00000001:02000400:2.0F:1787367615.777988:0:3303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787367634.144120:0:3528:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787367636.145722:0:3588:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 569 MB/s 00000001:01000000:1.0F:1787367636.397377:0:3588:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 605 MB/s 00000001:01000000:2.0:1787367636.647941:0:3588:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3091 MB/s 00000020:02000000:2.0:1787367637.530659:0:3620:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_45_gb800aec 00000400:02000000:2.0:1787367638.684805:0:3635:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.104@tcp [8/256/0/180] 00008000:02000000:3.0:1787367643.101686:0:3785:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787367701.781532:0:5765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787367716.081722:0:6515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787367716.081728:0:6515:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787367716.081730:0:6515:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787367716.081863:0:6515:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f73a1ec1 00000080:02000400:2.0:1787367716.081873:0:6515:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787367716.096079:0:6515:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787367716.096092:0:6515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787367716.096116:0:6515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b3d8960d) 00000020:00000080:2.0:1787367716.096133:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787367716.146270:0:6515:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787367716.146353:0:6515:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1787367716.158743:0:6515:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787367716.158987:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787367716.158996:0:6515:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787367716.159008:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff0301c9 00000020:01000004:1.0:1787367716.159015:0:6515:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787367716.159019:0:6515:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787367716.159026:0:6515:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f73a1ec1 from MGS 00000020:01000004:1.0:1787367716.159031:0:6515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787367716.159049:0:6515:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a5a32219) 00000020:00000080:1.0:1787367716.159065:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787367716.159179:0:6515:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f73a1ec1 from MGS, refs=2 00080000:01000000:1.0:1787367716.159185:0:6515:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787367716.159191:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff0301d7 00000100:00100000:1.0:1787367716.159282:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787367716.161080:0:6515:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787367716.161088:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787367716.161726:0:6515:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787367716.161734:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787367716.164863:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367716.165144:0:6515:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787367716.165150:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787367716.176804:0:6515:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787367716.176820:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787367716.177596:0:6515:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787367716.177604:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787367716.181630:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367716.181636:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367716.181638:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367716.189438:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367716.189445:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367716.189447:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367716.190811:0:6515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787367716.194686:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787367716.441819:0:6515:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2326 MB/s 00000001:01000000:0.0:1787367716.692441:0:6515:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7055 MB/s 00000001:01000000:3.0:1787367716.942485:0:6515:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 903 MB/s 00000001:01000000:2.0:1787367717.192591:0:6515:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1511 MB/s 00080000:10000000:2.0:1787367717.201699:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1787367717.208677:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787367717.210236:0:6515:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787367717.211943:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787367717.211998:0:6515:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787367717.212036:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787367717.212182:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787367717.212202:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787367717.212750:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787367717.212976:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787367717.212982:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787367717.215927:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787367717.215939:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787367717.224289:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787367717.224306:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787367717.229701:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787367717.229725:0:6515:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.104@tcp' 00000020:01000004:2.0:1787367717.229727:0:6515:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787367717.229773:0:6515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.104@tcp (typ=mgc) 00000020:00000080:2.0:1787367717.229791:0:6515:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.104@tcp (00000000cc3d74a5) 00000020:00000080:2.0:1787367717.229821:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787367717.229896:0:6515:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000031bc1822@MGC192.168.203.104@tcp: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1787367717.230238:0:6515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.104@tcp-0 is initialized 00000040:01000000:2.0:1787367717.230244:0:6515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787367717.231284:0:6534:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787367717.234502:0:6535:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787367717.234554:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.104@tcp (uuid c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f) 00000020:00000080:0.0:1787367717.234576:0:6515:0:(genops.c:1385:class_connect()) connect: client c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f, cookie 0x66f5679bff0301e5 00000100:00080000:0.0:1787367717.234588:0:6515:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787367717.234594:0:6515:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import 0000000031bc1822 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787367717.234643:0:6515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001227ad3c x1874190808383616/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787367717.234665:0:6515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS 00000020:01000004:0.0:1787367717.234682:0:6515:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787367717.234688:0:6515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787367717.234707:0:6515:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000001513ff53) 00000020:00000080:0.0:1787367717.234720:0:6515:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787367717.237142:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001227ad3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3650:1874190808383616:0@lo:250: 00000100:00100000:2.0:1787367717.237223:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367717.237309:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808383616 00000100:00100000:2.0:1787367717.237328:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808383616 00000100:00100000:2.0:1787367717.237393:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367717.237401:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032d5395a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3650:x1874190808383616:12345-0@lo:250: 00010000:00080000:2.0:1787367717.237425:0:6530:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:2.0:1787367717.237454:0:6530:0:(genops.c:1385:class_connect()) connect: client c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f, cookie 0x66f5679bff0301f3 00000100:00080000:2.0:1787367717.237569:0:6530:0:(import.c:65:import_set_state_nolock()) 00000000815b1cb1 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787367717.237617:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032d5395a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:3650:x1874190808383616:12345-0@lo:250: Request processed in 216us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367717.237624:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367717.237688:0:3650:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787367717.237696:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:2.0:1787367717.237702:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787367717.237706:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787367717.237709:0:3650:0:(import.c:65:import_set_state_nolock()) 0000000031bc1822 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787367717.237711:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787367717.237714:0:3650:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787367717.237718:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001227ad3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3650:1874190808383616:0@lo:250: 00000100:00100000:0.0:1787367717.248296:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367717.248525:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787367717.248531:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787367717.249434:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787367717.249494:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787367717.249834:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787367717.249839:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787367717.250336:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367717.250471:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787367717.250474:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787367717.251116:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787367717.251122:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787367717.280693:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367717.280885:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787367717.280894:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787367717.282336:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787367717.282348:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787367717.288241:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367717.289927:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787367717.289935:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787367717.294352:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787367717.294450:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787367717.295723:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367717.295890:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787367717.295896:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787367717.296449:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787367717.296455:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787367717.297174:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367717.297331:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787367717.297336:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787367717.297963:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787367717.297971:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787367717.316711:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787367717.316903:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787367717.316909:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787367717.318253:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787367717.318336:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787367717.323232:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787367717.323246:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787367717.330678:0:6515:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787367717.330717:0:6515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787367717.330722:0:6515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787367717.330817:0:6515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787367717.330856:0:6515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787367717.330860:0:6515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787367717.330862:0:6515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787367717.330863:0:6515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367717.330864:0:6515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367717.330866:0:6515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367717.330867:0:6515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367717.330868:0:6515:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787367717.330870:0:6515:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787367717.330871:0:6515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367717.330872:0:6515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367717.330874:0:6515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367717.330875:0:6515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787367717.330877:0:6515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787367717.330880:0:6515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787367717.330881:0:6515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787367717.330883:0:6515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367717.330884:0:6515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367717.330885:0:6515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367717.330886:0:6515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367717.330887:0:6515:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787367717.330888:0:6515:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787367717.330889:0:6515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367717.330890:0:6515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367717.330891:0:6515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367717.330892:0:6515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787367717.330928:0:6515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787367717.330948:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022249d69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808383744:0@lo:253: 00000100:00100000:3.0:1787367717.331020:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367717.331111:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023f964d8 going to sleep for 11 seconds 00000100:00100000:2.0:1787367717.335854:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808383744 00000100:00100000:2.0:1787367717.335867:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808383744 00000100:00100000:2.0:1787367717.335970:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367717.335979:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6ae5d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6515:x1874190808383744:12345-0@lo:253: 20000000:01000000:2.0:1787367717.336037:0:6533:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787367717.336040:0:6533:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787367717.337875:0:6554:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787367717.337941:0:6533:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787367717.338208:0:6533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787367717.340309:0:6555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787367717.345670:0:6533:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787367717.345677:0:6533:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787367717.345683:0:6533:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787367717.345686:0:6533:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787367717.345696:0:6533:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787367717.345871:0:6533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367717.346070:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787367717.346085:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787367717.346101:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787367717.346118:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787367717.346143:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787367717.346192:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787367717.346199:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787367717.346210:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787367717.346215:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787367717.346226:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787367717.346230:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787367717.346242:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787367717.346256:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787367717.346281:0:6533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787367717.346286:0:6533:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787367717.346292:0:6533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367717.347746:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787367717.347766:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787367717.347789:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787367717.347806:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787367717.347833:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787367717.347845:0:6533:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787367717.347873:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787367717.347879:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787367717.347889:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787367717.347900:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787367717.347911:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787367717.347918:0:6533:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787367717.347933:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787367717.347939:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787367717.347949:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787367717.347960:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787367717.348004:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787367717.348019:0:6533:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787367717.348026:0:6533:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787367717.352017:0:6556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787367717.355682:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787367717.355723:0:6533:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.104@tcp for mdt 20000000:01000000:0.0:1787367717.355725:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1787367717.355738:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787367717.355743:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787367717.355753:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787367717.355757:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1787367717.355766:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787367717.355772:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787367717.355782:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787367717.355794:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787367717.355819:0:6533:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787367717.355822:0:6533:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787367717.355825:0:6533:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787367717.355876:0:6533:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787367717.355878:0:6533:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787367717.359830:0:6557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787367717.360129:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787367717.360161:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787367717.360193:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787367717.360209:0:6533:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787367717.360212:0:6533:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787367717.372710:0:6558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787367717.379810:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787367717.379846:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787367717.379862:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787367717.379876:0:6533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367717.379879:0:6533:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787367717.379885:0:6533:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787367717.379887:0:6533:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787367717.379892:0:6533:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787367717.379899:0:6533:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787367717.388932:0:6559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787367717.389127:0:6533:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787367717.404908:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787367717.404942:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787367717.404957:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787367717.404975:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787367717.404993:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405010:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405019:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405025:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405031:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405037:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405043:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aee7148d already unused, calling callback (00000000e280a026) 00010000:00010000:3.0:1787367717.405046:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405062:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405074:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405081:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.405086:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aee7148d/0x66f5679bff0301fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787367717.405105:0:6533:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787367717.423572:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6ae5d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6515:x1874190808383744:12345-0@lo:253: Request processed in 87586us (92544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367717.423592:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367717.423645:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022249d69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808383744:0@lo:253: 10000000:01000000:0.0:1787367717.423662:0:6515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787367717.423665:0:6515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787367717.423667:0:6515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787367717.423668:0:6515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367717.423669:0:6515:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787367717.423670:0:6515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367717.423671:0:6515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367717.423672:0:6515:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787367717.423674:0:6515:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787367717.423675:0:6515:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787367717.423676:0:6515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367717.423678:0:6515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787367717.423706:0:6515:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f73a1ec1 from lustre-MDT0000 10000000:01000000:0.0:1787367717.423734:0:6515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787367717.423736:0:6515:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787367717.423741:0:6515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c55b8aab370 10000000:01000000:0.0:1787367717.423744:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787367717.423751:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c55b8aab370 from 1 10000000:01000000:0.0:1787367717.423754:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787367717.423788:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.423797:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.423805:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367717.423821:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808383872:0@lo:101: 00000100:00100000:0.0:1787367717.423932:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367717.423985:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089e73692 going to sleep for 11 seconds 00000100:00100000:1.0:1787367717.424107:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808383872 00000100:00100000:1.0:1787367717.424120:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808383872 00000100:00100000:1.0:1787367717.424162:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367717.424170:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000001a2f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6515:x1874190808383872:12345-0@lo:101: 00010000:00010000:1.0:1787367717.424182:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367717.424193:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030201 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.424215:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030201 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.424224:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030201 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.424231:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da1c74e6, rc 0) 00000100:00100000:1.0:1787367717.424269:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000001a2f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:6515:x1874190808383872:12345-0@lo:101: Request processed in 101us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367717.424273:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367717.424340:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808383872:0@lo:101: 00010000:00010000:0.0:1787367717.424351:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.424386:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367717.424436:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384000:0@lo:501: 00000100:00100000:0.0:1787367717.424472:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367717.424488:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089e73692 going to sleep for 11 seconds 00000100:00100000:3.0:1787367717.424613:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808384000 00000100:00100000:3.0:1787367717.424618:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808384000 00000100:00100000:3.0:1787367717.424667:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367717.424674:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000378b5ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:6515:x1874190808384000:12345-0@lo:501: 00000100:00100000:3.0:1787367717.424747:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000378b5ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:6515:x1874190808384000:12345-0@lo:501: Request processed in 75us (285us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787367717.424755:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787367717.424887:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384000:0@lo:501: 10000000:01000000:0.0:1787367717.424917:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787367717.424936:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.424944:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367717.424953:0:6515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c55834d5000 10000000:01000000:0.0:1787367717.424958:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787367717.424961:0:6515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c55834d5000 10000000:01000000:0.0:1787367717.424964:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787367717.424967:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c55834d5000 from 1 10000000:01000000:0.0:1787367717.424969:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787367717.425203:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000064f4c7b/0x66f5679bff03020f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.425212:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000064f4c7b/0x66f5679bff03020f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.425221:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000064f4c7b/0x66f5679bff03020f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367717.425232:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384128:0@lo:101: 00000100:00100000:0.0:1787367717.425262:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367717.425280:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089e73692 going to sleep for 11 seconds 00000100:00100000:3.0:1787367717.425381:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808384128 00000100:00100000:3.0:1787367717.425386:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808384128 00000100:00100000:3.0:1787367717.425410:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787367717.425416:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cda3d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:6515:x1874190808384128:12345-0@lo:101: 00010000:00010000:3.0:1787367717.425425:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367717.425441:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aee7148d/0x66f5679bff030216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03020f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.425458:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aee7148d/0x66f5679bff030216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03020f expref: 7 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.425466:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aee7148d/0x66f5679bff030216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03020f expref: 7 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.425474:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aee7148d, rc 0) 00000100:00100000:3.0:1787367717.425502:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cda3d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+7:6515:x1874190808384128:12345-0@lo:101: Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367717.425508:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367717.425664:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384128:0@lo:101: 00010000:00010000:0.0:1787367717.425676:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000064f4c7b/0x66f5679bff03020f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.425693:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000064f4c7b/0x66f5679bff03020f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367717.425705:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787367717.425717:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000064f4c7b/0x66f5679bff03020f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.425723:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000064f4c7b/0x66f5679bff03020f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367717.425730:0:6515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787367717.425733:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787367717.425738:0:6515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c55834d5000 10000000:01000000:0.0:1787367717.425740:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787367717.425743:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787367717.425744:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787367717.425757:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.425763:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.425769:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367717.425780:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384256:0@lo:101: 00000100:00100000:0.0:1787367717.425805:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367717.425820:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089e73692 going to sleep for 11 seconds 00000100:00100000:3.0:1787367717.425880:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808384256 00000100:00100000:3.0:1787367717.425885:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808384256 00000100:00100000:3.0:1787367717.425911:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787367717.425916:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ff847c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+7:6515:x1874190808384256:12345-0@lo:101: 00010000:00010000:3.0:1787367717.425923:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367717.425929:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03021d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.425941:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03021d expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.425948:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03021d expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.425955:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c474c00, rc 0) 00000100:00100000:3.0:1787367717.425980:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ff847c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+8:6515:x1874190808384256:12345-0@lo:101: Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367717.425994:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367717.426191:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384256:0@lo:101: 00010000:00010000:0.0:1787367717.426201:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.426207:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367717.426250:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384384:0@lo:501: 00000100:00100000:0.0:1787367717.426273:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367717.426282:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089e73692 going to sleep for 11 seconds 00000100:00100000:3.0:1787367717.426339:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808384384 00000100:00100000:3.0:1787367717.426343:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808384384 00000100:00100000:3.0:1787367717.426389:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367717.426395:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e84efac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+8:6515:x1874190808384384:12345-0@lo:501: 00000100:00100000:3.0:1787367717.426650:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e84efac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:6515:x1874190808384384:12345-0@lo:501: Request processed in 255us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367717.426657:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787367717.426851:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384384:0@lo:501: 00000100:00100000:0.0:1787367717.426883:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384512:0@lo:503: 00000100:00100000:0.0:1787367717.426921:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367717.426952:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089e73692 going to sleep for 11 seconds 00000100:00100000:3.0:1787367717.426986:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808384512 00000100:00100000:3.0:1787367717.426991:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808384512 00000100:00100000:3.0:1787367717.427025:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787367717.427032:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004700b788 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:6515:x1874190808384512:12345-0@lo:503: 00000100:00100000:3.0:1787367717.427190:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004700b788 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:6515:x1874190808384512:12345-0@lo:503: Request processed in 160us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367717.427198:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787367717.427288:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384512:0@lo:503: 00000100:00100000:3.0:1787367717.427873:0:6560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc779681 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6560:1874190808384640:0@lo:502: 00000100:00100000:3.0:1787367717.427914:0:6560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367717.427969:0:6560:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2d7ceaf going to sleep for 11 seconds 00000100:00100000:1.0:1787367717.428171:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808384640 00000100:00100000:1.0:1787367717.428177:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808384640 00000100:00100000:1.0:1787367717.428248:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787367717.428255:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae9f403a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:6560:x1874190808384640:12345-0@lo:502: 00000100:00100000:1.0:1787367717.428392:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae9f403a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:6560:x1874190808384640:12345-0@lo:502: Request processed in 101us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367717.428400:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787367717.428511:0:6560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc779681 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6560:1874190808384640:0@lo:502: 00000020:01000000:0.0:1787367717.428660:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367717.428671:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367717.428673:0:6560:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787367717.428678:0:6560:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787367717.428680:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787367717.428693:0:6560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f3e18894) 00000020:00000080:0.0:1787367717.428710:0:6560:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787367717.428715:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787367717.428802:0:6560:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787367717.428809:0:6560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff030232 00000020:00000080:0.0:1787367717.429040:0:6560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787367717.429045:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367717.429049:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367717.429054:0:6560:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787367717.429057:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367717.429060:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367717.429061:0:6560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787367717.429064:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787367717.429071:0:6560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000041a03905) 00000020:00000080:0.0:1787367717.429080:0:6560:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787367717.429084:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787367717.429086:0:6560:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787367717.429088:0:6560:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787367717.429094:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787367717.429140:0:6560:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f73a1ec1 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787367717.429152:0:6560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000c85f5c3) 00000020:00000080:0.0:1787367717.429159:0:6560:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787367717.429220:0:6560:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787367717.429226:0:6560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff030247 00000020:00000080:0.0:1787367717.429327:0:6560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787367717.429334:0:6560:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787367717.429338:0:6560:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x66f5679bff03024e 00080000:01000000:0.0:1787367717.429343:0:6560:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787367717.429346:0:6560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff030255 00080000:10000000:0.0:1787367717.429909:0:6560:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787367717.430035:0:6560:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787367717.437217:0:6560:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787367717.583713:0:6560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787367717.584128:0:6560:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787367717.588775:0:6560:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787367717.589104:0:6560:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787367717.598212:0:6560:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006811cc86) 00000020:00000080:2.0:1787367717.598232:0:6560:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787367717.598309:0:6560:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787367717.598335:0:6560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff030263 00000020:00000080:0.0:1787367717.599099:0:6560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787367717.600496:0:6560:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1787367717.621348:0:6560:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1787367717.624807:0:6560:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1787367717.628587:0:6560:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1787367717.631328:0:6560:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1787367717.633995:0:6560:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1787367717.636018:0:6560:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x66f5679bff03026a 00000020:00000080:2.0:1787367717.636840:0:6560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787367717.636852:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367717.636858:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367717.636860:0:6560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787367717.636863:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367717.636867:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367717.636868:0:6560:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787367717.636871:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367717.636872:0:6560:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787367717.636874:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367717.636877:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367717.636878:0:6560:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787367717.636880:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367717.636884:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367717.636885:0:6560:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787367717.636889:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787367717.636941:0:6560:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787367717.637006:0:6560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097ea072d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6560:1874190808384768:0@lo:502: 00000100:00100000:2.0:1787367717.637082:0:6560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367717.637267:0:6560:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de47cd37 going to sleep for 11 seconds 00000100:00100000:0.0:1787367717.637421:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808384768 00000100:00100000:0.0:1787367717.637429:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808384768 00000100:00100000:0.0:1787367717.637464:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787367717.637472:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000956c500a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:6560:x1874190808384768:12345-0@lo:502: 00000100:00100000:0.0:1787367717.637673:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000956c500a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:6560:x1874190808384768:12345-0@lo:502: Request processed in 201us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367717.637690:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787367717.637902:0:6560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097ea072d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6560:1874190808384768:0@lo:502: 00000020:01000000:2.0:1787367717.637930:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367717.637935:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367717.637936:0:6560:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787367717.637939:0:6560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787367717.638165:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787367717.638187:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787367717.638210:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.638222:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367717.638230:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55834d5000 from 1 10000000:01000000:0.0:1787367717.638233:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787367717.638257:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.638264:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.638272:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367717.638287:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021560888 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384896:0@lo:101: 00000100:00100000:0.0:1787367717.638331:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367717.638474:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808384896 00000100:00100000:2.0:1787367717.638480:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808384896 00000100:00100000:2.0:1787367717.638508:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787367717.638526:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0f6df98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:6515:x1874190808384896:12345-0@lo:101: 00010000:00010000:2.0:1787367717.638543:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367717.638562:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030271 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367717.638583:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030271 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367717.638592:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030271 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367717.638599:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ae86fa6, rc 0) 00000100:00100000:2.0:1787367717.638627:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0f6df98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+10:6515:x1874190808384896:12345-0@lo:101: Request processed in 102us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367717.638633:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787367717.640015:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d359c2e going to sleep for 11 seconds 00000100:00100000:0.0:1787367717.640048:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021560888 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808384896:0@lo:101: 00010000:00010000:0.0:1787367717.640066:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.640076:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367717.640879:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021560888 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385024:0@lo:256: 00000100:00100000:0.0:1787367717.640944:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367717.640983:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d359c2e going to sleep for 11 seconds 00000100:00100000:2.0:1787367717.641083:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808385024 00000100:00100000:2.0:1787367717.641090:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808385024 00000100:00100000:2.0:1787367717.641136:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787367717.641144:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090a2138d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+10:6515:x1874190808385024:12345-0@lo:256: 20000000:01000000:2.0:1787367717.641162:0:6532:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787367717.641168:0:6532:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787367717.641233:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090a2138d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+10:6515:x1874190808385024:12345-0@lo:256: Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367717.641241:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787367717.641968:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021560888 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385024:0@lo:256: 10000000:01000000:3.0:1787367717.642635:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367717.642646:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.642656:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367717.645018:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55834d5000 from 1 10000000:01000000:3.0:1787367717.645022:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367717.645066:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.645075:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.645085:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367717.645108:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385152:0@lo:101: 00000100:00100000:3.0:1787367717.645172:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367717.645298:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b035d44 going to sleep for 11 seconds 00000100:00100000:0.0:1787367717.646924:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808385152 00000100:00100000:0.0:1787367717.646937:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808385152 00000100:00100000:0.0:1787367717.647031:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787367717.647041:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c5aa204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+10:6515:x1874190808385152:12345-0@lo:101: 00010000:00010000:0.0:1787367717.647056:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367717.647074:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03027f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.647099:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03027f expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.647109:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03027f expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.647116:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008768eaf1, rc 0) 00000100:00100000:0.0:1787367717.647183:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c5aa204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:6515:x1874190808385152:12345-0@lo:101: Request processed in 144us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367717.647191:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787367717.647277:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385152:0@lo:101: 00010000:00010000:3.0:1787367717.647294:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.647303:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367717.647391:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385280:0@lo:501: 00000100:00100000:3.0:1787367717.647421:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367717.647685:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b035d44 going to sleep for 11 seconds 00000100:00100000:2.0:1787367717.647788:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808385280 00000100:00100000:2.0:1787367717.647795:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808385280 00000100:00100000:2.0:1787367717.647820:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787367717.647826:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b30d90c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:6515:x1874190808385280:12345-0@lo:501: 00000100:00100000:2.0:1787367717.647980:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b30d90c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:6515:x1874190808385280:12345-0@lo:501: Request processed in 154us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367717.647988:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787367717.648092:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385280:0@lo:501: 00000100:00100000:3.0:1787367717.648122:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385408:0@lo:503: 00000100:00100000:3.0:1787367717.648169:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367717.648191:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b035d44 going to sleep for 11 seconds 00000100:00100000:2.0:1787367717.648392:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808385408 00000100:00100000:2.0:1787367717.648397:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808385408 00000100:00100000:2.0:1787367717.648415:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367717.648421:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db01d9ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:6515:x1874190808385408:12345-0@lo:503: 00000040:00080000:2.0:1787367717.648450:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367717.648486:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db01d9ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:6515:x1874190808385408:12345-0@lo:503: Request processed in 65us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367717.648492:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787367717.648701:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385408:0@lo:503: 00000040:00080000:3.0:1787367717.649380:0:6564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787367717.649435:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787367717.649453:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367717.649467:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.649477:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367717.649754:0:6515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787367717.649757:0:6515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c55834d5000 10000000:01000000:3.0:1787367717.649760:0:6515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c55834d5000 10000000:01000000:3.0:1787367717.649765:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787367717.649770:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55834d5000 from 1 10000000:01000000:3.0:1787367717.649773:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787367717.649858:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.649867:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.649875:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367717.649891:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385536:0@lo:101: 00000100:00100000:3.0:1787367717.649936:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367717.650207:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2d7ceaf going to sleep for 11 seconds 00000100:00100000:0.0:1787367717.650778:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808385536 00000100:00100000:0.0:1787367717.650795:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808385536 00000100:00100000:0.0:1787367717.650834:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787367717.650842:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff8aa0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:6515:x1874190808385536:12345-0@lo:101: 00010000:00010000:0.0:1787367717.650854:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367717.650866:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03028d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.650897:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03028d expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.650906:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03028d expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.650914:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3dffe3c, rc 0) 00000100:00100000:0.0:1787367717.650965:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff8aa0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6515:x1874190808385536:12345-0@lo:101: Request processed in 124us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367717.650972:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367717.651091:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385536:0@lo:101: 00010000:00010000:3.0:1787367717.651105:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.651113:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367717.651168:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385664:0@lo:501: 00000100:00100000:3.0:1787367717.651194:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367717.651222:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2d7ceaf going to sleep for 11 seconds 00000100:00100000:3.0:1787367717.651429:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808385664 00000100:00100000:3.0:1787367717.651433:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808385664 00000100:00100000:3.0:1787367717.651454:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367717.651459:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d24c0274 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6515:x1874190808385664:12345-0@lo:501: 00000100:00100000:3.0:1787367717.651574:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d24c0274 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6515:x1874190808385664:12345-0@lo:501: Request processed in 114us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367717.651582:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367717.651610:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385664:0@lo:501: 00000100:00100000:3.0:1787367717.651638:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385792:0@lo:503: 00000100:00100000:3.0:1787367717.651675:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367717.651689:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2d7ceaf going to sleep for 11 seconds 00000100:00100000:3.0:1787367717.651701:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808385792 00000100:00100000:3.0:1787367717.651705:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808385792 00000100:00100000:3.0:1787367717.651723:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367717.651727:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000772bdf1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6515:x1874190808385792:12345-0@lo:503: 00000100:00100000:3.0:1787367717.651817:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000772bdf1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6515:x1874190808385792:12345-0@lo:503: Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367717.651830:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367717.651867:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808385792:0@lo:503: 00000100:00100000:3.0:1787367717.652027:0:6565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6565:1874190808385920:0@lo:502: 00000100:00100000:3.0:1787367717.652060:0:6565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367717.652078:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808385920 00000100:00100000:3.0:1787367717.652081:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808385920 00000100:00100000:3.0:1787367717.652098:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787367717.652103:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000912465f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6565:x1874190808385920:12345-0@lo:502: 00000100:00100000:3.0:1787367717.652169:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000912465f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6565:x1874190808385920:12345-0@lo:502: Request processed in 66us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367717.652176:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787367717.652203:0:6565:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f3c76c3e going to sleep for 11 seconds 00000100:00100000:3.0:1787367717.652214:0:6565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000817b31b2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6565:1874190808385920:0@lo:502: 00000020:01000004:3.0:1787367717.652263:0:6565:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787367717.652285:0:6565:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000012633fe1) 00000020:00000080:3.0:1787367717.652303:0:6565:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787367717.652457:0:6565:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f73a1ec1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787367717.652461:0:6565:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f73a1ec1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787367717.652464:0:6565:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f73a1ec1 4 00010000:00080000:3.0:1787367717.652490:0:6565:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005a9c204c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1787367717.654043:0:6565:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787367717.658963:0:6565:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787367717.659009:0:6565:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787367717.659021:0:6565:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x66f5679bff0302a2 00000100:00080000:2.0:1787367717.659041:0:6565:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367717.659046:0:6565:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005a9c204c using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787367717.659079:0:6565:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000097ea072d x1874190808386048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787367717.659113:0:6565:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787367717.659258:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097ea072d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808386048:0@lo:38: 00000100:00100000:0.0:1787367717.659337:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367717.659716:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808386048 00000100:00100000:2.0:1787367717.659724:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808386048 00000100:00100000:2.0:1787367717.659853:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367717.659859:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b354f34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808386048:12345-0@lo:38: 00000100:00100000:2.0:1787367717.659925:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b354f34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808386048:12345-0@lo:38: Request processed in 65us (588us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787367717.659932:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367717.665262:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787367717.665274:0:3650:0:(import.c:65:import_set_state_nolock()) 000000005a9c204c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787367717.665282:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787367717.665286:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097ea072d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808386048:0@lo:38: 00000100:00100000:2.0:1787367717.665706:0:6565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000205ff524 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6565:1874190808386176:0@lo:502: 00000100:00100000:2.0:1787367717.665788:0:6565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367717.665832:0:6565:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff67557d going to sleep for 11 seconds 00000100:00100000:0.0:1787367717.665947:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808386176 00000100:00100000:0.0:1787367717.665954:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808386176 00000100:00100000:0.0:1787367717.666003:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787367717.666012:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000949ed52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6565:x1874190808386176:12345-0@lo:502: 00000100:00100000:0.0:1787367717.666137:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000949ed52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6565:x1874190808386176:12345-0@lo:502: Request processed in 126us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367717.666145:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787367717.666389:0:6565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000205ff524 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6565:1874190808386176:0@lo:502: 00000040:00080000:2.0:1787367717.666424:0:6565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787367717.666730:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787367717.666750:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787367717.667087:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.667105:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787367717.667150:0:6515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787367717.667153:0:6515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787367717.667154:0:6515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367717.667156:0:6515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787367717.667157:0:6515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367717.667158:0:6515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367717.667160:0:6515:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787367717.667161:0:6515:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787367717.667162:0:6515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787367717.667164:0:6515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787367717.667165:0:6515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367717.667166:0:6515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787367717.667170:0:6515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787367717.667172:0:6515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787367717.667173:0:6515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787367717.667174:0:6515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367717.667175:0:6515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787367717.667176:0:6515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367717.667177:0:6515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367717.667179:0:6515:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787367717.667180:0:6515:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787367717.667180:0:6515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787367717.667181:0:6515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787367717.667182:0:6515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367717.667183:0:6515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787367717.667199:0:6515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787367717.667211:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c556784 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808386304:0@lo:253: 00000100:00100000:0.0:1787367717.667252:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367717.671978:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808386304 00000100:00100000:1.0:1787367717.671992:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808386304 00000100:00100000:1.0:1787367717.672056:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787367717.672065:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b37aff3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6515:x1874190808386304:12345-0@lo:253: 20000000:01000000:1.0:1787367717.672095:0:6533:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787367717.672119:0:6533:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787367717.672544:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ce4dcbb going to sleep for 11 seconds 20000000:01000000:1.0:1787367717.681265:0:6533:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787367717.681287:0:6533:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787367717.681324:0:6554:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787367717.681328:0:6554:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787367717.681379:0:6554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.681403:0:6554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030271 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.681411:0:6554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.681448:0:6554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030271 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367717.681469:0:6554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030271 expref: 12 pid: 6532 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367717.681550:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cb0aec2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808386432:0@lo:104: 00000100:00100000:0.0:1787367717.681611:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367717.681656:0:6554:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011ce307c going to sleep for 11 seconds 00000100:00100000:1.0:1787367717.681679:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b37aff3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6515:x1874190808386304:12345-0@lo:253: Request processed in 9615us (14427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367717.681689:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367717.681694:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c556784 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6515:1874190808386304:0@lo:253: 10000000:01000000:0.0:1787367717.681704:0:6515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787367717.681706:0:6515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787367717.681708:0:6515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787367717.681709:0:6515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367717.681711:0:6515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787367717.681712:0:6515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367717.681713:0:6515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367717.681714:0:6515:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787367717.681716:0:6515:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787367717.681717:0:6515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787367717.681718:0:6515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787367717.681720:0:6515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367717.681721:0:6515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787367717.681733:0:6515:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787367717.681774:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808386432 00000100:00100000:3.0:1787367717.681860:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808386432 00000100:00100000:3.0:1787367717.681908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367717.681916:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c861b9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808386432:12345-0@lo:104: 00010000:00010000:3.0:1787367717.681927:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.681980:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367717.681985:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c861b9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808386432:12345-0@lo:104: Request processed in 71us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367717.681992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367717.682017:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cb0aec2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808386432:0@lo:104: 00010000:00010000:3.0:1787367717.682030:0:6554:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682077:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367717.682083:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682090:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b845bd9f already unused, calling callback (000000002d4c1920) 10000000:00010000:1.0:1787367717.682092:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682099:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367717.682105:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367717.682111:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787367717.682154:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682162:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367717.682183:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682189:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000b845bd9f/0x66f5679bff030271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030278 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682206:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367717.682214:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367717.682215:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367717.682293:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367717.682302:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bebe885c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808386560:0@lo:103: 00000100:00100000:3.0:1787367717.682342:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367717.682444:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808386560 00000100:00100000:1.0:1787367717.682449:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808386560 00010000:00010000:1.0:1787367717.682503:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030271 expref: 12 pid: 6532 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367717.682692:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367717.682700:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000817b31b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:3651:x1874190808386560:12345-0@lo:103: 00010000:00010000:1.0:1787367717.682710:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367717.682715:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030271 expref: 12 pid: 6532 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682724:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030271 expref: 12 pid: 6532 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682736:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ae86fa6/0x66f5679bff030278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030271 expref: 12 pid: 6532 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682749:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682757:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787367717.682769:0:6523:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001441816s 00010000:00010000:1.0:1787367717.682773:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682792:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682809:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682815:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682820:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d429fbd9 already unused, calling callback (00000000e280a026) 00010000:00010000:1.0:1787367717.682823:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682830:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682843:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367717.682852:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367717.682885:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000817b31b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:3651:x1874190808386560:12345-0@lo:103: Request processed in 186us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367717.682891:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367717.684999:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bebe885c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808386560:0@lo:103: 00010000:00010000:3.0:1787367717.685029:0:6554:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.685039:0:6554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367717.685045:0:6554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d429fbd9/0x66f5679bff0302a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787367717.693457:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1787367717.694447:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787367717.696897:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1787367717.697332:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787367717.698425:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1787367717.698742:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787367717.704449:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1787367717.706026:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787367717.706273:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1787367717.706469:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787367717.706714:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1787367717.706891:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1787367717.723167:0:6515:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787367717.749751:0:6515:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787367717.750333:0:6570:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787367717.750338:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787367717.750739:0:6571:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787367717.756179:0:6515:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787367717.756855:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787367717.757786:0:6515:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787367717.757806:0:6515:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787367717.762060:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787367717.763823:0:6571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367717.772301:0:6515:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787367717.774787:0:6515:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787367717.774856:0:6515:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787367717.775520:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787367717.779748:0:6515:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1787367717.784270:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787367717.784484:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787367717.784797:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787367717.784934:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787367717.785081:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787367717.785241:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787367717.788051:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787367717.790138:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787367717.792012:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787367717.792208:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787367717.792738:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787367717.792881:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787367717.793082:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787367717.793250:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787367717.795874:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787367717.797844:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787367717.802778:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787367717.804853:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000040:00080000:3.0:1787367717.805844:0:6571:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787367717.806632:0:6571:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787367717.806639:0:6571:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1787367717.806983:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787367717.807151:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787367717.807305:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787367717.807524:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787367717.807686:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787367717.807824:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787367717.807974:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787367717.808127:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787367717.808259:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787367717.808450:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787367717.808595:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787367717.808729:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787367717.808872:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787367717.809008:0:6515:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787367717.809200:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787367717.830286:0:6515:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787367717.830340:0:6515:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafad01c9f988 00100000:10000000:2.0:1787367717.830348:0:6515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787367717.831728:0:6515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787367717.831743:0:6515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787367717.831763:0:6515:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787367717.831777:0:6515:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787367717.832695:0:6515:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787367717.832870:0:6515:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787367718.234753:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367719.256477:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367720.283892:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367721.305309:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787367722.230937:0:6816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787367722.329206:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787367722.394003:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787367722.394010:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55834d5000 from 3 10000000:01000000:2.0:1787367722.394016:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787367722.394057:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367722.394068:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367722.394078:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367722.394100:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000205ff524 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808386688:0@lo:101: 00000100:00100000:2.0:1787367722.394165:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367722.394216:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecdad025 going to sleep for 11 seconds 00000100:00100000:3.0:1787367722.394266:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808386688 00000100:00100000:3.0:1787367722.394274:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808386688 00000100:00100000:3.0:1787367722.394334:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787367722.394352:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be26ad17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:6535:x1874190808386688:12345-0@lo:101: 00010000:00010000:3.0:1787367722.394388:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367722.394401:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0302b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367722.394424:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0302b0 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367722.394453:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0302b0 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367722.394462:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003020072f, rc 0) 00000100:00100000:3.0:1787367722.394513:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be26ad17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6535:x1874190808386688:12345-0@lo:101: Request processed in 172us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367722.394520:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787367722.394730:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000205ff524 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808386688:0@lo:101: 00010000:00010000:1.0:1787367722.394745:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367722.394754:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367722.394818:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe6745b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808386816:0@lo:256: 00000100:00100000:1.0:1787367722.394853:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367722.394896:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000572dd4c2 going to sleep for 11 seconds 00000100:00100000:2.0:1787367722.395144:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808386816 00000100:00100000:2.0:1787367722.395149:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808386816 00000100:00100000:2.0:1787367722.395179:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787367722.395185:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066678773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6535:x1874190808386816:12345-0@lo:256: 20000000:01000000:2.0:1787367722.395199:0:6532:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787367722.395216:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787367722.395219:0:6532:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787367722.395309:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066678773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:6535:x1874190808386816:12345-0@lo:256: Request processed in 123us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367722.395321:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787367722.395625:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe6745b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808386816:0@lo:256: 10000000:01000000:1.0:1787367722.395673:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787367722.395680:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367722.395687:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367722.907015:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c556784 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808386944:0@lo:400: 00000100:00100000:1.0:1787367722.907084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787367722.907191:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787367722.907196:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787367722.907199:0:36:0:(import.c:65:import_set_state_nolock()) 000000005a9c204c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787367722.907207:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005a9c204c using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787367722.907228:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e4edfe80 x1874190808387072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787367722.907256:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808387072:0@lo:38: 00000100:00100000:0.0:1787367722.907299:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367722.907330:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808387072 00000100:00100000:3.0:1787367722.907338:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808387072 00000100:00100000:0.0:1787367722.907395:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367722.907401:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005527c4c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808387072:12345-0@lo:38: 00010000:00080000:0.0:1787367722.907423:0:6539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1787367722.907453:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x66f5679bff0302be 00000004:00100000:0.0:1787367722.907489:0:6539:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787367722.907623:0:6539:0:(import.c:65:import_set_state_nolock()) 000000001cfc5f14 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367722.907667:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005527c4c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874190808387072:12345-0@lo:38: Request processed in 265us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367722.907686:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787367722.907721:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e4edfe80 x1874190808387072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787367722.907744:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787367722.907751:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787367722.907755:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787367722.907756:0:3650:0:(import.c:65:import_set_state_nolock()) 000000005a9c204c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787367722.907761:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808387072:0@lo:38: 00000100:00100000:2.0:1787367722.907878:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808386944 00000100:00100000:2.0:1787367722.907882:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808386944 00000100:00100000:2.0:1787367722.907947:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787367722.907954:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004baba7a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:3653:x1874190808386944:12345-0@lo:400: 00000100:00100000:2.0:1787367722.908069:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004baba7a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:3653:x1874190808386944:12345-0@lo:400: Request processed in 117us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367722.908076:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787367722.908770:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c556784 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808386944:0@lo:400: 00000020:00000004:2.0:1787367722.944385:0:6868:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787367722.944563:0:6868:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787367723.352482:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367724.377028:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367725.403578:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787367725.650153:0:6969:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787367725.650693:0:6969:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787367726.429787:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367727.448500:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367728.029458:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808387328:0@lo:400: 00000100:00100000:0.0:1787367728.029740:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000efe70450 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808387200:0@lo:400: 00000100:00100000:0.0:1787367728.029775:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367728.029840:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808387200 00000100:00100000:0.0:1787367728.029847:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808387200 00000100:00100000:0.0:1787367728.029891:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787367728.029899:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dcf3bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:3654:x1874190808387200:12345-0@lo:400: 00000100:00100000:0.0:1787367728.029947:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dcf3bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:3654:x1874190808387200:12345-0@lo:400: Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367728.029954:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787367728.029998:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000efe70450 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808387200:0@lo:400: 00000100:00100000:2.0:1787367728.030485:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367728.031012:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808387328 00000100:00100000:0.0:1787367728.031018:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808387328 00000100:00100000:0.0:1787367728.031059:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367728.031066:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7475519 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808387328:12345-0@lo:400: 00000100:00100000:0.0:1787367728.031112:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7475519 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808387328:12345-0@lo:400: Request processed in 48us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367728.031129:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787367728.033887:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009cca8892 x1874190808387328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367728.033907:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808387328:0@lo:400: 00010000:00010000:2.0:1787367728.476438:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367729.498611:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367730.521701:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367731.547558:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367732.569289:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367733.146260:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367733.146299:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808387456:0@lo:400: 00000100:00100000:0.0:1787367733.146391:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367733.146441:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000082925c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808387584:0@lo:400: 00000100:00100000:0.0:1787367733.146470:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367733.146502:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808387456 00000100:00100000:0.0:1787367733.146509:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808387456 00000100:00100000:0.0:1787367733.146549:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787367733.146557:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014b3e578 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:3651:x1874190808387456:12345-0@lo:400: 00000100:00100000:0.0:1787367733.146603:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014b3e578 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:3651:x1874190808387456:12345-0@lo:400: Request processed in 47us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367733.146610:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787367733.146639:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808387584 00000100:00100000:0.0:1787367733.146643:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808387584 00000100:00100000:0.0:1787367733.146665:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367733.146670:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068813bf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808387584:12345-0@lo:400: 00000100:00100000:0.0:1787367733.146701:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068813bf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808387584:12345-0@lo:400: Request processed in 32us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367733.146707:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787367733.146738:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000082925c35 x1874190808387584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367733.146751:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000082925c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808387584:0@lo:400: 00000100:00100000:0.0:1787367733.146773:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808387456:0@lo:400: 00010000:00010000:1.0:1787367733.593436:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367734.617382:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787367734.761862:0:7468:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787367734.761866:0:7468:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787367734.761868:0:7468:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787367734.761995:0:7468:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000181d0333 00000020:01000004:3.0:1787367734.762011:0:7468:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1787367734.762022:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787367734.762035:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000001191ac51) 00000020:00000080:3.0:1787367734.762049:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787367734.841182:0:7468:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1787367734.841261:0:7468:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1787367734.882973:0:7468:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787367734.883182:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787367734.883193:0:7468:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787367734.883216:0:7468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff0302cc 00000020:01000004:0.0:1787367734.883228:0:7468:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787367734.883250:0:7468:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787367734.883252:0:7468:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787367734.883259:0:7468:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787367734.883285:0:7468:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787367734.883288:0:7468:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787367734.904677:0:7468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787367734.904717:0:7468:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1787367734.904721:0:7468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787367734.904723:0:7468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787367734.904724:0:7468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367734.904726:0:7468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787367734.904727:0:7468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367734.904728:0:7468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367734.904729:0:7468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787367734.904731:0:7468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787367734.904732:0:7468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787367734.904733:0:7468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367734.904735:0:7468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787367734.904737:0:7468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1787367734.904740:0:7468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787367734.904741:0:7468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787367734.904742:0:7468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367734.904743:0:7468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787367734.904744:0:7468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367734.904745:0:7468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367734.904746:0:7468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787367734.904747:0:7468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787367734.904748:0:7468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787367734.904749:0:7468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367734.904750:0:7468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787367734.904776:0:7468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787367734.904793:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808387712:0@lo:253: 00000100:00100000:0.0:1787367734.904870:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.904978:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c24a9bf5 going to sleep for 11 seconds 00000100:00100000:2.0:1787367734.905029:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808387712 00000100:00100000:2.0:1787367734.905037:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808387712 00000100:00100000:2.0:1787367734.905119:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787367734.905128:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e79a1f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:7468:x1874190808387712:12345-0@lo:253: 20000000:01000000:2.0:1787367734.905175:0:6533:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787367734.905180:0:6533:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1787367734.905185:0:6533:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1787367734.905187:0:6533:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1787367734.905228:0:6533:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1787367734.905685:0:6533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367734.905809:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787367734.905823:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787367734.905841:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787367734.905854:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787367734.905869:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787367734.905920:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1787367734.905928:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1787367734.905941:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1787367734.905946:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1787367734.905959:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1787367734.905963:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1787367734.905974:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787367734.905986:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787367734.906089:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1787367734.906098:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:2.0:1787367734.906108:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1787367734.906114:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787367734.906125:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1787367734.906130:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:2.0:1787367734.906141:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1787367734.906146:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787367734.906158:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787367734.906174:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787367734.906185:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787367734.906283:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1787367734.906292:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1787367734.906305:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787367734.906321:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787367734.906337:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1787367734.907562:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1787367734.908052:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1787367734.908103:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1787367734.908110:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1787367734.908154:0:6533:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787367734.908162:0:6533:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1787367734.909065:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787367734.909303:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787367734.909325:0:6533:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.104@tcp for mdt 20000000:01000000:0.0:1787367734.909328:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1787367734.909547:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787367734.909556:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787367734.909573:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787367734.909578:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1787367734.909594:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787367734.909821:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1787367734.909842:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1787367734.909862:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1787367734.909916:0:6533:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1787367734.909924:0:6533:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1787367734.910231:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1787367734.910425:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787367734.910441:0:6533:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.104@tcp for mdt 20000000:01000000:2.0:1787367734.910443:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:2.0:1787367734.910462:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787367734.910469:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787367734.910481:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787367734.910486:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:2.0:1787367734.910497:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787367734.910503:0:6533:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1787367734.910517:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787367734.910531:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1787367734.910550:0:6533:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787367734.910553:0:6533:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787367734.910556:0:6533:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787367734.910614:0:6533:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787367734.910616:0:6533:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787367734.911067:0:7476:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787367734.911088:0:7476:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787367734.911104:0:7476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787367734.911252:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787367734.911274:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787367734.911294:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787367734.911305:0:6533:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787367734.911307:0:6533:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787367734.917960:0:7477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787367734.918009:0:7477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787367734.918025:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1787367734.918234:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787367734.918253:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787367734.918268:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1787367734.918278:0:6533:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787367734.918280:0:6533:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787367734.918665:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787367734.918686:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787367734.918699:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787367734.918878:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1787367734.918911:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1787367734.918923:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1787367734.918933:0:6533:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787367734.918936:0:6533:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787367734.918940:0:6533:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787367734.918947:0:6533:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787367734.919231:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1787367734.919317:0:6533:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787367734.946598:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787367734.946703:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.946720:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030201 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.946728:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03021d expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.946733:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03028d expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.946740:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.946783:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03028d expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.946797:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03028d expref: 12 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367734.946809:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6533:1874190808387840:0@lo:104: 00000100:00100000:2.0:1787367734.946883:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367734.949823:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808387840 00000100:00100000:1.0:1787367734.949837:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808387840 00010000:00010000:2.0:1787367734.958127:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03021d expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.958148:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03021d expref: 12 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367734.958163:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e7f093 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6533:1874190808387968:0@lo:104: 00000100:00100000:2.0:1787367734.958238:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367734.958287:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030201 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.958295:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030201 expref: 12 pid: 6532 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367734.958303:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002bacdc3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6533:1874190808388096:0@lo:104: 00000100:00100000:2.0:1787367734.958323:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367734.965878:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bf15eb8 going to sleep for 11 seconds 00000100:00100000:3.0:1787367734.966017:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808387968 00000100:00100000:3.0:1787367734.966027:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808387968 00000100:00100000:3.0:1787367734.966063:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808388096 00000100:00100000:3.0:1787367734.966066:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808388096 00000100:00100000:3.0:1787367734.966082:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367734.966090:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cf0fcad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6533:x1874190808387840:12345-0@lo:104: 00010000:00010000:3.0:1787367734.966104:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.966240:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367734.966245:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cf0fcad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6533:x1874190808387840:12345-0@lo:104: Request processed in 157us (19363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367734.966253:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367734.966271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367734.966277:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0db938c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6533:x1874190808387968:12345-0@lo:104: 00010000:00010000:3.0:1787367734.966284:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.966318:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787367734.966322:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0db938c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6533:x1874190808387968:12345-0@lo:104: Request processed in 47us (8086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367734.966328:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787367734.966450:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367734.966455:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966463:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009dd0e78d already unused, calling callback (000000002d4c1920) 10000000:00010000:0.0:1787367734.966481:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966488:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367734.966495:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367734.966499:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367734.966533:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966540:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367734.966556:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966563:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 000000009dd0e78d/0x66f5679bff03028d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030294 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966574:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367734.966576:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966581:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000729a9030 already unused, calling callback (000000002d4c1920) 10000000:00010000:0.0:1787367734.966583:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966588:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367734.966621:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367734.966626:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367734.966639:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966645:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367734.966659:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966665:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000729a9030/0x66f5679bff03021d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030224 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.966675:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367734.966676:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367734.966678:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367734.966691:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000082925c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808388224:0@lo:103: 00000100:00100000:0.0:1787367734.966728:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.966764:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808388352:0@lo:103: 00000100:00100000:0.0:1787367734.966786:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.967805:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808388224 00000100:00100000:0.0:1787367734.967815:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808388224 00010000:00010000:0.0:1787367734.967845:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03028d expref: 13 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367734.967871:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808388352 00000100:00100000:0.0:1787367734.967874:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808388352 00010000:00010000:0.0:1787367734.967884:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03021d expref: 14 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367734.967909:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367734.967917:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077869395 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:3654:x1874190808388224:12345-0@lo:103: 00010000:00010000:0.0:1787367734.967928:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367734.967932:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03028d expref: 14 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.967943:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03028d expref: 14 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.967962:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367734.968005:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077869395 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:3654:x1874190808388224:12345-0@lo:103: Request processed in 90us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367734.968012:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367734.968026:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367734.968031:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8b4ee2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:3651:x1874190808388352:12345-0@lo:103: 00010000:00010000:0.0:1787367734.968038:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367734.968041:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03021d expref: 13 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.968048:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03021d expref: 13 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.968057:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367734.968080:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8b4ee2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:3651:x1874190808388352:12345-0@lo:103: Request processed in 49us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367734.968085:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367734.968120:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808388352:0@lo:103: 00000100:00100000:0.0:1787367734.968156:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000082925c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808388224:0@lo:103: 00000100:00100000:3.0:1787367734.969189:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367734.969221:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceb696c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6533:x1874190808388096:12345-0@lo:104: 00010000:00010000:3.0:1787367734.969233:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.969301:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367734.969315:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceb696c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6533:x1874190808388096:12345-0@lo:104: Request processed in 105us (10991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367734.969322:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787367734.969382:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367734.969387:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.969395:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f56ec98a already unused, calling callback (000000002d4c1920) 10000000:00010000:3.0:1787367734.969397:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.969405:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367734.969411:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367734.969416:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367734.969442:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.969447:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367734.969468:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.969474:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000f56ec98a/0x66f5679bff030201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030208 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.969489:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367734.969490:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367734.969492:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367734.969524:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026cb83c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808388480:0@lo:103: 00000100:00100000:3.0:1787367734.969559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367734.973572:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808388480 00000100:00100000:3.0:1787367734.973592:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808388480 00010000:00010000:3.0:1787367734.973653:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030201 expref: 13 pid: 6532 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367734.973708:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367734.973717:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fa45ff5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:3652:x1874190808388480:12345-0@lo:103: 00010000:00010000:3.0:1787367734.973731:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367734.973736:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030201 expref: 13 pid: 6532 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973747:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030201 expref: 13 pid: 6532 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973769:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973776:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973791:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973798:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973804:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973828:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973834:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c2c56340 already unused, calling callback (00000000e280a026) 00010000:00010000:3.0:1787367734.973837:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973845:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973854:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.973864:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367734.973935:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fa45ff5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:3652:x1874190808388480:12345-0@lo:103: Request processed in 220us (4376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367734.973944:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367734.973991:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026cb83c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808388480:0@lo:103: 00010000:00010000:0.0:1787367734.974186:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367734.974451:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3dffe3c/0x66f5679bff030294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03028d expref: 12 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367734.974466:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6533:1874190808387840:0@lo:104: 00010000:00010000:2.0:1787367734.974499:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c474c00/0x66f5679bff030224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03021d expref: 11 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367734.974508:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e7f093 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6533:1874190808387968:0@lo:104: 00010000:00010000:2.0:1787367734.974517:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000da1c74e6/0x66f5679bff030208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030201 expref: 10 pid: 6532 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367734.974525:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002bacdc3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6533:1874190808388096:0@lo:104: 00010000:00010000:2.0:1787367734.974554:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.974562:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.974568:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.974572:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c2c56340/0x66f5679bff0302d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787367734.974589:0:6533:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787367734.982764:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e79a1f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:7468:x1874190808387712:12345-0@lo:253: Request processed in 77630us (77887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367734.982780:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787367734.982986:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808387712:0@lo:253: 10000000:01000000:0.0:1787367734.983000:0:7468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787367734.983003:0:7468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787367734.983004:0:7468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787367734.983005:0:7468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367734.983006:0:7468:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1787367734.983008:0:7468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367734.983009:0:7468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367734.983010:0:7468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787367734.983011:0:7468:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787367734.983013:0:7468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367734.983014:0:7468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787367734.983032:0:7468:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000181d0333 from lustre-MDT0001 10000000:01000000:0.0:1787367734.983060:0:7468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787367734.983064:0:7468:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787367734.983071:0:7468:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c55b8aab370 local copy 10000000:01000000:0.0:1787367734.983075:0:7468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787367734.983106:0:7468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.983118:0:7468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.983127:0:7468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367734.983144:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808388608:0@lo:101: 00000100:00100000:0.0:1787367734.983179:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.983230:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb66f1e going to sleep for 11 seconds 00000100:00100000:3.0:1787367734.983285:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808388608 00000100:00100000:3.0:1787367734.983291:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808388608 00000100:00100000:3.0:1787367734.983333:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787367734.983350:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052eaf4b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+9:7468:x1874190808388608:12345-0@lo:101: 00010000:00010000:3.0:1787367734.983382:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367734.983394:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d012356/0x66f5679bff0302e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0302da expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.983426:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d012356/0x66f5679bff0302e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0302da expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.983436:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d012356/0x66f5679bff0302e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0302da expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.983444:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d012356, rc 0) 00000100:00100000:3.0:1787367734.983474:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052eaf4b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+10:7468:x1874190808388608:12345-0@lo:101: Request processed in 135us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367734.983480:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787367734.983616:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808388608:0@lo:101: 00010000:00010000:0.0:1787367734.983628:0:7468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.983637:0:7468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367734.983714:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808388736:0@lo:501: 00000100:00100000:0.0:1787367734.983740:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.983759:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb66f1e going to sleep for 11 seconds 00000100:00100000:3.0:1787367734.983863:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808388736 00000100:00100000:3.0:1787367734.983868:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808388736 00000100:00100000:3.0:1787367734.983900:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787367734.983906:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e640283f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+10:7468:x1874190808388736:12345-0@lo:501: 00000100:00100000:3.0:1787367734.983960:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e640283f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+10:7468:x1874190808388736:12345-0@lo:501: Request processed in 55us (220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787367734.983967:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787367734.984092:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808388736:0@lo:501: 10000000:01000000:0.0:1787367734.984103:0:7468:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787367734.984119:0:7468:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787367734.984123:0:7468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.984130:0:7468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.984136:0:7468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.984157:0:7468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787367734.984179:0:7468:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c55bc6be800 10000000:01000000:0.0:1787367734.984184:0:7468:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787367734.984188:0:7468:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c55b8aab370 10000000:01000000:0.0:1787367734.984190:0:7468:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787367734.984193:0:7468:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c55b8aab370 from 1 10000000:01000000:0.0:1787367734.984210:0:7468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787367734.984225:0:7468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000002462bc4a/0x66f5679bff0302e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.984232:0:7468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000002462bc4a/0x66f5679bff0302e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.984239:0:7468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000002462bc4a/0x66f5679bff0302e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367734.984250:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808388864:0@lo:101: 00000100:00100000:0.0:1787367734.984275:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.984301:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000001823df0c going to sleep for 11 seconds 00010000:00010000:3.0:1787367734.984349:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367734.984371:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.984379:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000083bf71b2 already unused, calling callback (000000002d4c1920) 10000000:00010000:3.0:1787367734.984382:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.984389:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367734.984421:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367734.984426:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367734.984444:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.984449:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367734.984466:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.984473:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 0000000083bf71b2/0x66f5679bff0302da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x66f5679bff0302e1 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.984488:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367734.984489:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367734.984491:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367734.984598:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808388864 00000100:00100000:2.0:1787367734.984616:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808388864 00000100:00100000:2.0:1787367734.984649:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787367734.984656:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000613d8176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+10:7468:x1874190808388864:12345-0@lo:101: 00010000:00010000:2.0:1787367734.984664:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367734.984674:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9789f40/0x66f5679bff0302ef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0302e8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.984689:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9789f40/0x66f5679bff0302ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0302e8 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.984697:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9789f40/0x66f5679bff0302ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0302e8 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367734.984703:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9789f40, rc 0) 00000100:00100000:2.0:1787367734.984733:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000613d8176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:7468:x1874190808388864:12345-0@lo:101: Request processed in 79us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367734.984748:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787367734.984904:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026cb83c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808388992:0@lo:103: 00000100:00100000:0.0:1787367734.984934:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.985015:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808388864:0@lo:101: 00010000:00010000:0.0:1787367734.985026:0:7468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000002462bc4a/0x66f5679bff0302e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302ef expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985033:0:7468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000002462bc4a/0x66f5679bff0302e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0302ef expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367734.985046:0:7468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787367734.985063:0:7468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000002462bc4a/0x66f5679bff0302e8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302ef expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985069:0:7468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000002462bc4a/0x66f5679bff0302e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302ef expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367734.985089:0:7468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c55bc6be800 10000000:01000000:0.0:1787367734.985093:0:7468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787367734.985096:0:7468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c55bc6be800 from 1 10000000:01000000:0.0:1787367734.985098:0:7468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787367734.985112:0:7468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f40291a9/0x66f5679bff0302f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985117:0:7468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000f40291a9/0x66f5679bff0302f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985124:0:7468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000f40291a9/0x66f5679bff0302f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367734.985134:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389120:0@lo:101: 00000100:00100000:0.0:1787367734.985156:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.985168:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000001823df0c going to sleep for 11 seconds 00000100:00100000:0.0:1787367734.985181:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808389120 00000100:00100000:0.0:1787367734.985185:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808389120 00000100:00100000:0.0:1787367734.985221:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787367734.985227:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e89c5749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+11:7468:x1874190808389120:12345-0@lo:101: 00010000:00010000:0.0:1787367734.985234:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367734.985242:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092f27445/0x66f5679bff0302fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0302f6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985255:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092f27445/0x66f5679bff0302fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0302f6 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985263:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092f27445/0x66f5679bff0302fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0302f6 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985275:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092f27445, rc 0) 00000100:00100000:0.0:1787367734.985303:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e89c5749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:7468:x1874190808389120:12345-0@lo:101: Request processed in 76us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367734.985309:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787367734.985340:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389120:0@lo:101: 00010000:00010000:0.0:1787367734.985433:0:7468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000f40291a9/0x66f5679bff0302f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985439:0:7468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000f40291a9/0x66f5679bff0302f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367734.985449:0:7468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787367734.985452:0:7468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f40291a9/0x66f5679bff0302f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985458:0:7468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000f40291a9/0x66f5679bff0302f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367734.985463:0:7468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787367734.985466:0:7468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787367734.985470:0:7468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c55bc6be800 10000000:01000000:0.0:1787367734.985472:0:7468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787367734.985475:0:7468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787367734.985476:0:7468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787367734.985488:0:7468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000d1a993ea/0x66f5679bff030304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985493:0:7468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000d1a993ea/0x66f5679bff030304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.985504:0:7468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000d1a993ea/0x66f5679bff030304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367734.985514:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389248:0@lo:101: 00000100:00100000:0.0:1787367734.985537:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.985549:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000001823df0c going to sleep for 11 seconds 00000100:00100000:0.0:1787367734.985561:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808389248 00000100:00100000:0.0:1787367734.985564:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808389248 00000100:00100000:0.0:1787367734.985585:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787367734.985590:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007c5bec9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:7468:x1874190808389248:12345-0@lo:101: 00010000:00010000:0.0:1787367734.985596:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367734.986447:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000edf98e73/0x66f5679bff03030b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030304 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.986470:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edf98e73/0x66f5679bff03030b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030304 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.986478:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000edf98e73/0x66f5679bff03030b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030304 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.986485:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000edf98e73, rc 0) 00000100:00100000:0.0:1787367734.986528:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007c5bec9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808389248:12345-0@lo:101: Request processed in 937us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367734.986534:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787367734.986580:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389248:0@lo:101: 00010000:00010000:0.0:1787367734.986591:0:7468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000d1a993ea/0x66f5679bff030304 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367734.986840:0:7468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000d1a993ea/0x66f5679bff030304 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367734.986924:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389376:0@lo:501: 00000100:00100000:0.0:1787367734.986952:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.986969:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000001823df0c going to sleep for 11 seconds 00000100:00100000:0.0:1787367734.986986:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808389376 00000100:00100000:0.0:1787367734.986990:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808389376 00000100:00100000:0.0:1787367734.987017:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367734.987024:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f78a625e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808389376:12345-0@lo:501: 00000100:00100000:0.0:1787367734.987116:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f78a625e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808389376:12345-0@lo:501: Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367734.987122:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367734.987153:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389376:0@lo:501: 00000100:00100000:0.0:1787367734.987178:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389504:0@lo:503: 00000100:00100000:0.0:1787367734.987226:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.987239:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000001823df0c going to sleep for 11 seconds 00000100:00100000:0.0:1787367734.987252:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808389504 00000100:00100000:0.0:1787367734.987255:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808389504 00000100:00100000:0.0:1787367734.987275:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367734.987281:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072f2bce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808389504:12345-0@lo:503: 00000100:00100000:0.0:1787367734.987819:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072f2bce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808389504:12345-0@lo:503: Request processed in 537us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367734.987827:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367734.987872:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389504:0@lo:503: 00000040:00080000:0.0:1787367734.988113:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787367734.988177:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389632:0@lo:502: 00000100:00100000:0.0:1787367734.988231:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.988266:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000001823df0c going to sleep for 11 seconds 00000100:00100000:0.0:1787367734.988283:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808389632 00000100:00100000:0.0:1787367734.988286:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808389632 00000100:00100000:0.0:1787367734.988502:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367734.988510:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028d6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808389632:12345-0@lo:502: 00000100:00100000:0.0:1787367734.988595:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028d6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808389632:12345-0@lo:502: Request processed in 86us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367734.988724:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367734.988758:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389632:0@lo:502: 00000040:00080000:0.0:1787367734.988925:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787367734.988949:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1787367734.988964:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1787367734.988976:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1787367734.988988:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1787367734.989000:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1787367734.989030:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1787367734.989046:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1787367734.989060:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1787367734.989073:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1787367734.989085:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1787367734.989096:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1787367734.989106:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1787367734.989115:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1787367734.989125:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1787367734.989134:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1787367734.989144:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1787367734.989168:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1787367734.989179:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1787367734.989191:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000100:00100000:3.0:1787367734.989504:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808388992 00000100:00100000:3.0:1787367734.989509:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808388992 00000100:00100000:3.0:1787367734.989549:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367734.989556:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082925c35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:3653:x1874190808388992:12345-0@lo:103: 00010000:00010000:3.0:1787367734.989567:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367734.989583:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002d012356/0x66f5679bff0302e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0302da expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367734.989596:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367734.989655:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082925c35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:3653:x1874190808388992:12345-0@lo:103: Request processed in 100us (4721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367734.989662:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1787367734.991537:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1787367734.991565:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1787367734.991779:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1787367734.991824:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389760:0@lo:502: 00000100:00100000:0.0:1787367734.991891:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367734.997683:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000001823df0c going to sleep for 11 seconds 00000100:00100000:0.0:1787367734.997739:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026cb83c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808388992:0@lo:103: 00000100:00100000:2.0:1787367734.998106:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808389760 00000100:00100000:2.0:1787367734.998114:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808389760 00000100:00100000:2.0:1787367734.998155:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787367734.998161:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004424715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:7468:x1874190808389760:12345-0@lo:502: 00000100:00100000:2.0:1787367734.998320:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004424715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:7468:x1874190808389760:12345-0@lo:502: Request processed in 158us (6429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367734.998327:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787367734.998749:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4edfe80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808389760:0@lo:502: 00000040:00080000:0.0:1787367734.998825:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1787367734.998838:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1787367734.999265:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367734.999275:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367734.999277:0:7480:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787367734.999282:0:7480:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787367734.999284:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787367734.999297:0:7480:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000088d3be95) 00000020:00000080:2.0:1787367734.999315:0:7480:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1787367734.999320:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787367735.002046:0:7480:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787367735.002063:0:7480:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff030319 00000020:00000080:0.0:1787367735.002288:0:7480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787367735.002297:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367735.002303:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367735.002305:0:7480:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787367735.002308:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367735.002314:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367735.002315:0:7480:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787367735.002319:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787367735.002337:0:7480:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000005946ed65) 00000020:00000080:0.0:1787367735.002758:0:7480:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1787367735.002766:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787367735.002768:0:7480:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787367735.002771:0:7480:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787367735.002777:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787367735.002837:0:7480:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000181d0333 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787367735.002851:0:7480:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000014748f95) 00000020:00000080:0.0:1787367735.002868:0:7480:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1787367735.002928:0:7480:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787367735.002934:0:7480:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff03032e 00000020:00000080:0.0:1787367735.003027:0:7480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787367735.003033:0:7480:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787367735.003037:0:7480:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x66f5679bff030335 00080000:01000000:0.0:1787367735.003041:0:7480:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787367735.003044:0:7480:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff03033c 00080000:10000000:0.0:1787367735.004662:0:7480:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787367735.004828:0:7480:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1787367735.107465:0:7480:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1787367735.107788:0:7480:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1787367735.110942:0:7480:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787367735.111291:0:7480:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787367735.120581:0:7480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787367735.120597:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367735.120602:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367735.120605:0:7480:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787367735.120610:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367735.120616:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367735.120617:0:7480:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787367735.120620:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787367735.120625:0:7480:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:1.0:1787367735.120651:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787367735.120664:0:7480:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000de86f245) 00000020:00000080:1.0:1787367735.121037:0:7480:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787367735.121047:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787367735.121132:0:7480:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787367735.121138:0:7480:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787367735.121144:0:7480:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff03034a 00010000:00080000:1.0:1787367735.121496:0:7480:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000022d3c651@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1787367735.125229:0:7480:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1787367735.126248:0:7480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787367735.126265:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787367735.126305:0:7480:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787367735.126330:0:7480:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff030351 00000100:00080000:2.0:1787367735.126495:0:7480:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367735.126502:0:7480:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000022d3c651 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787367735.126536:0:7480:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000002bacdc3 x1874190808389888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787367735.126587:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002bacdc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808389888:0@lo:38: 00000100:00100000:0.0:1787367735.126657:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367735.126744:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808389888 00000100:00100000:1.0:1787367735.126751:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808389888 00000100:00100000:1.0:1787367735.126782:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367735.126788:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4edfe80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808389888:12345-0@lo:38: 00010000:00080000:1.0:1787367735.126808:0:6543:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1787367735.126836:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff030358 00000004:00100000:1.0:1787367735.126849:0:6543:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787367735.126854:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787367735.126941:0:7480:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787367735.127045:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367735.127050:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367735.127051:0:7480:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787367735.127063:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787367735.127066:0:7480:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787367735.127067:0:7480:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787367735.127069:0:7480:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787367735.127070:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787367735.127072:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367735.127074:0:7480:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787367735.127076:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367735.127080:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367735.127081:0:7480:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787367735.127084:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787367735.127119:0:7480:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787367735.127134:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367735.127137:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367735.127138:0:7480:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787367735.127141:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367735.127143:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367735.127144:0:7480:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787367735.127147:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367735.127148:0:7480:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787367735.127167:0:7480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367735.127170:0:7480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367735.127171:0:7480:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787367735.127173:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1787367735.127661:0:7468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:2.0:1787367735.127690:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe6745b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808390016:0@lo:400: 00000100:00100000:2.0:1787367735.127733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367735.127790:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808390016 00000100:00100000:3.0:1787367735.127795:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808390016 00000100:00100000:3.0:1787367735.127831:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367735.127838:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2e7f093 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808390016:12345-0@lo:400: 10000000:01000000:0.0:1787367735.127924:0:7468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787367735.127950:0:7468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000d1a993ea/0x66f5679bff030304 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.127961:0:7468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000d1a993ea/0x66f5679bff030304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367735.127970:0:7468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55bc6be800 from 1 10000000:01000000:0.0:1787367735.127973:0:7468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787367735.127994:0:7468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.128001:0:7468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.128009:0:7468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367735.128015:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2e7f093 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808390016:12345-0@lo:400: Request processed in 178us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367735.128022:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367735.128033:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390144:0@lo:101: 00000100:00100000:0.0:1787367735.128064:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787367735.128177:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fe6745b0 x1874190808390016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367735.128190:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe6745b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808390016:0@lo:400: 00000100:00100000:0.0:1787367735.128287:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb66f1e going to sleep for 11 seconds 00000100:00100000:2.0:1787367735.128495:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808390144 00000100:00100000:2.0:1787367735.128500:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808390144 00000100:00100000:2.0:1787367735.128590:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787367735.128601:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1bdd53b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+12:7468:x1874190808390144:12345-0@lo:101: 00010000:00010000:2.0:1787367735.128608:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367735.128616:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03035f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367735.128632:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03035f expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367735.128639:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03035f expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367735.128644:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c2c56340, rc 0) 00000100:00100000:2.0:1787367735.128673:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1bdd53b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808390144:12345-0@lo:101: Request processed in 74us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367735.128677:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787367735.128723:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390144:0@lo:101: 00010000:00010000:0.0:1787367735.128732:0:7468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.128739:0:7468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367735.129990:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390272:0@lo:256: 00000100:00100000:0.0:1787367735.130041:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.130237:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb66f1e going to sleep for 11 seconds 00000100:00100000:1.0:1787367735.130286:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808390272 00000100:00100000:1.0:1787367735.130292:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808390272 00000100:00100000:1.0:1787367735.130338:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787367735.130477:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6480bd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808390272:12345-0@lo:256: 20000000:01000000:1.0:1787367735.130503:0:6532:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787367735.130518:0:6532:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787367735.130521:0:6532:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787367735.130691:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6480bd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808390272:12345-0@lo:256: Request processed in 217us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.130696:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787367735.130751:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390272:0@lo:256: 10000000:01000000:0.0:1787367735.131890:0:7468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787367735.131907:0:7468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.131919:0:7468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367735.131927:0:7468:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bc6be800 from 1 10000000:01000000:0.0:1787367735.131929:0:7468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787367735.131969:0:7468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.131977:0:7468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.131996:0:7468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367735.132013:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390400:0@lo:101: 00000100:00100000:0.0:1787367735.132063:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.132109:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb66f1e going to sleep for 11 seconds 00000100:00100000:2.0:1787367735.132604:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808390400 00000100:00100000:2.0:1787367735.132612:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808390400 00000100:00100000:2.0:1787367735.132661:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787367735.132669:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000518b3203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808390400:12345-0@lo:101: 00010000:00010000:2.0:1787367735.132682:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367735.132693:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03036d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367735.132715:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03036d expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367735.132725:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03036d expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367735.132944:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065f04603, rc 0) 00000100:00100000:2.0:1787367735.132999:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000518b3203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:7468:x1874190808390400:12345-0@lo:101: Request processed in 330us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367735.133005:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787367735.134247:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390400:0@lo:101: 00010000:00010000:0.0:1787367735.134275:0:7468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.134285:0:7468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367735.134560:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390528:0@lo:501: 00000100:00100000:0.0:1787367735.134611:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.134653:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb66f1e going to sleep for 11 seconds 00000100:00100000:1.0:1787367735.134675:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808390528 00000100:00100000:1.0:1787367735.134683:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808390528 00000100:00100000:1.0:1787367735.134729:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787367735.134737:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030da0911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:7468:x1874190808390528:12345-0@lo:501: 00000100:00100000:1.0:1787367735.134858:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030da0911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:7468:x1874190808390528:12345-0@lo:501: Request processed in 122us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.134866:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787367735.135073:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390528:0@lo:501: 00000100:00100000:0.0:1787367735.135102:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390656:0@lo:503: 00000100:00100000:0.0:1787367735.135148:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.135172:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb66f1e going to sleep for 11 seconds 00000100:00100000:2.0:1787367735.135569:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808390656 00000100:00100000:2.0:1787367735.135574:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808390656 00000100:00100000:2.0:1787367735.135616:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787367735.135622:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ee2cc86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:7468:x1874190808390656:12345-0@lo:503: 00000040:00080000:2.0:1787367735.135659:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367735.135701:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ee2cc86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:7468:x1874190808390656:12345-0@lo:503: Request processed in 80us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367735.135708:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367735.135911:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390656:0@lo:503: 00000040:00080000:0.0:1787367735.136223:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367735.136284:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1787367735.136539:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367735.144535:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1787367735.148726:0:7468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787367735.148791:0:7468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787367735.148813:0:7468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.148827:0:7468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367735.148882:0:7468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787367735.148885:0:7468:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c55bc6be800 10000000:01000000:0.0:1787367735.148888:0:7468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c55bc6be800 10000000:01000000:0.0:1787367735.148893:0:7468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787367735.148899:0:7468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bc6be800 from 1 10000000:01000000:0.0:1787367735.148902:0:7468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787367735.148935:0:7468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 0000000049623c91/0x66f5679bff03037b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.148942:0:7468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 0000000049623c91/0x66f5679bff03037b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.148953:0:7468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 0000000049623c91/0x66f5679bff03037b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367735.148975:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390784:0@lo:101: 00000100:00100000:0.0:1787367735.149041:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.149100:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808390784 00000100:00100000:0.0:1787367735.149106:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808390784 00000100:00100000:0.0:1787367735.149150:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787367735.149158:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c9659ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:7468:x1874190808390784:12345-0@lo:101: 00010000:00010000:0.0:1787367735.149170:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367735.149182:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b38bb2d/0x66f5679bff030382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03037b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.149221:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b38bb2d/0x66f5679bff030382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03037b expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.149232:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b38bb2d/0x66f5679bff030382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03037b expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.149239:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b38bb2d, rc 0) 00000100:00100000:0.0:1787367735.149273:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c9659ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808390784:12345-0@lo:101: Request processed in 116us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367735.149280:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787367735.149327:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb66f1e going to sleep for 11 seconds 00000100:00100000:0.0:1787367735.149487:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390784:0@lo:101: 00010000:00010000:0.0:1787367735.149500:0:7468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 0000000049623c91/0x66f5679bff03037b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.149507:0:7468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 0000000049623c91/0x66f5679bff03037b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367735.149584:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390912:0@lo:501: 00000100:00100000:0.0:1787367735.149611:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.149624:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb66f1e going to sleep for 11 seconds 00000100:00100000:1.0:1787367735.150662:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808390912 00000100:00100000:1.0:1787367735.150670:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808390912 00000100:00100000:1.0:1787367735.150823:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787367735.150832:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008aff30c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808390912:12345-0@lo:501: 00000100:00100000:1.0:1787367735.150966:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008aff30c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808390912:12345-0@lo:501: Request processed in 136us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.150973:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787367735.151065:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b34cea9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808390912:0@lo:501: 00000100:00100000:2.0:1787367735.151106:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808391040:0@lo:503: 00000100:00100000:2.0:1787367735.151150:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367735.151296:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066dc8cd9 going to sleep for 11 seconds 00000100:00100000:0.0:1787367735.151496:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808391040 00000100:00100000:0.0:1787367735.151501:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808391040 00000100:00100000:0.0:1787367735.151526:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787367735.151532:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010fca219 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808391040:12345-0@lo:503: 00000100:00100000:0.0:1787367735.151661:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010fca219 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808391040:12345-0@lo:503: Request processed in 128us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367735.151677:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787367735.152704:0:6543:0:(import.c:65:import_set_state_nolock()) 000000004a4ad5d8 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367735.152768:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4edfe80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874190808389888:12345-0@lo:38: Request processed in 25978us (26110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.152777:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367735.152853:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808391040:0@lo:503: 00000040:00080000:2.0:1787367735.153182:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367735.153258:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808391168:0@lo:502: 00000100:00100000:2.0:1787367735.153302:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367735.153340:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066dc8cd9 going to sleep for 11 seconds 00000100:00100000:0.0:1787367735.153450:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787367735.153459:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787367735.153465:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787367735.153470:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787367735.153473:0:3650:0:(import.c:65:import_set_state_nolock()) 0000000022d3c651 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787367735.153487:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002bacdc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808389888:0@lo:38: 00000100:00100000:1.0:1787367735.153602:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808391168 00000100:00100000:1.0:1787367735.153607:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808391168 00000100:00100000:1.0:1787367735.153637:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787367735.153651:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c55163b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808391168:12345-0@lo:502: 00000100:00100000:1.0:1787367735.153779:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c55163b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808391168:12345-0@lo:502: Request processed in 129us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.153786:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787367735.153878:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808391168:0@lo:502: 00000040:00080000:2.0:1787367735.154033:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000100:00100000:0.0:1787367735.154222:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bdb62c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808391296:0@lo:41: 00000100:00100000:0.0:1787367735.154255:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367735.154316:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808391296 00000100:00100000:1.0:1787367735.154320:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808391296 00000100:00100000:1.0:1787367735.154377:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367735.154384:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000165892f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1874190808391296:12345-0@lo:41: 00000004:00000024:1.0:1787367735.154406:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000040:00080000:2.0:1787367735.154487:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787367735.154505:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787367735.154518:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787367735.154532:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787367735.154543:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787367735.154565:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787367735.154578:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787367735.154591:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787367735.154604:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787367735.154617:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787367735.154629:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787367735.154642:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787367735.154655:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787367735.154667:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787367735.154679:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787367735.154691:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787367735.154702:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787367735.154713:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787367735.154723:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787367735.154735:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787367735.154748:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787367735.154762:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787367735.154775:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787367735.154788:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787367735.154801:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787367735.154813:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787367735.154825:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1787367735.154844:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808391424:0@lo:502: 00000100:00100000:2.0:1787367735.154886:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367735.154909:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066dc8cd9 going to sleep for 11 seconds 00000100:00100000:1.0:1787367735.155595:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000165892f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1874190808391296:12345-0@lo:41: Request processed in 1211us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.155606:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367735.155630:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808391424 00000100:00100000:1.0:1787367735.155634:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808391424 00000100:00100000:1.0:1787367735.155672:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787367735.155679:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6be3759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808391424:12345-0@lo:502: 00000100:00100000:1.0:1787367735.155776:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6be3759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808391424:12345-0@lo:502: Request processed in 98us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.155783:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787367735.155830:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cca8892 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808391424:0@lo:502: 00000040:00080000:1.0:1787367735.155888:0:7468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787367735.155898:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787367735.156677:0:7486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787367735.156690:0:7486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000e988d89a) 00000020:00000080:3.0:1787367735.156709:0:7486:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787367735.156790:0:7486:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000181d0333 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787367735.156794:0:7486:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000181d0333 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787367735.156796:0:7486:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000181d0333 3 00010000:00080000:3.0:1787367735.156823:0:7486:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000530bab4f@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1787367735.159596:0:7486:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787367735.159826:0:7486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787367735.159868:0:7486:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787367735.159880:0:7486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x66f5679bff030390 00000100:00080000:3.0:1787367735.159891:0:7486:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787367735.159896:0:7486:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000530bab4f using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787367735.159926:0:7486:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a0224686 x1874190808391552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787367735.159977:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0224686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808391552:0@lo:38: 00000100:00100000:2.0:1787367735.160044:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787367735.160429:0:7486:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787367735.162402:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bdb62c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808391296:0@lo:41: 00000100:00100000:0.0:1787367735.162458:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808391552 00000100:00100000:0.0:1787367735.162466:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808391552 00000100:00100000:0.0:1787367735.162508:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367735.162515:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dd6309f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808391552:12345-0@lo:38: 00010000:00080000:0.0:1787367735.162541:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1787367735.162574:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x66f5679bff030397 00000004:00100000:0.0:1787367735.162589:0:6538:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787367735.162622:0:6538:0:(import.c:65:import_set_state_nolock()) 000000009edca390 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1787367735.164421:0:7486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1787367735.164578:0:7488:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1787367735.164821:0:7468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787367735.164851:0:7468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787367735.164909:0:7468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 0000000049623c91/0x66f5679bff03037b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.164933:0:7468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 0000000049623c91/0x66f5679bff03037b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787367735.164981:0:7468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787367735.164983:0:7468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787367735.164984:0:7468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367735.164986:0:7468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367735.164987:0:7468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367735.164989:0:7468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367735.164990:0:7468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787367735.164991:0:7468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367735.164993:0:7468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367735.164994:0:7468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367735.164996:0:7468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787367735.164999:0:7468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787367735.165002:0:7468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787367735.165003:0:7468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787367735.165004:0:7468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367735.165005:0:7468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367735.165006:0:7468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367735.165007:0:7468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367735.165008:0:7468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787367735.165009:0:7468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367735.165009:0:7468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367735.165010:0:7468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367735.165011:0:7468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787367735.165033:0:7468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787367735.165059:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a5379081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808391680:0@lo:253: 00000100:00100000:1.0:1787367735.165127:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367735.165289:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd2bc2e4 going to sleep for 11 seconds 00000100:00100000:0.0:1787367735.169613:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dd6309f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874190808391552:12345-0@lo:38: Request processed in 7090us (9562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367735.169630:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367735.169745:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808391680 00000100:00100000:3.0:1787367735.169753:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808391680 00000100:00100000:3.0:1787367735.169800:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787367735.169808:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c101498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7468:x1874190808391680:12345-0@lo:253: 20000000:01000000:3.0:1787367735.169839:0:6530:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787367735.169852:0:6530:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1787367735.170062:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a0224686 x1874190808391552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367735.170083:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787367735.170091:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787367735.170109:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787367735.170114:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787367735.170118:0:3650:0:(import.c:65:import_set_state_nolock()) 00000000530bab4f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787367735.170124:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0224686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808391552:0@lo:38: 00000001:00100000:1.0:1787367735.171959:0:6517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787367735.172614:0:6530:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787367735.172632:0:6530:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787367735.172837:0:6554:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787367735.172842:0:6554:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787367735.172862:0:6554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.172894:0:6554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0302b0 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.172901:0:6554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03035f expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.172907:0:6554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.172940:0:6554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03035f expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.172953:0:6554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03035f expref: 15 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367735.172966:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b59bdce0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808391808:0@lo:104: 00000100:00100000:0.0:1787367735.173031:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787367735.173109:0:6554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0302b0 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.173117:0:6554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0302b0 expref: 15 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367735.173125:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808391936:0@lo:104: 00000100:00100000:0.0:1787367735.173258:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.173282:0:6554:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c24a9bf5 going to sleep for 11 seconds 00000100:00100000:1.0:1787367735.173334:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808391808 00000100:00100000:1.0:1787367735.173349:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808391808 00000100:00100000:1.0:1787367735.173406:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808391936 00000100:00100000:1.0:1787367735.173416:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808391936 00000100:00100000:1.0:1787367735.173433:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367735.173440:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eaecc04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6554:x1874190808391808:12345-0@lo:104: 00010000:00010000:1.0:1787367735.173451:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173502:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367735.173507:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eaecc04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6554:x1874190808391808:12345-0@lo:104: Request processed in 68us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.173513:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367735.173528:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367735.173533:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b34cea9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808391936:12345-0@lo:104: 00010000:00010000:1.0:1787367735.173539:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173570:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787367735.173574:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b34cea9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808391936:12345-0@lo:104: Request processed in 42us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.173580:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787367735.173593:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787367735.173597:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173604:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c588ce3 already unused, calling callback (000000002d4c1920) 10000000:00010000:1.0:1787367735.173607:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173614:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367735.173632:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367735.173637:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787367735.173663:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173669:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367735.173684:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173691:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 000000009c588ce3/0x66f5679bff03035f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030366 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173713:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367735.173716:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173722:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000026fb6dbd already unused, calling callback (000000002d4c1920) 10000000:00010000:1.0:1787367735.173724:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173730:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367735.173735:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367735.173740:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787367735.173758:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173764:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367735.173778:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173783:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 0000000026fb6dbd/0x66f5679bff0302b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0302b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.173796:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367735.173797:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367735.173798:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367735.173809:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ef9899d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808392064:0@lo:103: 00000100:00100000:1.0:1787367735.173838:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367735.173866:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015454c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808392192:0@lo:103: 00000100:00100000:1.0:1787367735.173890:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367735.173916:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808392064 00000100:00100000:1.0:1787367735.173919:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808392064 00010000:00010000:1.0:1787367735.173934:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03035f expref: 16 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367735.173952:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808392192 00000100:00100000:1.0:1787367735.173956:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808392192 00010000:00010000:1.0:1787367735.173965:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0302b0 expref: 17 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367735.173976:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367735.173981:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a6ab4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:3652:x1874190808392064:12345-0@lo:103: 00010000:00010000:1.0:1787367735.173990:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367735.174000:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03035f expref: 17 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174009:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03035f expref: 17 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174024:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367735.174050:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a6ab4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:3652:x1874190808392064:12345-0@lo:103: Request processed in 70us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.174058:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367735.174071:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367735.174288:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073cee8ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:3653:x1874190808392192:12345-0@lo:103: 00010000:00010000:1.0:1787367735.174297:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367735.174300:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0302b0 expref: 16 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174309:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0302b0 expref: 16 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174319:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174326:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787367735.174349:0:6525:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001507630s 00010000:00010000:1.0:1787367735.174352:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174380:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174396:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174401:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174407:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000093515485 already unused, calling callback (00000000e280a026) 00010000:00010000:1.0:1787367735.174409:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174416:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174423:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367735.174432:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367735.174461:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073cee8ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:3653:x1874190808392192:12345-0@lo:103: Request processed in 175us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367735.174467:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367735.174528:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015454c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808392192:0@lo:103: 00000100:00100000:1.0:1787367735.174553:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ef9899d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808392064:0@lo:103: 00010000:00010000:0.0:1787367735.174689:0:6554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c2c56340/0x66f5679bff030366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03035f expref: 15 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367735.174710:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b59bdce0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808391808:0@lo:104: 00010000:00010000:0.0:1787367735.174722:0:6554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003020072f/0x66f5679bff0302b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0302b0 expref: 14 pid: 6530 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367735.174729:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808391936:0@lo:104: 00010000:00010000:0.0:1787367735.174743:0:6554:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.174750:0:6554:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.174755:0:6554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.174760:0:6554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000093515485/0x66f5679bff03039e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367735.174777:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367735.174958:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c101498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:7468:x1874190808391680:12345-0@lo:253: Request processed in 5150us (9830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367735.174966:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787367735.175238:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a5379081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7468:1874190808391680:0@lo:253: 10000000:01000000:1.0:1787367735.175249:0:7468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787367735.175252:0:7468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787367735.175253:0:7468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787367735.175254:0:7468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367735.175256:0:7468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367735.175263:0:7468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367735.175265:0:7468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367735.175266:0:7468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787367735.175267:0:7468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367735.175268:0:7468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367735.175270:0:7468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367735.175271:0:7468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787367735.175282:0:7468:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787367735.184067:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1787367735.184597:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787367735.184820:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787367735.185004:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787367735.186754:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787367735.186937:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787367735.191829:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787367735.192656:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787367735.192870:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1787367735.193063:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787367735.193352:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1787367735.193900:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1787367735.196789:0:7468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787367735.197017:0:7491:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787367735.197022:0:7491:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787367735.197338:0:7492:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1787367735.197564:0:7492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aeddd2a9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7492:1874190808392320:0@lo:700: 00000100:00100000:3.0:1787367735.197632:0:7492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367735.197678:0:7492:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f97a758 going to sleep for 11 seconds 00000100:00100000:0.0:1787367735.197745:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808392320 00000100:00100000:0.0:1787367735.197751:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808392320 00000100:00100000:0.0:1787367735.197798:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367735.197806:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007caf286f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7492:x1874190808392320:12345-0@lo:700: 00000040:01000000:1.0:1787367735.198011:0:7468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787367735.198842:0:7493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009709f294 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808392448:0@lo:1000: 00000100:00100000:3.0:1787367735.198889:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367735.198923:0:7493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003397ab59 going to sleep for 11 seconds 00000100:00100000:2.0:1787367735.199027:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808392448 00000100:00100000:2.0:1787367735.199032:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808392448 00000100:00100000:2.0:1787367735.199085:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367735.199092:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cf8a5cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808392448:12345-0@lo:1000: 00000100:00100000:2.0:1787367735.199292:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cf8a5cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808392448:12345-0@lo:1000: Request processed in 201us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367735.199300:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367735.199546:0:7493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009709f294 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808392448:0@lo:1000: 00000040:01000000:0.0:1787367735.199581:0:7493:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787367735.199606:0:7493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808392576:0@lo:700: 00000100:00100000:0.0:1787367735.199635:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.199660:0:7493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b28c31 going to sleep for 11 seconds 00000100:00100000:2.0:1787367735.199904:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808392576 00000100:00100000:2.0:1787367735.199909:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808392576 00000100:00100000:2.0:1787367735.199942:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367735.199948:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b59bdce0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808392576:12345-0@lo:700: 00000100:00100000:2.0:1787367735.199995:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b59bdce0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808392576:12345-0@lo:700: Request processed in 47us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367735.200001:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367735.200063:0:7493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808392576:0@lo:700: 00000100:00100000:0.0:1787367735.200109:0:7493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7493:1874190808392704:0@lo:900: 00000100:00100000:0.0:1787367735.200134:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.200265:0:7493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b28c31 going to sleep for 11 seconds 00000100:00100000:2.0:1787367735.200484:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808392704 00000100:00100000:2.0:1787367735.200488:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808392704 00000100:00100000:2.0:1787367735.200518:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367735.200523:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c556784 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7493:x1874190808392704:12345-0@lo:900: 00000100:00100000:2.0:1787367735.200557:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c556784 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7493:x1874190808392704:12345-0@lo:900: Request processed in 35us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367735.200563:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787367735.200652:0:7493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dfbfe8df x1874190808392704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787367751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367735.200662:0:7493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7493:1874190808392704:0@lo:900: 00000100:00100000:0.0:1787367735.200731:0:7493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808392832:0@lo:1000: 00000100:00100000:0.0:1787367735.200757:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367735.201631:0:7493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbee5896 going to sleep for 11 seconds 00000040:01000000:1.0:1787367735.202955:0:7468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787367735.203081:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787367735.203744:0:7468:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787367735.203753:0:7468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787367735.203892:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367735.207641:0:7468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787367735.209613:0:7468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787367735.209689:0:7468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787367735.209924:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367735.211049:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808392832 00000100:00100000:2.0:1787367735.211061:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808392832 00000100:00100000:2.0:1787367735.211152:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367735.211161:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cb0aec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808392832:12345-0@lo:1000: 00000100:00100000:2.0:1787367735.211302:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cb0aec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808392832:12345-0@lo:1000: Request processed in 142us (10543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367735.211309:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00080000:10000000:1.0:1787367735.211936:0:7468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787367735.213033:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:2.0:1787367735.214441:0:7493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808392832:0@lo:1000: 00000004:00080000:2.0:1787367735.214509:0:7493:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000061b28c31 with version 0 00000020:00100000:2.0:1787367735.214533:0:7493:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787367735.214539:0:7493:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ab89c7af x1874190808393088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787367735.214558:0:7493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808393088:0@lo:1000: 00000100:00100000:2.0:1787367735.214630:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367735.214666:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808393088 00000100:00100000:2.0:1787367735.214672:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808393088 00000100:00100000:2.0:1787367735.214711:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367735.214719:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c7d69c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808393088:12345-0@lo:1000: 00100000:10000000:1.0:1787367735.215773:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787367735.215918:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787367735.216079:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787367735.216262:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787367735.217930:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787367735.218114:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787367735.219752:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787367735.219928:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:3.0:1787367735.220218:0:7493:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b4708be going to sleep for 11 seconds 00100000:10000000:1.0:1787367735.222529:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787367735.222720:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787367735.222872:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787367735.223040:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787367735.224838:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787367735.224990:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 40000000:02000000:0.0:1787367735.225795:0:6545:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:1.0:1787367735.226693:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787367735.227102:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787367735.233940:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787367735.234125:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000001:00080000:3.0:1787367735.235507:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1787367735.235679:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c7d69c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808393088:12345-0@lo:1000: Request processed in 20958us (21046us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787367735.235692:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1787367735.235780:0:7493:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787367735.235786:0:7493:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787367735.235800:0:7493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808393088:0@lo:1000: 00000100:00100000:3.0:1787367735.235881:0:7493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019fc1b97 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808393216:0@lo:1000: 00000100:00100000:3.0:1787367735.235917:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367735.235963:0:7493:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ab26c92 going to sleep for 11 seconds 00000100:00100000:2.0:1787367735.236486:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808393216 00000100:00100000:2.0:1787367735.236495:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808393216 00000100:00100000:2.0:1787367735.236534:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787367735.236542:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a895f4d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808393216:12345-0@lo:1000: 00000100:00100000:2.0:1787367735.236612:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a895f4d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7493:x1874190808393216:12345-0@lo:1000: Request processed in 72us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367735.236620:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787367735.236715:0:7493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019fc1b97 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7493:1874190808393216:0@lo:1000: 00000040:00080000:3.0:1787367735.236734:0:7493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1787367735.236762:0:7493:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d2113af5 with version 1 00000004:00080000:2.0:1787367735.237338:0:7483:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000008da5dbda version 1 rpc_version 1 00100000:10000000:1.0:1787367735.237710:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787367735.237872:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787367735.238005:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000020:00100000:2.0:1787367735.238325:0:7483:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787367735.238333:0:7483:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004d71d81f x1874190808393472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787367735.238498:0:7483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d71d81f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7483:1874190808393472:0@lo:1000: 00000100:00100000:2.0:1787367735.238553:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367735.238582:0:7483:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066dc8cd9 going to sleep for 11 seconds 00000100:00100000:2.0:1787367735.238607:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808393472 00000100:00100000:2.0:1787367735.238613:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808393472 00000100:00100000:2.0:1787367735.238655:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787367735.238663:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038d7fc4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7483:x1874190808393472:12345-0@lo:1000: 00100000:10000000:1.0:1787367735.241669:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787367735.241978:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787367735.243675:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787367735.243850:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787367735.244002:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787367735.247799:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787367735.247976:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000040:00080000:3.0:1787367735.249580:0:7493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787367735.249673:0:7493:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:1.0:1787367735.250747:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787367735.250924:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787367735.253980:0:7468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787367735.254549:0:7468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787367735.254631:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007caf286f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7492:x1874190808392320:12345-0@lo:700: Request processed in 56823us (56995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367735.254644:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787367735.255730:0:7492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000aeddd2a9 x1874190808392320/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787367751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367735.255748:0:7492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aeddd2a9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7492:1874190808392320:0@lo:700: 40000000:02000000:2.0:1787367735.255761:0:7492:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:3.0:1787367735.260451:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1787367735.260591:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038d7fc4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7483:x1874190808393472:12345-0@lo:1000: Request processed in 21926us (22035us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787367735.260609:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787367735.266802:0:7483:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787367735.266812:0:7483:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787367735.266833:0:7483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d71d81f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7483:1874190808393472:0@lo:1000: 00000001:00080000:3.0:1787367735.267594:0:7468:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787367735.267629:0:7468:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffafad01ca7988 00100000:10000000:3.0:1787367735.267637:0:7468:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787367735.268269:0:7468:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787367735.268299:0:7468:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787367735.268322:0:7468:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787367735.268349:0:7468:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787367735.269226:0:7468:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787367735.273622:0:7468:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1787367735.312105:0:7492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367735.331811:0:7492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787367735.331901:0:7492:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787367735.331906:0:7492:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1787367735.644841:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367736.666024:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367737.697485:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367738.713656:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367739.410703:0:7737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787367739.737705:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367740.314468:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021560888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808393600:0@lo:41: 00000100:00100000:1.0:1787367740.314550:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367740.314622:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808393600 00000100:00100000:1.0:1787367740.314630:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808393600 00000100:00100000:1.0:1787367740.314670:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787367740.314677:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5379081 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808393600:12345-0@lo:41: 00000004:00000024:1.0:1787367740.314723:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787367740.314765:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5379081 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808393600:12345-0@lo:41: Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367740.314772:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787367740.314813:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021560888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808393600:0@lo:41: 00000100:00100000:1.0:1787367740.315309:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808393728:0@lo:400: 00000100:00100000:1.0:1787367740.315343:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367740.315389:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367740.315395:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001227ad3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808393856:0@lo:400: 00000100:00100000:1.0:1787367740.315471:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367740.315507:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808393856 00000100:00100000:1.0:1787367740.315511:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808393856 00000100:00100000:1.0:1787367740.315541:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367740.315547:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ef9899d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808393856:12345-0@lo:400: 00000100:00100000:1.0:1787367740.315581:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ef9899d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808393856:12345-0@lo:400: Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367740.315587:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367740.315608:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021560888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808393984:0@lo:400: 00000100:00100000:1.0:1787367740.315633:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367740.315657:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808393984 00000100:00100000:1.0:1787367740.315661:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808393984 00000100:00100000:1.0:1787367740.315681:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367740.315686:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015454c7b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808393984:12345-0@lo:400: 00000100:00100000:3.0:1787367740.315883:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808393728 00000100:00100000:3.0:1787367740.315888:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808393728 00000100:00100000:1.0:1787367740.316024:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015454c7b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808393984:12345-0@lo:400: Request processed in 337us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367740.316031:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787367740.316060:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000021560888 x1874190808393984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367740.316070:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021560888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808393984:0@lo:400: 00010000:00080000:1.0:1787367740.316096:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001227ad3c x1874190808393856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367740.316104:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001227ad3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808393856:0@lo:400: 00000100:00100000:3.0:1787367740.320415:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787367740.320432:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac28db89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:3651:x1874190808393728:12345-0@lo:400: 00000100:00100000:3.0:1787367740.320514:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac28db89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:3651:x1874190808393728:12345-0@lo:400: Request processed in 88us (5171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367740.320521:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787367740.334195:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4e889a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808393728:0@lo:400: 00000020:00000004:3.0:1787367740.343093:0:7790:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787367740.343317:0:7790:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787367740.761071:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367741.787081:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787367742.365802:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787367742.365810:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55bc6be800 from 4 10000000:01000000:2.0:1787367742.365814:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787367742.365858:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000005ae86fa6/0x66f5679bff0303a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.365869:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000005ae86fa6/0x66f5679bff0303a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.365879:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000005ae86fa6/0x66f5679bff0303a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367742.365916:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059c180ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394112:0@lo:101: 00000100:00100000:2.0:1787367742.365977:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367742.366035:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cbf1a831 going to sleep for 11 seconds 00000100:00100000:0.0:1787367742.367756:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808394112 00000100:00100000:0.0:1787367742.367769:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808394112 00000100:00100000:0.0:1787367742.367823:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787367742.367831:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007be0b00a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:6535:x1874190808394112:12345-0@lo:101: 00010000:00010000:0.0:1787367742.367852:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367742.367868:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d429fbd9/0x66f5679bff0303ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0303a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367742.367891:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d429fbd9/0x66f5679bff0303ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0303a5 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367742.367901:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d429fbd9/0x66f5679bff0303ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303a5 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367742.367908:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d429fbd9, rc 0) 00000100:00100000:0.0:1787367742.367966:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007be0b00a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:6535:x1874190808394112:12345-0@lo:101: Request processed in 136us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367742.367973:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787367742.372160:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059c180ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394112:0@lo:101: 00010000:00010000:3.0:1787367742.372201:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000005ae86fa6/0x66f5679bff0303a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.372212:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000005ae86fa6/0x66f5679bff0303a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367742.372275:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019fc1b97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394240:0@lo:256: 00000100:00100000:3.0:1787367742.372525:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.372569:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04ca2ca going to sleep for 11 seconds 00000100:00100000:0.0:1787367742.372708:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808394240 00000100:00100000:0.0:1787367742.372715:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808394240 00000100:00100000:0.0:1787367742.372752:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787367742.372758:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0377504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:6535:x1874190808394240:12345-0@lo:256: 20000000:01000000:0.0:1787367742.372777:0:6533:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787367742.372790:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787367742.372793:0:6533:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787367742.372863:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0377504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:6535:x1874190808394240:12345-0@lo:256: Request processed in 106us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367742.372871:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787367742.374621:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019fc1b97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394240:0@lo:256: 10000000:01000000:3.0:1787367742.374690:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367742.374698:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000005ae86fa6/0x66f5679bff0303a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.374707:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000005ae86fa6/0x66f5679bff0303a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367742.374718:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787367742.374720:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55834d5000 from 21 10000000:01000000:3.0:1787367742.374723:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787367742.374749:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000b9cce837/0x66f5679bff0303b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.374757:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000b9cce837/0x66f5679bff0303b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.374765:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000b9cce837/0x66f5679bff0303b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367742.374793:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019fc1b97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394368:0@lo:101: 00000100:00100000:3.0:1787367742.374841:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.374878:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04ca2ca going to sleep for 11 seconds 00000100:00100000:0.0:1787367742.375542:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808394368 00000100:00100000:0.0:1787367742.375550:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808394368 00000100:00100000:0.0:1787367742.375596:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787367742.375605:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c50004d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:6535:x1874190808394368:12345-0@lo:101: 00010000:00010000:0.0:1787367742.375618:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367742.375636:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f4ec88f2/0x66f5679bff0303ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0303b3 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367742.375658:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4ec88f2/0x66f5679bff0303ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0303b3 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367742.375668:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f4ec88f2/0x66f5679bff0303ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303b3 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367742.375676:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f4ec88f2, rc 0) 00000100:00100000:0.0:1787367742.375713:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c50004d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808394368:12345-0@lo:101: Request processed in 110us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367742.375720:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787367742.376069:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019fc1b97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394368:0@lo:101: 00010000:00010000:3.0:1787367742.376083:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000b9cce837/0x66f5679bff0303b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.376091:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000b9cce837/0x66f5679bff0303b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367742.376158:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019fc1b97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394496:0@lo:501: 00000100:00100000:3.0:1787367742.376189:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.376256:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04ca2ca going to sleep for 11 seconds 00000100:00100000:0.0:1787367742.376819:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808394496 00000100:00100000:0.0:1787367742.376824:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808394496 00000100:00100000:0.0:1787367742.376886:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787367742.376893:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000508b47bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808394496:12345-0@lo:501: 00000100:00100000:0.0:1787367742.377096:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000508b47bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808394496:12345-0@lo:501: Request processed in 203us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367742.377104:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787367742.377171:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019fc1b97 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394496:0@lo:501: 00000100:00100000:2.0:1787367742.377208:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ccd5c56 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394624:0@lo:503: 00000100:00100000:2.0:1787367742.377254:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367742.377461:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 000000003999bd1f going to sleep for 11 seconds 00000100:00100000:3.0:1787367742.377506:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808394624 00000100:00100000:3.0:1787367742.377511:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808394624 00000100:00100000:3.0:1787367742.377535:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787367742.377540:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005637c912 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808394624:12345-0@lo:503: 00000100:00100000:3.0:1787367742.377621:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005637c912 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808394624:12345-0@lo:503: Request processed in 80us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367742.377627:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787367742.377829:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ccd5c56 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808394624:0@lo:503: 00000100:00100000:3.0:1787367742.378285:0:7855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7855:1874190808394752:0@lo:502: 00000100:00100000:3.0:1787367742.378763:0:7855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.378833:0:7855:0:(client.c:2715:ptlrpc_set_wait()) set 000000000711898e going to sleep for 11 seconds 00000100:00100000:0.0:1787367742.378866:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808394752 00000100:00100000:0.0:1787367742.378872:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808394752 00000100:00100000:0.0:1787367742.378937:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787367742.378945:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074f286f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7855:x1874190808394752:12345-0@lo:502: 00000100:00100000:0.0:1787367742.379056:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074f286f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7855:x1874190808394752:12345-0@lo:502: Request processed in 111us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367742.379063:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787367742.379129:0:7855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7855:1874190808394752:0@lo:502: 00000100:00100000:3.0:1787367742.379181:0:7855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7855:1874190808394880:0@lo:502: 00000100:00100000:3.0:1787367742.379219:0:7855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.379856:0:7855:0:(client.c:2715:ptlrpc_set_wait()) set 000000000711898e going to sleep for 11 seconds 00000100:00100000:2.0:1787367742.379889:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808394880 00000100:00100000:2.0:1787367742.379895:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808394880 00000100:00100000:2.0:1787367742.379919:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787367742.379925:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0940b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7855:x1874190808394880:12345-0@lo:502: 00000100:00100000:2.0:1787367742.380097:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0940b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:7855:x1874190808394880:12345-0@lo:502: Request processed in 171us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367742.380105:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787367742.380198:0:7855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7855:1874190808394880:0@lo:502: 00000040:00080000:3.0:1787367742.380220:0:7855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787367742.380702:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787367742.380723:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367742.380732:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000b9cce837/0x66f5679bff0303b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.380742:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000b9cce837/0x66f5679bff0303b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367742.380751:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787367742.380754:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55834d5000 from 4 10000000:01000000:2.0:1787367742.380763:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787367742.380787:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000003984e7b5/0x66f5679bff0303c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.380794:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000003984e7b5/0x66f5679bff0303c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.380803:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000003984e7b5/0x66f5679bff0303c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367742.380816:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ccd5c56 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395008:0@lo:101: 00000100:00100000:2.0:1787367742.380846:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367742.381777:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009fc7d7d going to sleep for 11 seconds 00000100:00100000:0.0:1787367742.381836:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808395008 00000100:00100000:0.0:1787367742.381842:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808395008 00000100:00100000:0.0:1787367742.381918:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787367742.381925:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002794310f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808395008:12345-0@lo:101: 00010000:00010000:0.0:1787367742.381938:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367742.381950:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c01cf2f/0x66f5679bff0303c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0303c1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367742.381971:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c01cf2f/0x66f5679bff0303c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0303c1 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367742.381980:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c01cf2f/0x66f5679bff0303c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303c1 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367742.381987:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c01cf2f, rc 0) 00000100:00100000:0.0:1787367742.382046:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002794310f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808395008:12345-0@lo:101: Request processed in 121us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367742.382052:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787367742.382113:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ccd5c56 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395008:0@lo:101: 00010000:00010000:3.0:1787367742.382128:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000003984e7b5/0x66f5679bff0303c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.382135:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000003984e7b5/0x66f5679bff0303c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367742.382195:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395136:0@lo:256: 00000100:00100000:3.0:1787367742.382239:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.382584:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 000000000711898e going to sleep for 11 seconds 00000100:00100000:2.0:1787367742.382611:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808395136 00000100:00100000:2.0:1787367742.382616:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808395136 00000100:00100000:2.0:1787367742.382640:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787367742.382645:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efed7e1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808395136:12345-0@lo:256: 20000000:01000000:2.0:1787367742.382659:0:6533:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787367742.382673:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787367742.382676:0:6533:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787367742.382757:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efed7e1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808395136:12345-0@lo:256: Request processed in 111us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367742.382764:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787367742.382863:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395136:0@lo:256: 10000000:01000000:3.0:1787367742.382903:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367742.382909:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000003984e7b5/0x66f5679bff0303c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.382916:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000003984e7b5/0x66f5679bff0303c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367742.382924:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787367742.382926:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787367742.382929:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787367742.382946:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000002d012356/0x66f5679bff0303cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.382961:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000002d012356/0x66f5679bff0303cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.382969:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000002d012356/0x66f5679bff0303cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367742.382980:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395264:0@lo:101: 00000100:00100000:3.0:1787367742.390634:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.390694:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 000000000711898e going to sleep for 11 seconds 00000100:00100000:1.0:1787367742.390959:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808395264 00000100:00100000:1.0:1787367742.390978:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808395264 00000100:00100000:1.0:1787367742.391028:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787367742.391036:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a600bd18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808395264:12345-0@lo:101: 00010000:00010000:1.0:1787367742.391053:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367742.391073:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da1c74e6/0x66f5679bff0303d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0303cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367742.391100:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da1c74e6/0x66f5679bff0303d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0303cf expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367742.391111:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da1c74e6/0x66f5679bff0303d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303cf expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367742.391120:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da1c74e6, rc 0) 00000100:00100000:1.0:1787367742.391179:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a600bd18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808395264:12345-0@lo:101: Request processed in 143us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367742.391185:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787367742.391720:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395264:0@lo:101: 00010000:00010000:3.0:1787367742.391738:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000002d012356/0x66f5679bff0303cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367742.391748:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000002d012356/0x66f5679bff0303cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367742.391818:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395392:0@lo:501: 00000100:00100000:3.0:1787367742.391854:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.391878:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 000000000711898e going to sleep for 11 seconds 00000100:00100000:3.0:1787367742.391893:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808395392 00000100:00100000:3.0:1787367742.391897:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808395392 00000100:00100000:3.0:1787367742.391929:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787367742.391936:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc73f84e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808395392:12345-0@lo:501: 00000100:00100000:3.0:1787367742.392115:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc73f84e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808395392:12345-0@lo:501: Request processed in 178us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367742.392123:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787367742.392176:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395392:0@lo:501: 00000100:00100000:3.0:1787367742.392201:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395520:0@lo:503: 00000100:00100000:3.0:1787367742.392826:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.392848:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 000000000711898e going to sleep for 11 seconds 00000100:00100000:1.0:1787367742.395106:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808395520 00000100:00100000:1.0:1787367742.395119:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808395520 00000100:00100000:1.0:1787367742.395289:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787367742.395307:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032130712 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808395520:12345-0@lo:503: 00000100:00100000:1.0:1787367742.395479:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032130712 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808395520:12345-0@lo:503: Request processed in 173us (2654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367742.395487:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787367742.395719:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808395520:0@lo:503: 00000100:00100000:3.0:1787367742.395909:0:7858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7858:1874190808395648:0@lo:502: 00000100:00100000:3.0:1787367742.395948:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367742.396180:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808395648 00000100:00100000:2.0:1787367742.396185:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808395648 00000100:00100000:2.0:1787367742.396277:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787367742.396284:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000930862a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:7858:x1874190808395648:12345-0@lo:502: 00000100:00100000:2.0:1787367742.396500:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000930862a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:7858:x1874190808395648:12345-0@lo:502: Request processed in 216us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367742.396516:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787367742.396721:0:7858:0:(client.c:2715:ptlrpc_set_wait()) set 0000000076908567 going to sleep for 11 seconds 00000100:00100000:3.0:1787367742.396737:0:7858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7858:1874190808395648:0@lo:502: 00000020:01000000:3.0:1787367742.396760:0:7858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367742.396771:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367742.396774:0:7858:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787367742.396778:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787367742.396780:0:7858:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:3.0:1787367742.396802:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787367742.396815:0:7858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000a12aef2a) 00000020:00000080:3.0:1787367742.396833:0:7858:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1787367742.396839:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787367742.396917:0:7858:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787367742.396922:0:7858:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787367742.396929:0:7858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff0303e4 00010000:00080000:3.0:1787367742.396955:0:7858:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c39635e7@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1787367742.399728:0:7858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1787367742.400686:0:7858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787367742.400700:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787367742.400734:0:7858:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787367742.400753:0:7858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff0303eb 00000100:00080000:2.0:1787367742.400764:0:7858:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367742.400769:0:7858:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000c39635e7 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787367742.400801:0:7858:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000002151d95 x1874190808395776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787367742.400833:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002151d95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808395776:0@lo:38: 00000100:00100000:2.0:1787367742.400894:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367742.400949:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808395776 00000100:00100000:2.0:1787367742.400955:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808395776 00000100:00100000:2.0:1787367742.400980:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787367742.400987:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ccd5c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808395776:12345-0@lo:38: 00010000:00080000:2.0:1787367742.401277:0:6544:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1787367742.401320:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff0303f2 00000004:00100000:2.0:1787367742.401334:0:6544:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787367742.401540:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787367742.401598:0:7858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1787367742.401645:0:7858:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1787367742.401917:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808395904:0@lo:400: 00000100:00100000:3.0:1787367742.401961:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.401997:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fc65876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808396160:0@lo:400: 00000100:00100000:3.0:1787367742.402101:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.402130:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367742.402135:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000411737c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808396032:0@lo:400: 00000100:00100000:3.0:1787367742.402170:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.402196:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808395904 00000100:00100000:3.0:1787367742.402202:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808395904 00000100:00100000:3.0:1787367742.402396:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808396160 00000100:00100000:3.0:1787367742.402400:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808396160 00000100:00100000:3.0:1787367742.402416:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787367742.402423:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc14c1d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808395904:12345-0@lo:400: 00000100:00100000:3.0:1787367742.402470:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc14c1d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808395904:12345-0@lo:400: Request processed in 47us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367742.402477:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787367742.402493:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367742.402499:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026a3eb10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808396160:12345-0@lo:400: 00000100:00100000:3.0:1787367742.402530:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026a3eb10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808396160:12345-0@lo:400: Request processed in 32us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367742.402535:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367742.402557:0:6543:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787367742.402564:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:3.0:1787367742.402589:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006fc65876 x1874190808396160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367742.402601:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fc65876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808396160:0@lo:400: 00010000:00080000:2.0:1787367742.402832:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002303857d x1874190808395904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367742.402842:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002303857d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808395904:0@lo:400: 00000100:00080000:3.0:1787367742.403092:0:7861:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000006fc65876 x1874190808396288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367742.403101:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c26760a going to sleep for 0 seconds 00000100:00100000:3.0:1787367742.403124:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808396032 00000100:00100000:3.0:1787367742.403128:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808396032 00000020:01000000:2.0:1787367742.403460:0:7858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367742.403472:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367742.403474:0:7858:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787367742.403478:0:7858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367742.403482:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367742.403483:0:7858:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787367742.403486:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367742.403488:0:7858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787367742.403509:0:7858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059c180ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7858:1874190808396416:0@lo:502: 00000100:00100000:2.0:1787367742.403556:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367742.403581:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808396416 00000100:00100000:2.0:1787367742.403585:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808396416 00000100:00100000:2.0:1787367742.403611:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787367742.403617:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000366f0da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:7858:x1874190808396416:12345-0@lo:502: 00000100:00100000:2.0:1787367742.403707:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000366f0da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:7858:x1874190808396416:12345-0@lo:502: Request processed in 89us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367742.403714:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787367742.403759:0:7858:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ca0f0c4 going to sleep for 11 seconds 00000100:00100000:2.0:1787367742.403774:0:7858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059c180ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:7858:1874190808396416:0@lo:502: 00000020:01000000:2.0:1787367742.403795:0:7858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367742.403799:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367742.403800:0:7858:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787367742.403804:0:7858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787367742.403852:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787367742.403870:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787367742.403878:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000002d012356/0x66f5679bff0303cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.403886:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000002d012356/0x66f5679bff0303cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367742.403904:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787367742.403907:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c55b8aab370 from 1 10000000:01000000:2.0:1787367742.403909:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787367742.403928:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000009d49fc36/0x66f5679bff0303f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.403934:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000009d49fc36/0x66f5679bff0303f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.403942:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000009d49fc36/0x66f5679bff0303f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367742.403952:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059c180ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808396544:0@lo:101: 00000100:00100000:2.0:1787367742.403977:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367742.403990:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ca0f0c4 going to sleep for 11 seconds 00000100:00100000:3.0:1787367742.404132:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367742.404156:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019fc1b97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808396032:12345-0@lo:400: 00000100:00100000:3.0:1787367742.404198:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019fc1b97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808396032:12345-0@lo:400: Request processed in 56us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367742.404273:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367742.404448:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000411737c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808396032:0@lo:400: 00000100:00100000:2.0:1787367742.404658:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808396544 00000100:00100000:2.0:1787367742.404663:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808396544 00000100:00100000:2.0:1787367742.404700:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787367742.404707:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af76bf9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808396544:12345-0@lo:101: 00010000:00010000:2.0:1787367742.404716:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367742.404727:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb6a8bff/0x66f5679bff030400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0303f9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.404748:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb6a8bff/0x66f5679bff030400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0303f9 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.404757:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb6a8bff/0x66f5679bff030400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303f9 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.404776:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb6a8bff, rc 0) 00000100:00100000:2.0:1787367742.404809:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af76bf9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808396544:12345-0@lo:101: Request processed in 103us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367742.404815:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787367742.404844:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059c180ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808396544:0@lo:101: 00010000:00010000:2.0:1787367742.404854:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000009d49fc36/0x66f5679bff0303f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.404862:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000009d49fc36/0x66f5679bff0303f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367742.404907:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059c180ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808396672:0@lo:501: 00000100:00100000:2.0:1787367742.404930:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367742.405010:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ca0f0c4 going to sleep for 11 seconds 00000100:00100000:1.0:1787367742.405191:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808396672 00000100:00100000:1.0:1787367742.405196:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808396672 00000100:00100000:1.0:1787367742.405307:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787367742.405313:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000353ddbe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808396672:12345-0@lo:501: 00000100:00100000:1.0:1787367742.405541:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000353ddbe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808396672:12345-0@lo:501: Request processed in 227us (610us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367742.405554:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787367742.405638:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059c180ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808396672:0@lo:501: 10000000:01000000:2.0:1787367742.405668:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787367742.405674:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 000000009d49fc36/0x66f5679bff0303f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367742.405681:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 000000009d49fc36/0x66f5679bff0303f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787367742.413753:0:6544:0:(import.c:65:import_set_state_nolock()) 00000000e4bc48b5 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367742.413841:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ccd5c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874190808395776:12345-0@lo:38: Request processed in 12852us (12945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367742.413857:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787367742.413953:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787367742.413962:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787367742.413969:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787367742.413974:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787367742.413977:0:3650:0:(import.c:65:import_set_state_nolock()) 00000000c39635e7 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787367742.413998:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008c26760a): req@000000006fc65876 x1874190808396288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367742.414086:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002151d95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808395776:0@lo:38: 00000100:00100000:1.0:1787367742.414197:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367742.414284:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c26760a going to sleep for 11 seconds 00000100:00100000:3.0:1787367742.414331:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808396800:0@lo:41: 00000100:00100000:3.0:1787367742.414390:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.414420:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808396288 00000100:00100000:3.0:1787367742.414426:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808396288 00000100:00100000:3.0:1787367742.414459:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808396800 00000100:00100000:3.0:1787367742.414463:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808396800 00000100:00100000:3.0:1787367742.414479:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787367742.414488:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a6ab4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7861:x1874190808396288:12345-0@lo:1000: 00000100:00100000:3.0:1787367742.414553:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a6ab4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7861:x1874190808396288:12345-0@lo:1000: Request processed in 66us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367742.414560:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787367742.414576:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787367742.414582:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000411737c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808396800:12345-0@lo:41: 00000004:00000024:3.0:1787367742.414607:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787367742.414651:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000411737c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808396800:12345-0@lo:41: Request processed in 69us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367742.414657:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787367742.414683:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fc65876 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808396288:0@lo:1000: 00000040:01000000:3.0:1787367742.414711:0:7861:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787367742.414738:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fc65876 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808396928:0@lo:1000: 00000100:00100000:0.0:1787367742.414777:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808396800:0@lo:41: 00000100:00100000:3.0:1787367742.414899:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.414911:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c26760a going to sleep for 11 seconds 00000100:00100000:0.0:1787367742.415172:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808396928 00000100:00100000:0.0:1787367742.415177:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808396928 00000100:00100000:1.0:1787367742.416093:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787367742.416105:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aeddd2a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7861:x1874190808396928:12345-0@lo:1000: 00000100:00100000:1.0:1787367742.416262:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aeddd2a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7861:x1874190808396928:12345-0@lo:1000: Request processed in 160us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367742.416270:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787367742.416302:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fc65876 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808396928:0@lo:1000: 00000100:00100000:0.0:1787367742.416485:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808397056:0@lo:700: 00000100:00100000:0.0:1787367742.416519:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367742.416536:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056da3293 going to sleep for 11 seconds 00000100:00100000:3.0:1787367742.416550:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808397056 00000100:00100000:3.0:1787367742.416556:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808397056 00000100:00100000:3.0:1787367742.416592:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367742.416598:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077869395 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874190808397056:12345-0@lo:700: 00000100:00100000:3.0:1787367742.416649:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077869395 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874190808397056:12345-0@lo:700: Request processed in 52us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367742.416657:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367742.416676:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808397056:0@lo:700: 00000100:00100000:0.0:1787367742.416826:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808397184:0@lo:1000: 00000100:00100000:0.0:1787367742.416855:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367742.416878:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 000000006761bc60 going to sleep for 11 seconds 00000100:00100000:1.0:1787367742.417086:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808397184 00000100:00100000:1.0:1787367742.417092:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808397184 00000100:00100000:1.0:1787367742.417125:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787367742.417130:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8b4ee2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874190808397184:12345-0@lo:1000: 00000100:00100000:1.0:1787367742.417331:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8b4ee2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874190808397184:12345-0@lo:1000: Request processed in 199us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367742.417338:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787367742.418913:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfbfe8df pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808397184:0@lo:1000: 00000004:00080000:1.0:1787367742.419175:0:7861:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000056da3293 with version 0 00000020:00100000:1.0:1787367742.419198:0:7861:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787367742.419469:0:7861:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000002c0a510 x1874190808397440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367742.419490:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002c0a510 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808397440:0@lo:1000: 00000100:00100000:1.0:1787367742.419541:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367742.419563:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 000000007475dbe5 going to sleep for 11 seconds 00000100:00100000:3.0:1787367742.419632:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808397440 00000100:00100000:3.0:1787367742.419638:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808397440 00000100:00100000:3.0:1787367742.419681:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787367742.419689:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009000445b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7861:x1874190808397440:12345-0@lo:1000: 00000001:00080000:1.0:1787367742.431127:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1787367742.431138:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787367742.432444:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009000445b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7861:x1874190808397440:12345-0@lo:1000: Request processed in 12750us (12896us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787367742.432459:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787367742.432552:0:7861:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787367742.432558:0:7861:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787367742.432573:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002c0a510 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808397440:0@lo:1000: 00000100:00100000:1.0:1787367742.432662:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002c0a510 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808397568:0@lo:1000: 00000100:00100000:1.0:1787367742.432700:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367742.432740:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056da3293 going to sleep for 11 seconds 00000100:00100000:3.0:1787367742.432890:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808397568 00000100:00100000:3.0:1787367742.432897:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808397568 00000100:00100000:3.0:1787367742.432939:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367742.432948:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032be46dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7861:x1874190808397568:12345-0@lo:1000: 00000100:00100000:3.0:1787367742.433036:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032be46dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7861:x1874190808397568:12345-0@lo:1000: Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367742.433043:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787367742.433108:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002c0a510 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874190808397568:0@lo:1000: 00000040:00080000:0.0:1787367742.433126:0:7861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787367742.433162:0:7861:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000006761bc60 with version 1 00000040:00080000:0.0:1787367742.435421:0:7861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787367742.435503:0:7861:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787367742.435508:0:7861:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1787367742.436047:0:7859:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000057560bf5 version 1 rpc_version 1 00000020:00100000:3.0:1787367742.436082:0:7859:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787367742.436090:0:7859:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009709f294 x1874190808397824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787367742.436111:0:7859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009709f294 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7859:1874190808397824:0@lo:1000: 00000100:00100000:3.0:1787367742.436199:0:7859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367742.436245:0:7859:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b5d973b going to sleep for 11 seconds 00000100:00100000:1.0:1787367742.436449:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808397824 00000100:00100000:1.0:1787367742.436457:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808397824 00000100:00100000:1.0:1787367742.436504:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787367742.436512:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000817b31b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7859:x1874190808397824:12345-0@lo:1000: 00000001:00080000:1.0:1787367742.451787:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1787367742.451948:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000817b31b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7859:x1874190808397824:12345-0@lo:1000: Request processed in 15433us (15746us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787367742.451960:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1787367742.452042:0:7859:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787367742.452047:0:7859:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787367742.452062:0:7859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009709f294 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7859:1874190808397824:0@lo:1000: 00010000:00010000:2.0:1787367742.808517:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787367743.066919:0:7897:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787367743.067188:0:7897:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787367743.836508:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787367744.178764:0:7945:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde1cfc990 20000000:00000080:1.0:1787367744.178781:0:7945:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c55bd4a8000 uarg=0000000000000000 20000000:01000000:1.0:1787367744.178828:0:7945:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787367744.178868:0:7945:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787367744.178873:0:7945:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787367744.180297:0:7945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787367744.180310:0:7945:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787367744.196613:0:7945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367744.196861:0:7945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787367744.196894:0:7945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787367744.196909:0:7945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787367744.196928:0:7945:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787367744.196951:0:7945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367744.196968:0:7945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03027f expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367744.196975:0:7945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03036d expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367744.196981:0:7945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367744.197018:0:7945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03036d expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367744.197031:0:7945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03036d expref: 17 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367744.197044:0:7945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac226b6d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7945:1874190808397952:0@lo:104: 00000100:00100000:1.0:1787367744.197116:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367744.197183:0:7945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03027f expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367744.197192:0:7945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03027f expref: 17 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367744.197212:0:7945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000238f033c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7945:1874190808398080:0@lo:104: 00000100:00100000:3.0:1787367744.197217:0:6521:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787367744.197237:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808397952 00000100:00100000:1.0:1787367744.197242:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367744.197246:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808397952 00000100:00100000:1.0:1787367744.197267:0:7945:0:(client.c:2715:ptlrpc_set_wait()) set 000000007475dbe5 going to sleep for 11 seconds 00000100:00100000:3.0:1787367744.197285:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808398080 00000100:00100000:3.0:1787367744.197289:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808398080 00000100:00100000:3.0:1787367744.197303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367744.197311:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed407121 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:7945:x1874190808397952:12345-0@lo:104: 00010000:00010000:3.0:1787367744.198117:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198324:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367744.198330:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed407121 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:7945:x1874190808397952:12345-0@lo:104: Request processed in 1019us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367744.198345:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367744.198408:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787367744.198416:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed2090bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:7945:x1874190808398080:12345-0@lo:104: 00010000:00010000:3.0:1787367744.198425:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198460:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787367744.198465:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed2090bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:7945:x1874190808398080:12345-0@lo:104: Request processed in 51us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367744.198470:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787367744.198485:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367744.198490:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198497:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000588d6a6c already unused, calling callback (000000002d4c1920) 10000000:00010000:3.0:1787367744.198500:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198507:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367744.198514:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367744.198519:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367744.198545:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198551:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367744.198573:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198579:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000588d6a6c/0x66f5679bff03036d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030374 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198591:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367744.198594:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198599:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aaa914a1 already unused, calling callback (000000002d4c1920) 10000000:00010000:3.0:1787367744.198601:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198607:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367744.198612:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367744.198617:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367744.198629:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198635:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367744.198647:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198653:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000aaa914a1/0x66f5679bff03027f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030286 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198664:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367744.198671:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367744.198672:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367744.198680:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367744.198691:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003fa45ff5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808398208:0@lo:103: 00000100:00100000:3.0:1787367744.198721:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367744.198756:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367744.198764:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0224686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808398336:0@lo:103: 00000100:00100000:3.0:1787367744.198790:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367744.198814:0:7945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac226b6d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7945:1874190808397952:0@lo:104: 00000100:00100000:1.0:1787367744.198829:0:7945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000238f033c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7945:1874190808398080:0@lo:104: 00000100:00100000:3.0:1787367744.198832:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808398208 00000100:00100000:3.0:1787367744.198838:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808398208 00010000:00010000:1.0:1787367744.198857:0:7945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198862:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03036d expref: 18 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367744.198890:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808398336 00000100:00100000:3.0:1787367744.198893:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808398336 00010000:00010000:3.0:1787367744.198903:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03027f expref: 19 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367744.198915:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367744.198921:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdb62c7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:3653:x1874190808398208:12345-0@lo:103: 00010000:00010000:3.0:1787367744.198929:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367744.198933:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03036d expref: 19 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198942:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03036d expref: 19 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198955:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065f04603/0x66f5679bff030374 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03036d expref: 19 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.198967:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367744.199006:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdb62c7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:3653:x1874190808398208:12345-0@lo:103: Request processed in 85us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367744.199012:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367744.199026:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787367744.199032:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026cb83c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:3652:x1874190808398336:12345-0@lo:103: 00010000:00010000:2.0:1787367744.199380:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367744.199677:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367744.199682:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03027f expref: 17 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199692:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03027f expref: 17 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199703:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008768eaf1/0x66f5679bff030286 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03027f expref: 17 pid: 6530 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199714:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199721:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199732:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199738:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199744:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199749:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199761:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004330c9c2 already unused, calling callback (00000000e280a026) 00010000:00010000:3.0:1787367744.199764:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199770:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.199788:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367744.200027:0:7945:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367744.200101:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367744.200238:0:7945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367744.200246:0:7945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004330c9c2/0x66f5679bff030407 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367744.201662:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026cb83c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:3652:x1874190808398336:12345-0@lo:103: Request processed in 2628us (2870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367744.201673:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787367744.202222:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003fa45ff5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808398208:0@lo:103: 00000100:00100000:2.0:1787367744.212931:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0224686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808398336:0@lo:103: 00010000:00010000:2.0:1787367744.856589:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367745.432650:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc779681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808398464:0@lo:41: 00000100:00100000:2.0:1787367745.432759:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367745.432903:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808398464 00000100:00100000:3.0:1787367745.432911:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808398464 00000100:00100000:3.0:1787367745.432962:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367745.432970:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059c180ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808398464:12345-0@lo:41: 00000004:00000024:3.0:1787367745.432998:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787367745.433063:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059c180ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808398464:12345-0@lo:41: Request processed in 94us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367745.433070:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367745.433122:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc779681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808398464:0@lo:41: 00010000:00010000:3.0:1787367745.881942:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367746.927248:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367747.481314:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000082925c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808398592:0@lo:41: 00000100:00100000:2.0:1787367747.481430:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367747.481675:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808398592 00000100:00100000:1.0:1787367747.481683:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808398592 00000100:00100000:1.0:1787367747.481722:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787367747.481728:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d71d81f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808398592:12345-0@lo:41: 00000004:00000024:1.0:1787367747.481762:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787367747.481858:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d71d81f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808398592:12345-0@lo:41: Request processed in 129us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367747.481865:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787367747.481905:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000082925c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808398592:0@lo:41: 00000100:00100000:1.0:1787367747.486466:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac226b6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808398848:0@lo:400: 00000100:00100000:1.0:1787367747.486533:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367747.486568:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367747.486573:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e94249 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808398976:0@lo:400: 00000100:00100000:1.0:1787367747.486597:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367747.486632:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808398976 00000100:00100000:1.0:1787367747.486640:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808398976 00000100:00100000:1.0:1787367747.486676:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787367747.486684:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019bf77e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808398976:12345-0@lo:400: 00000100:00100000:1.0:1787367747.486746:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019bf77e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808398976:12345-0@lo:400: Request processed in 49us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367747.486752:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787367747.486788:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e94249 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808398976:0@lo:400: 00000100:00100000:1.0:1787367747.486822:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b0acd1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808399104:0@lo:400: 00000100:00100000:1.0:1787367747.486848:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367747.486869:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367747.486874:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000238f033c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808398720:0@lo:400: 00000100:00100000:1.0:1787367747.486899:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367747.486925:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808398720 00000100:00100000:1.0:1787367747.486928:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808398720 00000100:00100000:1.0:1787367747.486950:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787367747.486955:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032d5395a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:3653:x1874190808398720:12345-0@lo:400: 00000100:00100000:1.0:1787367747.486985:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032d5395a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:3653:x1874190808398720:12345-0@lo:400: Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367747.486990:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787367747.487022:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000238f033c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808398720:0@lo:400: 00000100:00100000:2.0:1787367747.487403:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808398848 00000100:00100000:2.0:1787367747.487408:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808398848 00000100:00100000:2.0:1787367747.487438:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808399104 00000100:00100000:2.0:1787367747.487440:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808399104 00000100:00100000:2.0:1787367747.487454:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787367747.487459:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047e0f9f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808398848:12345-0@lo:400: 00000100:00100000:2.0:1787367747.487500:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047e0f9f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808398848:12345-0@lo:400: Request processed in 40us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367747.487506:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787367747.487518:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787367747.487523:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2e94249 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808399104:12345-0@lo:400: 00000100:00100000:2.0:1787367747.487549:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2e94249 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808399104:12345-0@lo:400: Request processed in 26us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367747.487555:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787367747.487583:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ac226b6d x1874190808398848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367747.487593:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac226b6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808398848:0@lo:400: 00010000:00080000:1.0:1787367747.487668:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000b0acd1f x1874190808399104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367747.487677:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b0acd1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808399104:0@lo:400: 00010000:00010000:3.0:1787367747.940617:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367748.952562:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367749.977253:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367750.563665:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b0acd1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808399232:0@lo:41: 00000100:00100000:1.0:1787367750.563741:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367750.563811:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808399232 00000100:00100000:1.0:1787367750.563819:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808399232 00000100:00100000:1.0:1787367750.563861:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787367750.564328:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000238f033c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808399232:12345-0@lo:41: 00000004:00000024:1.0:1787367750.564379:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787367750.564430:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000238f033c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808399232:12345-0@lo:41: Request processed in 109us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367750.565120:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787367750.569549:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b0acd1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808399232:0@lo:41: 00010000:00010000:2.0:1787367751.004460:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367752.025308:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367752.602440:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b0acd1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808399360:0@lo:41: 00000100:00100000:1.0:1787367752.602504:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367752.602590:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808399360 00000100:00100000:1.0:1787367752.602597:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808399360 00000100:00100000:1.0:1787367752.602634:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787367752.602641:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd213c52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808399360:12345-0@lo:41: 00000004:00000024:1.0:1787367752.602669:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787367752.602703:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd213c52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808399360:12345-0@lo:41: Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367752.602710:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787367752.602748:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b0acd1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808399360:0@lo:41: 10000000:01000000:2.0:1787367752.603374:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787367752.603378:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bc6be800 from 1 10000000:01000000:2.0:1787367752.603381:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787367752.603408:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000b700a015/0x66f5679bff03040e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.603428:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000b700a015/0x66f5679bff03040e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.603437:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000b700a015/0x66f5679bff03040e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367752.603451:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808399488:0@lo:101: 00000100:00100000:2.0:1787367752.603485:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367752.603517:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c046e820 going to sleep for 11 seconds 00000100:00100000:2.0:1787367752.603533:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808399488 00000100:00100000:2.0:1787367752.603537:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808399488 00000100:00100000:2.0:1787367752.603563:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787367752.603568:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6ae5d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808399488:12345-0@lo:101: 00010000:00010000:2.0:1787367752.603577:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367752.603587:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000026fb6dbd/0x66f5679bff030415 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03040e expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.603606:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026fb6dbd/0x66f5679bff030415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03040e expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.603615:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000026fb6dbd/0x66f5679bff030415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03040e expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.603623:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000026fb6dbd, rc 0) 00000100:00100000:2.0:1787367752.603652:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6ae5d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808399488:12345-0@lo:101: Request processed in 83us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367752.603658:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787367752.603761:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808399488:0@lo:101: 00010000:00010000:2.0:1787367752.603777:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000b700a015/0x66f5679bff03040e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.603785:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000b700a015/0x66f5679bff03040e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367752.603828:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808399616:0@lo:501: 00000100:00100000:2.0:1787367752.603849:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367752.603874:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c046e820 going to sleep for 11 seconds 00000100:00100000:0.0:1787367752.603967:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808399616 00000100:00100000:0.0:1787367752.603973:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808399616 00000100:00100000:0.0:1787367752.604005:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787367752.604011:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000001a2f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808399616:12345-0@lo:501: 00000100:00100000:0.0:1787367752.604131:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000001a2f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808399616:12345-0@lo:501: Request processed in 120us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367752.604138:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787367752.604515:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808399616:0@lo:501: 00000100:00100000:2.0:1787367752.604559:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808399744:0@lo:503: 00000100:00100000:2.0:1787367752.604602:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367752.604623:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c046e820 going to sleep for 11 seconds 00000100:00100000:0.0:1787367752.604661:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808399744 00000100:00100000:0.0:1787367752.604666:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808399744 00000100:00100000:0.0:1787367752.604700:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787367752.604706:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000378b5ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808399744:12345-0@lo:503: 00000100:00100000:0.0:1787367752.604849:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000378b5ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808399744:12345-0@lo:503: Request processed in 143us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367752.604930:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787367752.604994:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc779681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808399872:0@lo:400: 00000100:00100000:0.0:1787367752.605027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367752.605072:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022249d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808400000:0@lo:400: 00000100:00100000:0.0:1787367752.605108:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367752.605129:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367752.605135:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0224686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808400128:0@lo:400: 00000100:00100000:0.0:1787367752.605157:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367752.605190:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808400000 00000100:00100000:0.0:1787367752.605194:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808400000 00000100:00100000:0.0:1787367752.605221:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787367752.605227:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c861b9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808400000:12345-0@lo:400: 00000100:00100000:0.0:1787367752.605266:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c861b9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808400000:12345-0@lo:400: Request processed in 40us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367752.605272:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787367752.605301:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022249d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808400000:0@lo:400: 00000100:00100000:0.0:1787367752.605335:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808399872 00000100:00100000:0.0:1787367752.605339:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808399872 00000100:00100000:0.0:1787367752.605425:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808400128 00000100:00100000:0.0:1787367752.605429:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808400128 00000100:00100000:0.0:1787367752.605446:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787367752.605453:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082925c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808399872:12345-0@lo:400: 00000100:00100000:0.0:1787367752.605492:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082925c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808399872:12345-0@lo:400: Request processed in 40us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367752.605508:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787367752.605522:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787367752.605529:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eaecc04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808400128:12345-0@lo:400: 00000100:00100000:0.0:1787367752.605561:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eaecc04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808400128:12345-0@lo:400: Request processed in 34us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367752.605567:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787367752.605610:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000dc779681 x1874190808399872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367752.605622:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc779681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808399872:0@lo:400: 00010000:00080000:0.0:1787367752.605648:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a0224686 x1874190808400128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367752.605656:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0224686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808400128:0@lo:400: 00000100:00100000:2.0:1787367752.605993:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808399744:0@lo:503: 00000100:00100000:2.0:1787367752.607099:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8412:1874190808400256:0@lo:502: 00000100:00100000:2.0:1787367752.607164:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367752.607232:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f31a959 going to sleep for 11 seconds 00000100:00100000:0.0:1787367752.607273:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808400256 00000100:00100000:0.0:1787367752.607279:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808400256 00000100:00100000:0.0:1787367752.607350:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787367752.607377:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cda3d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:8412:x1874190808400256:12345-0@lo:502: 00000100:00100000:0.0:1787367752.607479:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cda3d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:8412:x1874190808400256:12345-0@lo:502: Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367752.607487:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787367752.607645:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab89c7af pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8412:1874190808400256:0@lo:502: 00000020:01000000:2.0:1787367752.607670:0:8412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367752.607678:0:8412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367752.607681:0:8412:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787367752.607688:0:8412:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55bc6be800 00000020:00000080:2.0:1787367752.607691:0:8412:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787367752.607739:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8412:1874190808400384:0@lo:502: 00000100:00100000:2.0:1787367752.607774:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367752.607795:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582af2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367752.607830:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808400384 00000100:00100000:0.0:1787367752.607834:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808400384 00000100:00100000:0.0:1787367752.607925:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787367752.607932:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:8412:x1874190808400384:12345-0@lo:502: 00000100:00100000:0.0:1787367752.607993:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:8412:x1874190808400384:12345-0@lo:502: Request processed in 60us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367752.608004:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787367752.608075:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8412:1874190808400384:0@lo:502: 00000020:01000000:2.0:1787367752.608102:0:8412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367752.608106:0:8412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367752.608108:0:8412:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787367752.608111:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787367752.608329:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787367752.608350:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787367752.608385:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367752.608396:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367752.608407:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787367752.608409:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55834d5000 from 1 10000000:01000000:0.0:1787367752.608412:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787367752.608436:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367752.608444:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367752.608453:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367752.608465:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808400512:0@lo:101: 00000100:00100000:0.0:1787367752.608494:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367752.608511:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a03fcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367752.608565:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808400512 00000100:00100000:2.0:1787367752.608569:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808400512 00000100:00100000:2.0:1787367752.608672:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787367752.608679:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808400512:12345-0@lo:101: 00010000:00010000:2.0:1787367752.608687:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367752.608698:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03041c expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.608717:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03041c expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.608727:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03041c expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.608736:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175600, rc 0) 00000100:00100000:2.0:1787367752.608767:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808400512:12345-0@lo:101: Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367752.608773:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787367752.608807:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808400512:0@lo:101: 00010000:00010000:2.0:1787367752.608819:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.608827:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367752.609069:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808400640:0@lo:501: 00000100:00100000:2.0:1787367752.609106:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367752.609172:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582af26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367752.609207:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808400640 00000100:00100000:0.0:1787367752.609212:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808400640 00000100:00100000:0.0:1787367752.609268:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787367752.609276:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808400640:12345-0@lo:501: 00000100:00100000:0.0:1787367752.609386:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808400640:12345-0@lo:501: Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367752.609400:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787367752.610400:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808400640:0@lo:501: 00000100:00100000:2.0:1787367752.610445:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808400768:0@lo:503: 00000100:00100000:2.0:1787367752.610499:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367752.610531:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582af26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367752.610549:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808400768 00000100:00100000:2.0:1787367752.610553:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808400768 00000100:00100000:2.0:1787367752.610606:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787367752.610614:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808400768:12345-0@lo:503: 00000100:00100000:2.0:1787367752.610719:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808400768:12345-0@lo:503: Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367752.610727:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787367752.610776:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808400768:0@lo:503: 00000100:00100000:2.0:1787367752.610957:0:8413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8413:1874190808400896:0@lo:502: 00000100:00100000:2.0:1787367752.610992:0:8413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367752.611010:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808400896 00000100:00100000:2.0:1787367752.611014:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808400896 00000100:00100000:2.0:1787367752.611035:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787367752.611041:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:8413:x1874190808400896:12345-0@lo:502: 00000100:00100000:2.0:1787367752.611119:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:8413:x1874190808400896:12345-0@lo:502: Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367752.611126:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787367752.611162:0:8413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787367752.611174:0:8413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8413:1874190808400896:0@lo:502: 00000020:01000000:2.0:1787367752.611192:0:8413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367752.611200:0:8413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367752.611203:0:8413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787367752.611209:0:8413:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55834d5000 00000020:00000080:2.0:1787367752.611212:0:8413:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787367752.611230:0:8413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8413:1874190808401024:0@lo:502: 00000100:00100000:2.0:1787367752.611262:0:8413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367752.611281:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808401024 00000100:00100000:2.0:1787367752.611284:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808401024 00000100:00100000:2.0:1787367752.611317:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787367752.611325:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:8413:x1874190808401024:12345-0@lo:502: 00000100:00100000:2.0:1787367752.611402:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:8413:x1874190808401024:12345-0@lo:502: Request processed in 78us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367752.611409:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787367752.611442:0:8413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590d69780 going to sleep for 11 seconds 00000100:00100000:2.0:1787367752.611453:0:8413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8413:1874190808401024:0@lo:502: 00000020:01000000:2.0:1787367752.611471:0:8413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367752.611475:0:8413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367752.611477:0:8413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787367752.611480:0:8413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787367752.611530:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787367752.611549:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367752.611558:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367752.611567:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.049586:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787367753.101667:0:8445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787367753.101677:0:8445:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787367753.101678:0:8445:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787367753.101798:0:8445:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c55bd606800 00000020:01000004:3.0:1787367753.101812:0:8445:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787367753.101823:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787367753.101843:0:8445:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c55bd6dcd28) 00000020:00000080:3.0:1787367753.101858:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787367753.169212:0:8445:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787367753.169268:0:8445:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1787367753.210024:0:8445:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787367753.210238:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787367753.210250:0:8445:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787367753.210260:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x66f5679bff030431 00000020:01000004:3.0:1787367753.210267:0:8445:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787367753.210287:0:8445:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787367753.210290:0:8445:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787367753.210295:0:8445:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787367753.210300:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787367753.210311:0:8445:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c55bd6d99b8) 00000020:00000080:3.0:1787367753.210322:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1787367753.213985:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367753.214183:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787367753.214189:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787367753.222690:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787367753.222703:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787367753.223159:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787367753.223166:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787367753.225503:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787367753.225680:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787367753.225686:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787367753.226298:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787367753.226305:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787367753.252914:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367753.253278:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787367753.253283:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787367753.256424:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787367753.256438:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787367753.262511:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787367753.262525:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787367753.269340:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367753.270276:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787367753.270283:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787367753.277137:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787367753.277149:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787367753.374291:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787367753.374498:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787367753.374504:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787367753.376297:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787367753.376310:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787367753.377330:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787367753.377386:0:8445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787367753.377392:0:8445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787367753.423429:0:8445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787367753.423467:0:8445:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787367753.423471:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787367753.423472:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787367753.423473:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367753.423475:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367753.423476:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367753.423477:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367753.423479:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787367753.423485:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367753.423487:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367753.423488:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367753.423489:0:8445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787367753.423492:0:8445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787367753.423495:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787367753.423496:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787367753.423497:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367753.423497:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367753.423498:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367753.423499:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367753.423500:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787367753.423501:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367753.423502:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367753.423503:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367753.423503:0:8445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787367753.423528:0:8445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787367753.423545:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808401152:0@lo:253: 00000100:00100000:1.0:1787367753.423615:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367753.423677:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb594cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367753.423708:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808401152 00000100:00100000:2.0:1787367753.423715:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808401152 00000100:00100000:2.0:1787367753.423764:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787367753.423774:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:8445:x1874190808401152:12345-0@lo:253: 20000000:01000000:2.0:1787367753.423804:0:6530:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787367753.423808:0:6530:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787367753.423813:0:6530:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787367753.423816:0:6530:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787367753.424092:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367753.424230:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787367753.424243:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787367753.424261:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787367753.424266:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787367753.424294:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787367753.424309:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787367753.424440:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787367753.424455:0:6530:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:2.0:1787367753.424456:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:2.0:1787367753.424470:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787367753.424475:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787367753.424488:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787367753.424493:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:2.0:1787367753.424505:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787367753.424582:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787367753.424633:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787367753.424669:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787367753.424778:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1787367753.424790:0:6530:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:3.0:1787367753.424791:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:3.0:1787367753.424806:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1787367753.425066:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787367753.425097:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1787367753.425103:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:3.0:1787367753.425116:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1787367753.425122:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787367753.425134:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1787367753.425148:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1787367753.425534:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1787367753.425548:0:6530:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:3.0:1787367753.425550:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:3.0:1787367753.425564:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1787367753.425571:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787367753.425585:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1787367753.425590:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:3.0:1787367753.425602:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1787367753.425608:0:6530:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787367753.425620:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1787367753.425636:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1787367753.425648:0:6530:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787367753.425651:0:6530:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787367753.425655:0:6530:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787367753.428186:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787367753.428194:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787367753.430531:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1787367753.430584:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1787367753.430602:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787367753.431257:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787367753.431283:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787367753.431326:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787367753.431342:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787367753.431345:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787367753.432344:0:8465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1787367753.432553:0:8465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1787367753.432572:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1787367753.433793:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1787367753.435217:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1787367753.435244:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1787367753.435257:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787367753.435260:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787367753.438307:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787367753.440063:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787367753.440110:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787367753.440128:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787367753.440138:0:6530:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787367753.440141:0:6530:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787367753.443204:0:8467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1787367753.443259:0:8467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1787367753.443279:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787367753.443908:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1787367753.443933:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1787367753.443966:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:3.0:1787367753.443982:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787367753.444001:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444019:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68b400/0x66f5679bff03030b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030304 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444027:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03037b expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444034:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0303ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303b3 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444041:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581672200/0x66f5679bff0303d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303cf expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444047:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55c2174000/0x66f5679bff030400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303f9 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444067:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444117:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55c2174000/0x66f5679bff030400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0303f9 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444133:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55c2174000/0x66f5679bff030400 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0303f9 expref: 18 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.444147:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9487800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401280:0@lo:104: 00000100:00100000:3.0:1787367753.444207:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787367753.444260:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581672200/0x66f5679bff0303d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0303cf expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444269:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581672200/0x66f5679bff0303d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0303cf expref: 18 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.444278:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9487100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401408:0@lo:104: 00000100:00100000:3.0:1787367753.444297:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787367753.444327:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0303ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0303b3 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444335:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0303ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0303b3 expref: 18 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.444344:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9487480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401536:0@lo:104: 00000100:00100000:3.0:1787367753.444394:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787367753.444423:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03037b expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444439:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03037b expref: 18 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.444448:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9485c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401664:0@lo:104: 00000100:00100000:3.0:1787367753.444491:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787367753.444513:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68b400/0x66f5679bff03030b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030304 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.444521:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68b400/0x66f5679bff03030b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030304 expref: 18 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.444529:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401792:0@lo:104: 00000100:00100000:3.0:1787367753.444549:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367753.444560:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367753.444705:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808401280 00000100:00100000:0.0:1787367753.444713:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808401280 00000100:00100000:0.0:1787367753.444743:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808401408 00000100:00100000:0.0:1787367753.444747:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808401408 00000100:00100000:0.0:1787367753.444758:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808401536 00000100:00100000:0.0:1787367753.444760:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808401536 00000100:00100000:0.0:1787367753.444768:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808401664 00000100:00100000:0.0:1787367753.444771:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808401664 00000100:00100000:0.0:1787367753.444779:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808401792 00000100:00100000:0.0:1787367753.444781:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808401792 00000100:00100000:0.0:1787367753.444793:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787367753.444800:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+7:6530:x1874190808401280:12345-0@lo:104: 00010000:00010000:0.0:1787367753.444814:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff0303f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.444882:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787367753.444888:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+7:6530:x1874190808401280:12345-0@lo:104: Request processed in 88us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.444895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787367753.444911:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787367753.444917:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9486680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:6530:x1874190808401408:12345-0@lo:104: 00010000:00010000:0.0:1787367753.444923:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff0303cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.444982:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787367753.444988:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9486680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:6530:x1874190808401408:12345-0@lo:104: Request processed in 72us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.444994:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787367753.445008:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787367753.445016:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787367753.445016:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6530:x1874190808401536:12345-0@lo:104: 00010000:00010000:2.0:1787367753.445026:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff0303f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445028:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55814a1600/0x66f5679bff0303b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445044:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174a00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367753.445049:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff0303f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445059:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff0303f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367753.445067:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff0303f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445067:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787367753.445088:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6530:x1874190808401536:12345-0@lo:104: Request processed in 72us (692us total) trans 0 rc 0/0 10000000:01000000:2.0:1787367753.445089:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787367753.445099:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787367753.445113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787367753.445120:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6530:x1874190808401664:12345-0@lo:104: 00010000:00010000:2.0:1787367753.445127:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff0303f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445128:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff03037b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445144:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367753.445163:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff0303f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445168:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1787367753.445171:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff0303f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030400 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445176:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6530:x1874190808401664:12345-0@lo:104: Request processed in 56us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.445187:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787367753.445190:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787367753.445195:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff0303cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445202:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787367753.445204:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367753.445208:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff0303cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445212:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6530:x1874190808401792:12345-0@lo:104: 00010000:00010000:0.0:1787367753.445221:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff030304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445224:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff0303cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367753.445237:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff0303cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367753.445246:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367753.445273:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1787367753.445276:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff0303cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445280:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6530:x1874190808401792:12345-0@lo:104: Request processed in 70us (729us total) trans 0 rc 0/0 00010000:00010000:2.0:1787367753.445290:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787367753.445295:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787367753.445298:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff0303cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445307:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff0303cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303d6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445312:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787367753.445319:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367753.445324:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff03037b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445330:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ba00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367753.445333:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff03037b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445336:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808401920:0@lo:103: 00010000:00010000:2.0:1787367753.445348:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff03037b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367753.445375:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff03037b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367753.445387:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787367753.445396:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367753.445405:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff03037b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445412:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787367753.445421:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787367753.445430:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff03037b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445431:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808402048:0@lo:103: 00010000:00010000:2.0:1787367753.445443:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff03037b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030382 expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445454:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367753.445458:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff030304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445459:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367753.445468:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68bc00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367753.445471:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff030304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445478:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff030304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367753.445485:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff030304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367753.445490:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787367753.445498:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808401920 00000100:00100000:0.0:1787367753.445503:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808401920 00010000:00010000:2.0:1787367753.445504:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff030304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445511:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367753.445527:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff030304 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445527:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55c2174000/0x66f5679bff030400 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303f9 expref: 19 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445546:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff030304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03030b expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.445559:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367753.445562:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367753.445563:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808402048 00010000:00010000:2.0:1787367753.445565:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367753.445568:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808402048 00010000:00010000:0.0:1787367753.445583:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581672200/0x66f5679bff0303d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303cf expref: 20 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445598:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787367753.445603:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:3651:x1874190808401920:12345-0@lo:103: 00010000:00010000:0.0:1787367753.445620:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367753.445625:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55c2174000/0x66f5679bff030400 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303f9 expref: 20 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445635:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55c2174000/0x66f5679bff030400 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0303f9 expref: 20 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445656:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367753.445691:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:3651:x1874190808401920:12345-0@lo:103: Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.445698:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787367753.445710:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787367753.445716:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:3651:x1874190808402048:12345-0@lo:103: 00010000:00010000:0.0:1787367753.445723:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367753.445728:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581672200/0x66f5679bff0303d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303cf expref: 19 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445737:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581672200/0x66f5679bff0303d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0303cf expref: 19 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445747:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367753.445768:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:3651:x1874190808402048:12345-0@lo:103: Request processed in 53us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.445774:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787367753.445797:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808402176:0@lo:103: 00000100:00100000:2.0:1787367753.445804:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808402048:0@lo:103: 00000100:00100000:2.0:1787367753.445817:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808401920:0@lo:103: 00000100:00100000:0.0:1787367753.445824:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367753.445847:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367753.445853:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808402304:0@lo:103: 00000100:00100000:0.0:1787367753.445872:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367753.445893:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808402176 00000100:00100000:0.0:1787367753.445897:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808402176 00010000:00010000:0.0:1787367753.445910:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030382 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03037b expref: 19 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445922:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808402304 00000100:00100000:0.0:1787367753.445930:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808402304 00010000:00010000:0.0:1787367753.445941:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68b400/0x66f5679bff03030b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030304 expref: 20 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.445955:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787367753.445960:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:3653:x1874190808402176:12345-0@lo:103: 00010000:00010000:0.0:1787367753.445967:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367753.445971:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030382 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03037b expref: 20 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445979:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03037b expref: 20 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.445990:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367753.446026:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:3653:x1874190808402176:12345-0@lo:103: Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.446032:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787367753.446047:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787367753.446055:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:3653:x1874190808402304:12345-0@lo:103: 00000100:00100000:2.0:1787367753.446057:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808402176:0@lo:103: 00010000:00010000:3.0:1787367753.446759:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2174000/0x66f5679bff030400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0303f9 expref: 19 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.446773:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9487800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401280:0@lo:104: 00010000:00010000:3.0:1787367753.446785:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672200/0x66f5679bff0303d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0303cf expref: 18 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.446794:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9487100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401408:0@lo:104: 00000100:00100000:3.0:1787367753.446802:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9487480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401536:0@lo:104: 00010000:00010000:1.0:1787367753.447105:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367753.447114:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a1600/0x66f5679bff0303b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.447122:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787367753.447134:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a1600/0x66f5679bff0303b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.447144:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a1600/0x66f5679bff0303b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367753.447151:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a1600/0x66f5679bff0303b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367753.447157:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787367753.447196:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55814a1600/0x66f5679bff0303b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.447202:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367753.447219:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a1600/0x66f5679bff0303b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367753.447226:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808402432:0@lo:103: 00010000:00010000:1.0:1787367753.447229:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a1600/0x66f5679bff0303b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303ba expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.447249:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367753.447251:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367753.447253:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367753.447259:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367753.447261:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367753.447286:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367753.447384:0:6523:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787367753.447392:0:6523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787367753.448153:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03037b expref: 17 pid: 6533 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.448169:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9485c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401664:0@lo:104: 00000100:00100000:3.0:1787367753.448191:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6530:1874190808401792:0@lo:104: 00010000:00010000:3.0:1787367753.448217:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367753.448788:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808402432 00000100:00100000:2.0:1787367753.448796:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808402432 00010000:00010000:0.0:1787367753.448804:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367753.448815:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68b400/0x66f5679bff03030b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030304 expref: 17 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.448824:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0303ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303b3 expref: 17 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.448829:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68b400/0x66f5679bff03030b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030304 expref: 17 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.448845:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68b400/0x66f5679bff03030b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030304 expref: 17 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.448857:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367753.448928:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:3653:x1874190808402304:12345-0@lo:103: Request processed in 2874us (3053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.448939:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787367753.448945:0:6523:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787367753.450463:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808402304:0@lo:103: 00000100:00100000:2.0:1787367753.453833:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367753.453863:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:3651:x1874190808402432:12345-0@lo:103: 00010000:00010000:2.0:1787367753.453885:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367753.453894:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0303ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303b3 expref: 15 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.453910:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0303ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0303b3 expref: 15 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.453946:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0303ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0303b3 expref: 15 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.453964:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.453971:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.454900:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.454908:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.454915:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.454922:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.454929:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787367753.454933:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.454941:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.454970:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.455004:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367753.455086:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:3651:x1874190808402432:12345-0@lo:103: Request processed in 1237us (7798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.455100:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367753.455196:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808402432:0@lo:103: 00010000:00010000:1.0:1787367753.455336:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.455397:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.455402:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55814a0400/0x66f5679bff03043f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787367753.455417:0:6530:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787367753.458850:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:8445:x1874190808401152:12345-0@lo:253: Request processed in 35068us (35225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367753.458864:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787367753.459105:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808401152:0@lo:253: 10000000:01000000:2.0:1787367753.459121:0:8445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787367753.459125:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787367753.459126:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787367753.459128:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367753.459129:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787367753.459131:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367753.459132:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367753.459133:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787367753.459135:0:8445:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787367753.459137:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367753.459138:0:8445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787367753.459159:0:8445:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c55bd606800 from lustre-OST0000 10000000:01000000:2.0:1787367753.459188:0:8445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787367753.459191:0:8445:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787367753.459199:0:8445:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c55b8aab370 local copy 10000000:01000000:2.0:1787367753.459203:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787367753.459237:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.459248:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.459257:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367753.459288:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc512a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808402560:0@lo:101: 00000100:00100000:2.0:1787367753.459322:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367753.459376:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb594900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367753.459444:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808402560 00000100:00100000:1.0:1787367753.459451:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808402560 00000100:00100000:1.0:1787367753.459498:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787367753.459507:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+13:8445:x1874190808402560:12345-0@lo:101: 00010000:00010000:1.0:1787367753.459519:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367753.459532:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673e00/0x66f5679bff03044d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030446 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.459554:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673e00/0x66f5679bff03044d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030446 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.459564:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673e00/0x66f5679bff03044d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030446 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.459573:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673e00, rc 0) 00000100:00100000:1.0:1787367753.459609:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808402560:12345-0@lo:101: Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367753.459614:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787367753.459821:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc512a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808402560:0@lo:101: 00010000:00010000:3.0:1787367753.459835:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.459844:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.459967:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808402688:0@lo:501: 00000100:00100000:3.0:1787367753.459996:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367753.460023:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367753.460038:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808402688 00000100:00100000:1.0:1787367753.460043:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808402688 00000100:00100000:1.0:1787367753.460085:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787367753.460092:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808402688:12345-0@lo:501: 00000100:00100000:1.0:1787367753.460159:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808402688:12345-0@lo:501: Request processed in 67us (161us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367753.460166:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787367753.460231:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808402688:0@lo:501: 10000000:01000000:3.0:1787367753.460244:0:8445:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787367753.460259:0:8445:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787367753.460265:0:8445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.460273:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.460280:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.460301:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367753.460325:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787367753.460333:0:8445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c55bd606800 00010000:00010000:2.0:1787367753.460333:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367753.460340:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787367753.460343:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174800 already unused, calling callback (ffffffffc114ec20) 10000000:01000000:3.0:1787367753.460348:0:8445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:00010000:2.0:1787367753.460349:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367753.460352:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787367753.460374:0:8445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787367753.460377:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787367753.460394:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.460395:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.460412:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367753.460413:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367753.460431:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367753.460432:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.460448:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808402816:0@lo:101: 00010000:00010000:2.0:1787367753.460452:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.460460:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787367753.460481:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367753.460482:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.460490:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff030446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x66f5679bff03044d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.460499:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787367753.460504:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367753.460513:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367753.460515:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367753.460528:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808402944:0@lo:103: 00000100:00100000:2.0:1787367753.460556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367753.460603:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808402816 00000100:00100000:2.0:1787367753.460607:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808402816 00000100:00100000:3.0:1787367753.460621:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808402944 00000100:00100000:3.0:1787367753.460627:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808402944 00000100:00100000:2.0:1787367753.460637:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787367753.460646:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808402816:12345-0@lo:101: 00010000:00010000:2.0:1787367753.460654:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367753.460665:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030454 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.460667:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367753.460693:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:3652:x1874190808402944:12345-0@lo:103: 00010000:00010000:3.0:1787367753.460702:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367753.460715:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673e00/0x66f5679bff03044d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff030446 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.460726:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367753.460755:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:3652:x1874190808402944:12345-0@lo:103: Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367753.460762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787367753.460891:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030454 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.460900:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030454 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.460971:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175800, rc 0) 00000100:00100000:2.0:1787367753.461010:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808402816:12345-0@lo:101: Request processed in 365us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.461015:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787367753.461050:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808402944:0@lo:103: 00000100:00100000:3.0:1787367753.461865:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808402816:0@lo:101: 00010000:00010000:3.0:1787367753.461882:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.461891:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.461988:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403072:0@lo:501: 00000100:00100000:3.0:1787367753.462022:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367753.462056:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367753.462107:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808403072 00000100:00100000:2.0:1787367753.462113:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808403072 00000100:00100000:2.0:1787367753.462151:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787367753.462159:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808403072:12345-0@lo:501: 00000100:00100000:2.0:1787367753.462312:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808403072:12345-0@lo:501: Request processed in 153us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.462331:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787367753.462552:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403072:0@lo:501: 00000100:00100000:3.0:1787367753.462592:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403200:0@lo:503: 00000100:00100000:3.0:1787367753.462630:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367753.462693:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367753.462777:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808403200 00000100:00100000:2.0:1787367753.462782:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808403200 00000100:00100000:2.0:1787367753.462843:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787367753.462851:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808403200:12345-0@lo:503: 00000100:00100000:2.0:1787367753.462946:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808403200:12345-0@lo:503: Request processed in 96us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.462954:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787367753.463023:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403200:0@lo:503: 00000040:00080000:0.0:1787367753.463262:0:8445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787367753.463329:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403328:0@lo:502: 00000100:00100000:0.0:1787367753.463403:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367753.463430:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077240 going to sleep for 11 seconds 00000100:00100000:2.0:1787367753.463564:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808403328 00000100:00100000:2.0:1787367753.463569:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808403328 00000100:00100000:2.0:1787367753.463599:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787367753.463606:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808403328:12345-0@lo:502: 00000100:00100000:2.0:1787367753.463859:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808403328:12345-0@lo:502: Request processed in 252us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.463866:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787367753.464647:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403328:0@lo:502: 00000040:00080000:0.0:1787367753.465164:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787367753.465196:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787367753.465211:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787367753.465225:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787367753.465239:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787367753.465252:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787367753.465293:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403456:0@lo:502: 00000100:00100000:0.0:1787367753.465349:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367753.465423:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077240 going to sleep for 11 seconds 00000100:00100000:2.0:1787367753.465537:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808403456 00000100:00100000:2.0:1787367753.465544:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808403456 00000100:00100000:2.0:1787367753.465589:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787367753.465597:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808403456:12345-0@lo:502: 00000100:00100000:2.0:1787367753.465709:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808403456:12345-0@lo:502: Request processed in 112us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.465716:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787367753.465819:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403456:0@lo:502: 00000040:00080000:0.0:1787367753.465862:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787367753.465870:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787367753.466808:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787367753.466817:0:8470:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787367753.466823:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367753.466826:0:8470:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787367753.466831:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787367753.466845:0:8470:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c55bd6db370) 00000020:00000080:3.0:1787367753.466866:0:8470:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787367753.466884:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787367753.466964:0:8470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55bd606800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787367753.466972:0:8470:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787367753.466978:0:8470:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x66f5679bff030469 00010000:00010000:2.0:1787367753.472677:0:8470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1787367753.472959:0:8470:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787367753.481967:0:8470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787367753.482302:0:8470:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787367753.490432:0:8470:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1787367753.490660:0:8470:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787367753.503193:0:8470:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787367753.510477:0:8470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787367753.510489:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367753.510495:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367753.510497:0:8470:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787367753.510500:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367753.510504:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367753.510505:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787367753.510508:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367753.510510:0:8470:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787367753.510537:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367753.510540:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367753.510541:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787367753.510544:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787367753.510669:0:8445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787367753.510711:0:8445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787367753.510731:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.510741:0:8445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367753.510755:0:8445:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bd606800 from 1 10000000:01000000:0.0:1787367753.510758:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787367753.510791:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.510798:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.510808:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.510828:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403584:0@lo:101: 00000100:00100000:0.0:1787367753.510889:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367753.510954:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367753.511081:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808403584 00000100:00100000:3.0:1787367753.511088:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808403584 00000100:00100000:3.0:1787367753.511139:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787367753.511149:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:8445:x1874190808403584:12345-0@lo:101: 00010000:00010000:3.0:1787367753.511167:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367753.511179:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030470 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.511200:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030470 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.511211:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030470 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.511218:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0a00, rc 0) 00000100:00100000:3.0:1787367753.511251:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808403584:12345-0@lo:101: Request processed in 104us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367753.511258:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787367753.511530:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403584:0@lo:101: 00010000:00010000:0.0:1787367753.511544:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.511554:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.511633:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403712:0@lo:501: 00000100:00100000:0.0:1787367753.511660:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367753.511690:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367753.511782:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808403712 00000100:00100000:3.0:1787367753.511788:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808403712 00000100:00100000:3.0:1787367753.511819:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787367753.511826:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808403712:12345-0@lo:501: 00000100:00100000:3.0:1787367753.511910:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808403712:12345-0@lo:501: Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367753.511917:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787367753.513392:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403712:0@lo:501: 00000100:00100000:0.0:1787367753.513440:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403840:0@lo:503: 00000100:00100000:0.0:1787367753.513507:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367753.513549:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367753.513601:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808403840 00000100:00100000:1.0:1787367753.513606:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808403840 00000100:00100000:1.0:1787367753.513643:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787367753.513652:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808403840:12345-0@lo:503: 00000100:00100000:1.0:1787367753.513780:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808403840:12345-0@lo:503: Request processed in 129us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367753.513788:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787367753.513911:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403840:0@lo:503: 00000040:00080000:0.0:1787367753.514562:0:8445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787367753.514640:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403968:0@lo:502: 00000100:00100000:0.0:1787367753.515350:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367753.515490:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367753.525100:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808403968 00000100:00100000:1.0:1787367753.525114:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808403968 00000100:00100000:1.0:1787367753.525183:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787367753.525194:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808403968:12345-0@lo:502: 00000100:00100000:1.0:1787367753.525406:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808403968:12345-0@lo:502: Request processed in 213us (10724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367753.525414:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787367753.525557:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808403968:0@lo:502: 00000040:00080000:3.0:1787367753.525842:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787367753.525875:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787367753.525910:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404096:0@lo:502: 00000100:00100000:3.0:1787367753.526172:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367753.526219:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367753.526589:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808404096 00000100:00100000:1.0:1787367753.526596:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808404096 00000100:00100000:1.0:1787367753.526634:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787367753.526643:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808404096:12345-0@lo:502: 00000100:00100000:1.0:1787367753.526801:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808404096:12345-0@lo:502: Request processed in 158us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367753.526819:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787367753.526875:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404096:0@lo:502: 00000040:00080000:1.0:1787367753.526937:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787367753.526962:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787367753.528587:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367753.528597:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367753.528599:0:8474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787367753.528605:0:8474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55bd606800 00000020:00000080:1.0:1787367753.528607:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787367753.528618:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367753.528620:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367753.528622:0:8474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787367753.528624:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787367753.528836:0:8445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787367753.528867:0:8445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367753.528889:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.528901:0:8445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367753.528957:0:8445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787367753.528961:0:8445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c55bd606800 10000000:01000000:3.0:1787367753.528964:0:8445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c55bd606800 10000000:01000000:3.0:1787367753.528969:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787367753.528974:0:8445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bd606800 from 1 10000000:01000000:3.0:1787367753.528976:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787367753.529008:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.529015:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.529025:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.529045:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404224:0@lo:101: 00000100:00100000:3.0:1787367753.529113:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367753.529154:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367753.529469:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808404224 00000100:00100000:0.0:1787367753.529477:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808404224 00000100:00100000:0.0:1787367753.529510:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787367753.529518:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8445:x1874190808404224:12345-0@lo:101: 00010000:00010000:0.0:1787367753.529530:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367753.529541:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03047e expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.529562:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03047e expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.529572:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03047e expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.529579:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b400, rc 0) 00000100:00100000:0.0:1787367753.529622:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808404224:12345-0@lo:101: Request processed in 105us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.529629:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787367753.530140:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404224:0@lo:101: 00010000:00010000:3.0:1787367753.530158:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.530167:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367753.530345:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404352:0@lo:501: 00000100:00100000:3.0:1787367753.530408:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367753.530436:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787367753.530489:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808404352 00000100:00100000:2.0:1787367753.530495:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808404352 00000100:00100000:2.0:1787367753.530527:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787367753.530534:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808404352:12345-0@lo:501: 00000100:00100000:2.0:1787367753.530644:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808404352:12345-0@lo:501: Request processed in 110us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.530651:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787367753.532995:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404352:0@lo:501: 00000100:00100000:1.0:1787367753.533057:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404480:0@lo:503: 00000100:00100000:1.0:1787367753.533144:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367753.533191:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54810f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367753.533255:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808404480 00000100:00100000:2.0:1787367753.533261:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808404480 00000100:00100000:2.0:1787367753.533308:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787367753.533317:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808404480:12345-0@lo:503: 00000100:00100000:2.0:1787367753.533456:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808404480:12345-0@lo:503: Request processed in 139us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.533464:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787367753.533684:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404480:0@lo:503: 00000040:00080000:1.0:1787367753.533930:0:8445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787367753.534003:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404608:0@lo:502: 00000100:00100000:1.0:1787367753.534042:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367753.534086:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54810f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367753.534184:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808404608 00000100:00100000:2.0:1787367753.534189:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808404608 00000100:00100000:2.0:1787367753.534240:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787367753.534247:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808404608:12345-0@lo:502: 00000100:00100000:2.0:1787367753.534338:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808404608:12345-0@lo:502: Request processed in 91us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.534345:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787367753.534523:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404608:0@lo:502: 00000040:00080000:1.0:1787367753.534752:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787367753.534776:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787367753.534792:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787367753.534807:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787367753.534833:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787367753.534848:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787367753.534863:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787367753.534875:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787367753.534889:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787367753.534902:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787367753.534917:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787367753.534945:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787367753.535898:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787367753.535943:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787367753.535962:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787367753.535989:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787367753.536013:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787367753.536029:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787367753.536043:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787367753.536057:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787367753.536082:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787367753.536099:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787367753.536115:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787367753.536131:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787367753.536147:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787367753.536161:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787367753.536175:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787367753.536205:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787367753.536561:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787367753.536580:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787367753.536592:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787367753.536603:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787367753.536614:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787367753.536625:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787367753.536637:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787367753.536649:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787367753.536661:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1787367753.536708:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404736:0@lo:502: 00000100:00100000:1.0:1787367753.536789:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367753.536946:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54810f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367753.541473:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808404736 00000100:00100000:2.0:1787367753.541488:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808404736 00000100:00100000:2.0:1787367753.541551:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787367753.541618:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808404736:12345-0@lo:502: 00000100:00100000:3.0:1787367753.542028:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808404736:12345-0@lo:502: Request processed in 467us (5237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367753.542037:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787367753.542083:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808404736:0@lo:502: 00000040:00080000:1.0:1787367753.542160:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787367753.542174:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787367753.544055:0:8475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787367753.544084:0:8475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c559124cd28) 00000020:00000080:1.0:1787367753.544108:0:8475:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787367753.544199:0:8475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55bd606800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787367753.544204:0:8475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bd606800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787367753.544206:0:8475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bd606800 3 00010000:00080000:1.0:1787367753.544234:0:8475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5481b9a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787367753.549873:0:8475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1787367753.550623:0:8475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787367753.550795:0:8475:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787367753.550816:0:8475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x66f5679bff030493 00000100:00080000:0.0:1787367753.550826:0:8475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787367753.550831:0:8475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c5481b9a000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787367753.550863:0:8475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55912f3b80 x1874190808404864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787367753.550918:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808404864:0@lo:38: 00000100:00100000:3.0:1787367753.550998:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787367753.551056:0:8475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787367753.551724:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808404864 00000100:00100000:2.0:1787367753.551733:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808404864 00000100:00100000:2.0:1787367753.551775:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367753.551783:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808404864:12345-0@lo:38: 00010000:00080000:2.0:1787367753.551807:0:6539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1787367753.551838:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x66f5679bff03049a 00000004:00100000:2.0:1787367753.551853:0:6539:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787367753.551885:0:6539:0:(import.c:65:import_set_state_nolock()) ffff9c55a915d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787367753.556962:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874190808404864:12345-0@lo:38: Request processed in 5167us (5953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.556978:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367753.557182:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808404992:0@lo:400: 00000100:00100000:1.0:1787367753.557240:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367753.557265:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808405248:0@lo:400: 00000100:00100000:1.0:1787367753.557268:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367753.557273:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808405120:0@lo:400: 00010000:00080000:3.0:1787367753.557714:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55912f3b80 x1874190808404864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367753.557726:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787367753.557736:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787367753.557744:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787367753.557749:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787367753.557752:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787367753.557759:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808404864:0@lo:38: 00000100:00100000:3.0:1787367753.558209:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808404992 00000100:00100000:3.0:1787367753.558217:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808404992 00000100:00100000:3.0:1787367753.558262:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787367753.558270:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808404992:12345-0@lo:400: 00000100:00100000:1.0:1787367753.558419:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367753.558526:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808404992:12345-0@lo:400: Request processed in 256us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367753.558534:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787367753.558573:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808405376:0@lo:400: 00010000:00080000:1.0:1787367753.558686:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55bc693480 x1874190808404992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367753.558695:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808404992:0@lo:400: 00000100:00100000:2.0:1787367753.558747:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367753.558898:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808405248 00000100:00100000:1.0:1787367753.558903:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808405248 00000100:00100000:1.0:1787367753.558934:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787367753.558944:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808405248:12345-0@lo:400: 00000100:00100000:1.0:1787367753.558986:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808405248:12345-0@lo:400: Request processed in 45us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367753.559002:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787367753.559175:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808405120 00000100:00100000:3.0:1787367753.559179:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808405120 00000100:00100000:3.0:1787367753.559212:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787367753.559219:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808405120:12345-0@lo:400: 00010000:00080000:2.0:1787367753.561156:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55bc692a00 x1874190808405248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367753.561175:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808405248:0@lo:400: 00000020:01000004:0.0:1787367753.561932:0:8475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787367753.562347:0:8475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c55b55419b8) 00000020:00000080:0.0:1787367753.562386:0:8475:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787367753.562470:0:8475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55bd606800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787367753.562474:0:8475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bd606800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787367753.562477:0:8475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bd606800 3 00010000:00080000:0.0:1787367753.562519:0:8475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55c0027800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.104@tcp at head 00000100:00100000:3.0:1787367753.565463:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808405120:12345-0@lo:400: Request processed in 6234us (7039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367753.565549:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787367753.565607:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367753.565685:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808405120:0@lo:400: 00000100:00100000:3.0:1787367753.565711:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808405376 00000100:00100000:3.0:1787367753.565717:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808405376 00000100:00100000:3.0:1787367753.565758:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787367753.565768:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808405376:12345-0@lo:400: 00000100:00100000:3.0:1787367753.566557:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808405376:12345-0@lo:400: Request processed in 788us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367753.566566:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787367753.566668:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808405376:0@lo:400: 00010000:00010000:0.0:1787367753.568023:0:8475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1787367753.568226:0:8475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787367753.568269:0:8475:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787367753.568281:0:8475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x66f5679bff0304a8 00000100:00080000:0.0:1787367753.568290:0:8475:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787367753.568295:0:8475:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c55c0027800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787367753.568328:0:8475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55912f3480 x1874190808405504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787367753.568379:0:8475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787367753.568409:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808405504:0@lo:38: 00000100:00100000:3.0:1787367753.568754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367753.568852:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808405504 00000100:00100000:0.0:1787367753.568860:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808405504 00000100:00100000:0.0:1787367753.568894:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367753.568901:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874190808405504:12345-0@lo:38: 00010000:00080000:0.0:1787367753.568924:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1787367753.568987:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x66f5679bff0304af 00000004:00100000:0.0:1787367753.569007:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787367753.569044:0:6540:0:(import.c:65:import_set_state_nolock()) ffff9c548252c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367753.569119:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874190808405504:12345-0@lo:38: Request processed in 217us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.569128:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1787367753.569217:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:2.0:1787367753.569249:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55912f3480 x1874190808405504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367753.569260:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787367753.569268:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787367753.569275:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787367753.569279:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787367753.569282:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55c0027800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787367753.569288:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808405504:0@lo:38: 00000020:01000000:3.0:1787367753.569510:0:8445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787367753.569591:0:8445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787367753.569606:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367753.569616:0:8445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787367753.569657:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787367753.569659:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787367753.569660:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367753.569664:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367753.569666:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367753.569667:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367753.569668:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367753.569669:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367753.569670:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367753.569672:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367753.569673:0:8445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787367753.569676:0:8445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787367753.569678:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787367753.569679:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787367753.569680:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367753.569681:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367753.569682:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367753.569683:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367753.569684:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367753.569684:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367753.569685:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367753.569686:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367753.569687:0:8445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787367753.569700:0:8445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787367753.569709:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808405632:0@lo:253: 00000100:00100000:3.0:1787367753.569748:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367753.569779:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367753.569807:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808405632 00000100:00100000:0.0:1787367753.569812:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808405632 00000100:00100000:0.0:1787367753.569845:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787367753.569852:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808405632:12345-0@lo:253: 20000000:01000000:0.0:1787367753.569871:0:6530:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787367753.569884:0:6530:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787367753.582553:0:6530:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787367753.582576:0:6530:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787367753.582600:0:6554:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787367753.582605:0:6554:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787367753.582625:0:6554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.582643:0:6554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68a200/0x66f5679bff0303ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303a5 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.582651:0:6554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68b600/0x66f5679bff0303c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0303c1 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.582658:0:6554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.582695:0:6554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68b600/0x66f5679bff0303c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0303c1 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.582709:0:6554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68b600/0x66f5679bff0303c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0303c1 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367753.582722:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808405760:0@lo:104: 00000100:00100000:1.0:1787367753.582800:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367753.582912:0:6554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68a200/0x66f5679bff0303ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0303a5 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367753.582921:0:6554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68a200/0x66f5679bff0303ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0303a5 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367753.582946:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808405888:0@lo:104: 00000100:00100000:1.0:1787367753.582967:0:6554:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54810f4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787367753.583081:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:8445:x1874190808405632:12345-0@lo:253: Request processed in 13218us (13321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.583091:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787367753.583232:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8445:1874190808405632:0@lo:253: 10000000:01000000:1.0:1787367753.583244:0:8445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787367753.583247:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787367753.583249:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787367753.583250:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367753.583251:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367753.583253:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367753.583254:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367753.583255:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787367753.583257:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367753.583259:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367753.583260:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367753.583261:0:8445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787367753.583272:0:8445:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787367753.588860:0:6522:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787367753.588915:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367753.588961:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808405760 00000100:00100000:2.0:1787367753.588969:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808405760 00000100:00100000:2.0:1787367753.589003:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808405888 00000100:00100000:2.0:1787367753.589007:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808405888 00000100:00100000:2.0:1787367753.589022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787367753.589031:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd676050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6554:x1874190808405760:12345-0@lo:104: 00010000:00010000:2.0:1787367753.589048:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0303c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.589136:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367753.589142:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd676050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6554:x1874190808405760:12345-0@lo:104: Request processed in 113us (6342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.589150:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787367753.589187:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367753.589194:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc510e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808405888:12345-0@lo:104: 00010000:00010000:2.0:1787367753.589202:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff0303a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.589275:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787367753.589280:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc510e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808405888:12345-0@lo:104: Request processed in 87us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.589286:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787367753.589304:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367753.589309:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0303c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.589317:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367753.589321:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0303c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.589329:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0303c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.589334:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1787367753.589338:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0303c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.589340:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff0303a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367753.589344:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367753.589346:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175400 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367753.589349:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff0303a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.589716:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff0303a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367753.589725:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff0303a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367753.589738:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367753.589755:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff0303a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.589761:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787367753.589856:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808406144:0@lo:103: 00000100:00100000:3.0:1787367753.589896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787367753.589952:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff0303a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.589960:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff0303a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303ac expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.589973:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367753.589975:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367753.589976:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367753.590771:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808405760:0@lo:104: 00000100:00100000:0.0:1787367753.590804:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808405888:0@lo:104: 00010000:00010000:0.0:1787367753.590825:0:6554:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.594459:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808406144 00000100:00100000:0.0:1787367753.594472:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808406144 00010000:00010000:0.0:1787367753.594507:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68a200/0x66f5679bff0303ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303a5 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367753.594547:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787367753.594557:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:3653:x1874190808406144:12345-0@lo:103: 00010000:00010000:0.0:1787367753.594571:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367753.594577:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68a200/0x66f5679bff0303ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303a5 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.594595:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68a200/0x66f5679bff0303ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0303a5 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.594613:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68a200/0x66f5679bff0303ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0303a5 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367753.594628:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00080000:10000000:1.0:1787367753.595110:0:8445:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787367753.595646:0:8445:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787367753.595849:0:8445:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787367753.596036:0:8445:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787367753.596275:0:8445:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00010000:00010000:2.0:1787367753.599117:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0303c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599134:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367753.599167:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0303c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599174:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0303c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0303c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599218:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367753.599220:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367753.599222:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367753.599248:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808406016:0@lo:103: 00000100:00100000:2.0:1787367753.599316:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367753.599402:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808406016 00000100:00100000:2.0:1787367753.599409:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808406016 00010000:00010000:2.0:1787367753.599437:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68b600/0x66f5679bff0303c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303c1 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367753.599464:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367753.599473:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc511500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:3654:x1874190808406016:12345-0@lo:103: 00010000:00010000:2.0:1787367753.599485:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367753.599491:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68b600/0x66f5679bff0303c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0303c1 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599502:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68b600/0x66f5679bff0303c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0303c1 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599518:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68b600/0x66f5679bff0303c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0303c1 expref: 16 pid: 6530 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599532:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599540:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787367753.599554:0:6524:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016949288s 00010000:00010000:2.0:1787367753.599565:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599572:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599579:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599587:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599593:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673c00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787367753.599597:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599604:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599619:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599630:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367753.599666:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc511500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:3654:x1874190808406016:12345-0@lo:103: Request processed in 194us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367753.599674:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367753.599711:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808406016:0@lo:103: 00010000:00010000:2.0:1787367753.599733:0:6554:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599741:0:6554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367753.599755:0:6554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673c00/0x66f5679bff0304b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787367753.600902:0:8445:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1787367753.602493:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:3653:x1874190808406144:12345-0@lo:103: Request processed in 7930us (12588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367753.602507:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000001:00000004:2.0:1787367753.603916:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787367753.613621:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808406144:0@lo:103: 00002000:00080000:2.0:1787367753.615152:0:8445:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787367753.615161:0:8445:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787367753.615195:0:8445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787367753.615240:0:8445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787367753.615264:0:8445:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787367753.615285:0:8445:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787367753.616718:0:8445:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787367753.617332:0:8445:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787367754.072957:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787367754.573016:0:8531:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787367754.573890:0:8531:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787367755.103929:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367755.672574:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367755.675156:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808406272:0@lo:41: 00000100:00100000:0.0:1787367755.675237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367755.677317:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808406272 00000100:00100000:1.0:1787367755.677330:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808406272 00000100:00100000:1.0:1787367755.677822:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787367755.677835:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808406272:12345-0@lo:41: 00000004:00000024:1.0:1787367755.677869:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1787367755.677953:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808406272:12345-0@lo:41: Request processed in 121us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367755.677969:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787367755.678045:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808406272:0@lo:41: 00010000:00010000:2.0:1787367756.121023:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367757.144546:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367757.729613:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808406400:0@lo:41: 00000100:00100000:3.0:1787367757.729682:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367757.731185:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808406400 00000100:00100000:0.0:1787367757.731196:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808406400 00000100:00100000:0.0:1787367757.731244:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787367757.731253:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808406400:12345-0@lo:41: 00000004:00000024:0.0:1787367757.731284:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787367757.731376:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808406400:12345-0@lo:41: Request processed in 104us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367757.731384:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787367757.731485:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808406400:0@lo:41: 00010000:00010000:0.0:1787367758.171458:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367758.749769:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808406784:0@lo:400: 00000100:00100000:0.0:1787367758.749837:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367758.749890:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808407296:0@lo:400: 00000100:00100000:0.0:1787367758.749925:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367758.749950:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367758.749956:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808406912:0@lo:400: 00000100:00100000:0.0:1787367758.749978:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367758.750016:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808407296 00000100:00100000:0.0:1787367758.750022:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808407296 00000100:00100000:0.0:1787367758.750114:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808406912 00000100:00100000:0.0:1787367758.750117:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808406912 00000100:00100000:0.0:1787367758.750134:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787367758.750141:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808407296:12345-0@lo:400: 00000100:00100000:0.0:1787367758.750188:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808407296:12345-0@lo:400: Request processed in 47us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367758.750196:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787367758.750211:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787367758.750217:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808406912:12345-0@lo:400: 00000100:00100000:2.0:1787367758.750241:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808406656:0@lo:400: 00000100:00100000:0.0:1787367758.750245:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808406912:12345-0@lo:400: Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367758.750250:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367758.750269:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787367758.750285:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55912f2d80 x1874190808406912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367758.750286:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808407168:0@lo:400: 00000100:00100000:0.0:1787367758.750298:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808406912:0@lo:400: 00000100:00100000:2.0:1787367758.750308:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787367758.750309:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482621c00 x1874190808407296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367758.750318:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808407296:0@lo:400: 00000100:00100000:2.0:1787367758.750321:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787367758.750326:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808406528:0@lo:400: 00000100:00100000:0.0:1787367758.750339:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808406656 00000100:00100000:0.0:1787367758.750343:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808406656 00000100:00100000:2.0:1787367758.750349:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367758.750392:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808407040:0@lo:400: 00000100:00100000:0.0:1787367758.750395:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808407168 00000100:00100000:0.0:1787367758.750398:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808407168 00000100:00100000:0.0:1787367758.750411:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787367758.750413:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367758.750416:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808406656:12345-0@lo:400: 00000100:00100000:0.0:1787367758.750444:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808406656:12345-0@lo:400: Request processed in 28us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367758.750450:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787367758.750451:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55912f3b80 x1874190808406656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367758.750460:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808406656:0@lo:400: 00000100:00100000:0.0:1787367758.750460:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787367758.750466:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808407168:12345-0@lo:400: 00000100:00100000:0.0:1787367758.750490:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808407168:12345-0@lo:400: Request processed in 25us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367758.750496:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787367758.750510:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808406784 00010000:00080000:2.0:1787367758.750513:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482621880 x1874190808407168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367758.750513:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808406784 00000100:00100000:2.0:1787367758.750522:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808407168:0@lo:400: 00000100:00100000:0.0:1787367758.750530:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808407040 00000100:00100000:0.0:1787367758.750533:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808407040 00000100:00100000:0.0:1787367758.750547:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787367758.750553:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808406784:12345-0@lo:400: 00000100:00100000:3.0:1787367758.750562:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808406528 00000100:00100000:3.0:1787367758.750570:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808406528 00000100:00100000:0.0:1787367758.750599:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808406784:12345-0@lo:400: Request processed in 45us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367758.750608:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787367758.750609:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787367758.750623:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787367758.750628:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:3654:x1874190808406528:12345-0@lo:400: 00000100:00100000:0.0:1787367758.750635:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808407040:12345-0@lo:400: 00000100:00100000:0.0:1787367758.750678:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808407040:12345-0@lo:400: Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367758.750686:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787367758.750693:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:3654:x1874190808406528:12345-0@lo:400: Request processed in 68us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367758.750702:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787367758.750721:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808406528:0@lo:400: 00000100:00100000:0.0:1787367758.750746:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808407040:0@lo:400: 00000100:00080000:1.0:1787367758.752403:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367758.752411:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367758.753778:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808406784:0@lo:400: 00010000:00010000:2.0:1787367759.192498:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367759.757055:0:8821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787367760.218764:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787367760.617803:0:8873:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787367760.618050:0:8873:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787367760.793766:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808407424:0@lo:41: 00000100:00100000:2.0:1787367760.793837:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367760.793945:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808407424 00000100:00100000:0.0:1787367760.793953:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808407424 00000100:00100000:0.0:1787367760.794013:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787367760.794031:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808407424:12345-0@lo:41: 00000004:00000024:0.0:1787367760.794064:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1787367760.794120:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808407424:12345-0@lo:41: Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367760.794127:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787367760.794419:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808407424:0@lo:41: 00010000:00010000:0.0:1787367761.247015:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787367761.304616:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787367761.304624:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bc6be800 from 30 10000000:01000000:0.0:1787367761.304629:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787367761.304669:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367761.304682:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367761.304693:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367761.304716:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808407552:0@lo:101: 00000100:00100000:0.0:1787367761.304778:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367761.304835:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367761.304900:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808407552 00000100:00100000:2.0:1787367761.304907:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808407552 00000100:00100000:2.0:1787367761.304957:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787367761.304967:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:6535:x1874190808407552:12345-0@lo:101: 00010000:00010000:2.0:1787367761.304979:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367761.304992:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0304bd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.305015:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0304bd expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.305036:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0304bd expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.305045:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2174c00, rc 0) 00000100:00100000:2.0:1787367761.305130:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808407552:12345-0@lo:101: Request processed in 164us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367761.305137:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787367761.308612:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808407552:0@lo:101: 00010000:00010000:1.0:1787367761.308640:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.308652:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367761.308733:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808407680:0@lo:501: 00000100:00100000:1.0:1787367761.308786:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.308881:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd652780 going to sleep for 11 seconds 00000100:00100000:2.0:1787367761.312211:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808407680 00000100:00100000:2.0:1787367761.312225:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808407680 00000100:00100000:2.0:1787367761.312324:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787367761.312335:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808407680:12345-0@lo:501: 00000100:00100000:2.0:1787367761.312534:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808407680:12345-0@lo:501: Request processed in 201us (3747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367761.312543:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787367761.312632:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808407680:0@lo:501: 00000100:00100000:3.0:1787367761.312684:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808407808:0@lo:503: 00000100:00100000:3.0:1787367761.312730:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367761.313692:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6e7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367761.313928:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808407808 00000100:00100000:0.0:1787367761.313944:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808407808 00000100:00100000:0.0:1787367761.313976:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787367761.313984:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808407808:12345-0@lo:503: 00000100:00100000:0.0:1787367761.314131:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808407808:12345-0@lo:503: Request processed in 147us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367761.314139:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787367761.316386:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808407808:0@lo:503: 00000100:00100000:3.0:1787367761.316616:0:8907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8907:1874190808407936:0@lo:502: 00000100:00100000:3.0:1787367761.316682:0:8907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367761.316720:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808407936 00000100:00100000:3.0:1787367761.316726:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808407936 00000100:00100000:3.0:1787367761.316760:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787367761.316769:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8907:x1874190808407936:12345-0@lo:502: 00000100:00100000:3.0:1787367761.316867:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8907:x1874190808407936:12345-0@lo:502: Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367761.316874:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787367761.316921:0:8907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6e7780 going to sleep for 11 seconds 00000100:00100000:3.0:1787367761.316935:0:8907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8907:1874190808407936:0@lo:502: 00000100:00100000:3.0:1787367761.316977:0:8907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8907:1874190808408064:0@lo:502: 00000100:00100000:3.0:1787367761.317009:0:8907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367761.317040:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808408064 00000100:00100000:3.0:1787367761.317043:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808408064 00000100:00100000:3.0:1787367761.317061:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787367761.317073:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8907:x1874190808408064:12345-0@lo:502: 00000100:00100000:3.0:1787367761.317131:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:8907:x1874190808408064:12345-0@lo:502: Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367761.317137:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787367761.317165:0:8907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6e7780 going to sleep for 11 seconds 00000100:00100000:3.0:1787367761.317176:0:8907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8907:1874190808408064:0@lo:502: 00000040:00080000:3.0:1787367761.317193:0:8907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787367761.317793:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787367761.317817:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367761.317826:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.317838:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367761.317847:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787367761.317850:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55bc6be800 from 5 10000000:01000000:2.0:1787367761.317853:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787367761.317881:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.317890:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.317900:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367761.317913:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408192:0@lo:101: 00000100:00100000:2.0:1787367761.317946:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.317977:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367761.319149:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808408192 00000100:00100000:3.0:1787367761.319158:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808408192 00000100:00100000:3.0:1787367761.319199:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787367761.319207:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808408192:12345-0@lo:101: 00010000:00010000:3.0:1787367761.319220:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367761.319246:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0304cb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367761.319270:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0304cb expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367761.319282:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0304cb expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367761.319291:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0600, rc 0) 00000100:00100000:3.0:1787367761.319347:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808408192:12345-0@lo:101: Request processed in 140us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367761.319379:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787367761.319429:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408192:0@lo:101: 00010000:00010000:3.0:1787367761.319444:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367761.319461:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367761.319525:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408320:0@lo:256: 00000100:00100000:3.0:1787367761.319560:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367761.319585:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6e7840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367761.319600:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808408320 00000100:00100000:3.0:1787367761.319604:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808408320 00000100:00100000:3.0:1787367761.319624:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787367761.319630:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808408320:12345-0@lo:256: 20000000:01000000:3.0:1787367761.319643:0:6533:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787367761.319658:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787367761.319661:0:6533:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787367761.319738:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808408320:12345-0@lo:256: Request processed in 107us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367761.319744:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787367761.319772:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408320:0@lo:256: 10000000:01000000:3.0:1787367761.319815:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367761.319821:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367761.319828:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367761.319836:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787367761.319838:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1787367761.319840:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787367761.319869:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367761.319876:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367761.319884:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367761.319894:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408448:0@lo:101: 00000100:00100000:3.0:1787367761.319917:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367761.319937:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6e7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.319939:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808408448 00000100:00100000:1.0:1787367761.319943:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808408448 00000100:00100000:1.0:1787367761.322565:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787367761.322582:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808408448:12345-0@lo:101: 00010000:00010000:1.0:1787367761.322598:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367761.322614:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0304d9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.322718:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0304d9 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.322731:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0304d9 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.322752:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672800, rc 0) 00000100:00100000:1.0:1787367761.322825:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808408448:12345-0@lo:101: Request processed in 248us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.322832:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787367761.322886:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408448:0@lo:101: 00010000:00010000:1.0:1787367761.322904:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.322914:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367761.323062:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408576:0@lo:501: 00000100:00100000:1.0:1787367761.323159:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.323255:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd652480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.323271:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808408576 00000100:00100000:1.0:1787367761.323275:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808408576 00000100:00100000:1.0:1787367761.323304:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787367761.323311:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808408576:12345-0@lo:501: 00000100:00100000:1.0:1787367761.323453:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808408576:12345-0@lo:501: Request processed in 142us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.323461:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787367761.323491:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408576:0@lo:501: 00000100:00100000:1.0:1787367761.323521:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408704:0@lo:503: 00000100:00100000:1.0:1787367761.323559:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.323577:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd652480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.323593:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808408704 00000100:00100000:1.0:1787367761.323596:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808408704 00000100:00100000:1.0:1787367761.323613:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787367761.323619:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808408704:12345-0@lo:503: 00000100:00100000:1.0:1787367761.323778:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808408704:12345-0@lo:503: Request processed in 157us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.323785:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787367761.323823:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808408704:0@lo:503: 00000100:00100000:1.0:1787367761.327055:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8909:1874190808408832:0@lo:502: 00000100:00100000:1.0:1787367761.327483:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.327521:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808408832 00000100:00100000:1.0:1787367761.327527:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808408832 00000100:00100000:1.0:1787367761.327565:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787367761.327574:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:8909:x1874190808408832:12345-0@lo:502: 00000100:00100000:1.0:1787367761.327742:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:8909:x1874190808408832:12345-0@lo:502: Request processed in 168us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.327749:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787367761.327797:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.327814:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8909:1874190808408832:0@lo:502: 00000020:01000000:1.0:1787367761.327839:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787367761.327845:0:8909:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787367761.327851:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367761.327853:0:8909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787367761.327857:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787367761.327860:0:8909:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1787367761.327879:0:8909:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787367761.327881:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787367761.327899:0:8909:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c55912499b8) 00000020:00000080:1.0:1787367761.327986:0:8909:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1787367761.328058:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787367761.328266:0:8909:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787367761.328272:0:8909:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787367761.328279:0:8909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff0304ee 00010000:00080000:1.0:1787367761.328321:0:8909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55b606c000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1787367761.328542:0:8909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787367761.345594:0:8909:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787367761.345619:0:8909:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787367761.345902:0:8909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367761.346455:0:8909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367761.346542:0:8909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787367761.346711:0:8909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787367761.347037:0:8912:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367761.347042:0:8912:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787367761.355770:0:8909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787367761.355787:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787367761.355835:0:8909:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787367761.355864:0:8909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff0304f5 00000100:00080000:1.0:1787367761.355876:0:8909:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787367761.355883:0:8909:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c55b606c000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787367761.355919:0:8909:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bc693800 x1874190808408960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787367761.355942:0:8909:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787367761.356434:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808409088:0@lo:400: 00000100:00100000:1.0:1787367761.356506:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.356540:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808409600:0@lo:400: 00000100:00100000:1.0:1787367761.356567:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.356588:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367761.356594:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808409216:0@lo:400: 00000100:00100000:1.0:1787367761.356625:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787367761.356728:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367761.356735:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367761.356737:0:8909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787367761.356739:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367761.356743:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367761.356744:0:8909:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787367761.356747:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787367761.356749:0:8909:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787367761.356775:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8909:1874190808409728:0@lo:502: 00000100:00100000:1.0:1787367761.356818:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.356845:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808409728 00000100:00100000:1.0:1787367761.356851:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808409728 00000100:00100000:1.0:1787367761.356891:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787367761.356900:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:8909:x1874190808409728:12345-0@lo:502: 00000100:00100000:1.0:1787367761.357046:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:8909:x1874190808409728:12345-0@lo:502: Request processed in 146us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.357055:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787367761.357109:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.357128:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8909:1874190808409728:0@lo:502: 00000020:01000000:1.0:1787367761.357152:0:8909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367761.357156:0:8909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367761.357157:0:8909:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787367761.357160:0:8909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1787367761.357445:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1787367761.357469:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787367761.357478:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.357500:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367761.357510:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787367761.357512:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55834d5000 from 30 10000000:01000000:1.0:1787367761.357515:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787367761.357539:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.357547:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.357555:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367761.357568:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808409856:0@lo:101: 00000100:00100000:1.0:1787367761.357598:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.357613:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587d8b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.357629:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808409856 00000100:00100000:1.0:1787367761.357633:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808409856 00000100:00100000:1.0:1787367761.357661:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787367761.357668:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808409856:12345-0@lo:101: 00010000:00010000:1.0:1787367761.357677:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367761.357691:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0304fc expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.357713:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0304fc expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.357737:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0304fc expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.357746:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673800, rc 0) 00000100:00100000:1.0:1787367761.357777:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808409856:12345-0@lo:101: Request processed in 110us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.357783:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787367761.357816:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808409856:0@lo:101: 00010000:00010000:1.0:1787367761.357828:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.357836:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367761.357880:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808409984:0@lo:501: 00000100:00100000:1.0:1787367761.357903:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.357915:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587d8b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.357926:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808409984 00000100:00100000:1.0:1787367761.357929:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808409984 00000100:00100000:1.0:1787367761.357949:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787367761.357955:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808409984:12345-0@lo:501: 00000100:00100000:1.0:1787367761.358061:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808409984:12345-0@lo:501: Request processed in 105us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.358068:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787367761.358110:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808409984:0@lo:501: 00000100:00100000:1.0:1787367761.358134:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808410112:0@lo:503: 00000100:00100000:1.0:1787367761.359848:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.359895:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55905c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.359927:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808410112 00000100:00100000:1.0:1787367761.359935:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808410112 00000100:00100000:1.0:1787367761.359982:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787367761.359991:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808410112:12345-0@lo:503: 00000100:00100000:1.0:1787367761.360137:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808410112:12345-0@lo:503: Request processed in 146us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.360145:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787367761.360214:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808410112:0@lo:503: 00000100:00100000:2.0:1787367761.361124:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808408960:0@lo:8: 00000100:00100000:2.0:1787367761.361177:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.361220:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808409344:0@lo:400: 00000100:00100000:2.0:1787367761.361611:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.361639:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367761.361647:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808409472:0@lo:400: 00000100:00100000:1.0:1787367761.362005:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808409344 00000100:00100000:1.0:1787367761.362013:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808409344 00000100:00100000:1.0:1787367761.362083:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787367761.362094:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808409344:12345-0@lo:400: 00000100:00100000:2.0:1787367761.362100:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.362141:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808408960 00000100:00100000:2.0:1787367761.362145:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808408960 00000100:00100000:1.0:1787367761.362147:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808409344:12345-0@lo:400: Request processed in 56us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.362154:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787367761.362172:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367761.362177:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808408960:12345-0@lo:8: 00010000:00080000:2.0:1787367761.362200:0:8451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1787367761.362295:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff03050a 00002000:00100000:2.0:1787367761.362334:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c55a94e7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787367761.362339:0:8451:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1787367761.362342:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787367761.362388:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808409088 00000100:00100000:0.0:1787367761.362393:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808409088 00002000:00100000:2.0:1787367761.362413:0:8451:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787367761.362414:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808409600 00000100:00100000:0.0:1787367761.362417:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808409600 00000100:00100000:0.0:1787367761.362439:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808409216 00000100:00100000:0.0:1787367761.362442:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808409216 00000100:00100000:0.0:1787367761.362453:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808409472 00000100:00100000:0.0:1787367761.362455:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808409472 00000100:00100000:0.0:1787367761.362468:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787367761.362474:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808409088:12345-0@lo:400: 00000100:00100000:0.0:1787367761.362516:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808409088:12345-0@lo:400: Request processed in 42us (6009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367761.362522:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787367761.362536:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787367761.362542:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808409600:12345-0@lo:400: 00000100:00100000:0.0:1787367761.362569:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808409600:12345-0@lo:400: Request processed in 28us (6001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367761.362576:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787367761.362624:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367761.362628:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787367761.362657:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bc691880 x1874190808409088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367761.362672:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808409088:0@lo:400: 00010000:00080000:1.0:1787367761.362683:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd624380 x1874190808409600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367761.362691:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808409600:0@lo:400: 00002000:00080000:2.0:1787367761.362924:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787367761.362948:0:8451:0:(import.c:65:import_set_state_nolock()) ffff9c55a94e2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787367761.362990:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874190808408960:12345-0@lo:8: Request processed in 812us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367761.362996:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367761.363039:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808409344:0@lo:400: 00010000:00080000:2.0:1787367761.363063:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bc693800 x1874190808408960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787367771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367761.363071:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787367761.363083:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787367761.363091:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787367761.363096:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787367761.363098:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55b606c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787367761.363120:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787367761.363125:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808408960:0@lo:8: 00000100:00100000:1.0:1787367761.363190:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8913:1874190808410240:0@lo:700: 00000100:00100000:1.0:1787367761.363227:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.363251:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.363443:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787367761.363453:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808409216:12345-0@lo:400: 00000100:00100000:1.0:1787367761.363491:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808409216:12345-0@lo:400: Request processed in 41us (6866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.363498:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787367761.363511:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787367761.363518:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808409472:12345-0@lo:400: 00000100:00100000:1.0:1787367761.363549:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808409472:12345-0@lo:400: Request processed in 32us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.363555:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787367761.363584:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bc692a00 x1874190808409216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367761.363594:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808409216:0@lo:400: 00000004:00080000:0.0:1787367761.363679:0:8912:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787367761.363733:0:8912:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 218651377010ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787367761.363739:0:8912:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787367761.364333:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8915:1874190808410368:0@lo:502: 00000100:00100000:0.0:1787367761.364399:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367761.364426:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826243c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367761.364775:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808410240 00000100:00100000:2.0:1787367761.364783:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808410240 00000100:00100000:2.0:1787367761.364826:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367761.364834:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8913:x1874190808410240:12345-0@lo:700: 00000100:00100000:2.0:1787367761.364865:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8460:1874190808410496:0@lo:700: 00000100:00100000:2.0:1787367761.364895:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.364913:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077e40 going to sleep for 11 seconds 00010000:00080000:2.0:1787367761.364939:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bc693480 x1874190808409472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367761.364949:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808409472:0@lo:400: 00000100:00100000:2.0:1787367761.364972:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808410496 00000100:00100000:2.0:1787367761.364976:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808410496 00000100:00100000:1.0:1787367761.364982:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808410368 00000100:00100000:1.0:1787367761.364985:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808410368 00000100:00100000:2.0:1787367761.365000:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367761.365006:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8460:x1874190808410496:12345-0@lo:700: 00000100:00100000:1.0:1787367761.365006:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787367761.365011:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:8915:x1874190808410368:12345-0@lo:502: 00000100:00100000:1.0:1787367761.365571:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:8915:x1874190808410368:12345-0@lo:502: Request processed in 557us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.365579:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787367761.365591:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367761.365969:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8915:1874190808410368:0@lo:502: 00000100:00100000:2.0:1787367761.366035:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8915:1874190808410624:0@lo:502: 00000100:00100000:2.0:1787367761.366076:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.366110:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.366966:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808410624 00000100:00100000:1.0:1787367761.366975:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808410624 00000100:00100000:1.0:1787367761.367015:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787367761.367036:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:8915:x1874190808410624:12345-0@lo:502: 00000100:00100000:1.0:1787367761.367282:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:8915:x1874190808410624:12345-0@lo:502: Request processed in 247us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.367289:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787367761.367330:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8915:1874190808410624:0@lo:502: 00000040:00080000:2.0:1787367761.367377:0:8915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787367761.367447:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787367761.367468:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787367761.367477:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.367488:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367761.367496:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787367761.367499:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55834d5000 from 5 10000000:01000000:1.0:1787367761.367502:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787367761.367527:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.367534:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.367543:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367761.367556:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808410752:0@lo:101: 00000100:00100000:1.0:1787367761.367587:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.367612:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.367742:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808410752 00000100:00100000:1.0:1787367761.367747:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808410752 00000100:00100000:1.0:1787367761.367773:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787367761.367779:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808410752:12345-0@lo:101: 00010000:00010000:1.0:1787367761.367794:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367761.367805:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030511 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.367826:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030511 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.367835:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030511 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.367844:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673200, rc 0) 00000100:00100000:1.0:1787367761.367873:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808410752:12345-0@lo:101: Request processed in 94us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.367880:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787367761.367922:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808410752:0@lo:101: 00010000:00010000:1.0:1787367761.367933:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367761.367941:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367761.367981:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808410880:0@lo:256: 00000100:00100000:1.0:1787367761.368012:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.368037:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367761.368056:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808410880 00000100:00100000:0.0:1787367761.368060:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808410880 00000100:00100000:0.0:1787367761.368092:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787367761.368100:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808410880:12345-0@lo:256: 20000000:01000000:0.0:1787367761.368112:0:6533:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787367761.368126:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787367761.368130:0:6533:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787367761.368214:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808410880:12345-0@lo:256: Request processed in 115us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367761.368222:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787367761.368609:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808410880:0@lo:256: 10000000:01000000:2.0:1787367761.368657:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787367761.368663:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.368671:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367761.368677:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787367761.368679:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787367761.368736:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787367761.368756:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.368762:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.368769:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367761.368781:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411008:0@lo:101: 00000100:00100000:2.0:1787367761.368808:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.371856:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367761.372047:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808411008 00000100:00100000:2.0:1787367761.372055:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808411008 00000100:00100000:2.0:1787367761.372103:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787367761.372113:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808411008:12345-0@lo:101: 00010000:00010000:2.0:1787367761.372129:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367761.372154:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03051f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.372180:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03051f expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.372190:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03051f expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.372199:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2174800, rc 0) 00000100:00100000:2.0:1787367761.372251:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808411008:12345-0@lo:101: Request processed in 140us (3441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367761.372258:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787367761.372308:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411008:0@lo:101: 00010000:00010000:2.0:1787367761.372323:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.372332:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367761.372451:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411136:0@lo:501: 00000100:00100000:2.0:1787367761.372497:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.372510:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367761.372606:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808411136 00000100:00100000:2.0:1787367761.372610:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808411136 00000100:00100000:2.0:1787367761.372633:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787367761.372640:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808411136:12345-0@lo:501: 00000100:00100000:2.0:1787367761.372734:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808411136:12345-0@lo:501: Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367761.372750:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787367761.372781:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411136:0@lo:501: 00000100:00100000:2.0:1787367761.372807:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411264:0@lo:503: 00000100:00100000:2.0:1787367761.372846:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.372859:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367761.372882:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808411264 00000100:00100000:2.0:1787367761.372885:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808411264 00000100:00100000:2.0:1787367761.372928:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787367761.372933:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808411264:12345-0@lo:503: 00000100:00100000:2.0:1787367761.373000:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808411264:12345-0@lo:503: Request processed in 66us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367761.373007:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787367761.373110:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411264:0@lo:503: 00000100:00100000:2.0:1787367761.373295:0:8917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8917:1874190808411392:0@lo:502: 40000000:02000000:2.0:1787367761.373394:0:6545:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000004:00080000:0.0:1787367761.375645:0:7470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787367761.375771:0:8917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367761.375816:0:8917:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367761.375868:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808411392 00000100:00100000:0.0:1787367761.375875:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808411392 00000100:00100000:0.0:1787367761.375922:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787367761.375932:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:8917:x1874190808411392:12345-0@lo:502: 00000100:00100000:0.0:1787367761.376066:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:8917:x1874190808411392:12345-0@lo:502: Request processed in 135us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367761.376074:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787367761.377687:0:8917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8917:1874190808411392:0@lo:502: 00000020:01000000:3.0:1787367761.377728:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787367761.377736:0:8917:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787367761.377742:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367761.377744:0:8917:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787367761.377750:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787367761.377753:0:8917:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:3.0:1787367761.377777:0:8917:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787367761.377780:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787367761.377795:0:8917:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c55bd6d8000) 00000020:00000080:3.0:1787367761.377817:0:8917:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1787367761.377824:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787367761.377917:0:8917:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787367761.377922:0:8917:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787367761.377929:0:8917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff030534 00010000:00080000:3.0:1787367761.377957:0:8917:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5481bcd800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1787367761.378171:0:8917:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:2.0:1787367761.388424:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8460:x1874190808410496:12345-0@lo:700: Request processed in 23409us (23519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367761.388449:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787367761.388814:0:8460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd688000 x1874190808410496/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367761.388829:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8460:1874190808410496:0@lo:700: 40000000:02000000:1.0:1787367761.388854:0:8460:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:3.0:1787367761.398009:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787367761.399465:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8913:x1874190808410240:12345-0@lo:700: Request processed in 34625us (36230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.399598:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787367761.399750:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd624380 x1874190808410240/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367761.399765:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8913:1874190808410240:0@lo:700: 00000040:01000000:0.0:1787367761.400138:0:8917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787367761.400154:0:8917:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787367761.400344:0:8917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367761.400825:0:8917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367761.400938:0:8917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787367761.401052:0:8917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787367761.401627:0:8919:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367761.401632:0:8919:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787367761.402270:0:8917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787367761.402281:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787367761.402316:0:8917:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787367761.402338:0:8917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff03053b 00000100:00080000:0.0:1787367761.402348:0:8917:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787367761.402415:0:8917:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c5481bcd800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787367761.402459:0:8917:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5482620380 x1874190808411520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787367761.402594:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808411520:0@lo:8: 00000100:00100000:2.0:1787367761.402667:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787367761.402809:0:8917:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787367761.402868:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367761.402873:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367761.402875:0:8917:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787367761.402878:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367761.402882:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367761.402884:0:8917:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787367761.402887:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787367761.402888:0:8917:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787367761.402912:0:8917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8917:1874190808411648:0@lo:502: 00000100:00100000:0.0:1787367761.402958:0:8917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367761.402976:0:8917:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367761.402995:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808411648 00000100:00100000:0.0:1787367761.403000:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808411648 00000100:00100000:0.0:1787367761.403049:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787367761.403058:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:8917:x1874190808411648:12345-0@lo:502: 00000100:00100000:0.0:1787367761.403161:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:8917:x1874190808411648:12345-0@lo:502: Request processed in 103us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367761.403169:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787367761.403230:0:8917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:8917:1874190808411648:0@lo:502: 00000020:01000000:0.0:1787367761.403251:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367761.403256:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367761.403257:0:8917:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787367761.403260:0:8917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1787367761.403463:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808411520 00000100:00100000:1.0:1787367761.403468:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808411520 00000100:00100000:1.0:1787367761.403574:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367761.403580:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874190808411520:12345-0@lo:8: 00010000:00080000:1.0:1787367761.403601:0:8454:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1787367761.403626:0:8454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff030542 00002000:00100000:1.0:1787367761.403641:0:8454:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c55b606f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787367761.403645:0:8454:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787367761.403648:0:8454:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787367761.403989:0:8454:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787367761.404024:0:8454:0:(import.c:65:import_set_state_nolock()) ffff9c55b606f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367761.404192:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1874190808411520:12345-0@lo:8: Request processed in 609us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.404199:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787367761.404258:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482620380 x1874190808411520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787367771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367761.404268:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787367761.404274:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787367761.404287:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787367761.404291:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787367761.404294:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5481bcd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787367761.404347:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787367761.404372:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808411520:0@lo:8: 00000020:01000000:2.0:1787367761.404395:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787367761.404418:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787367761.404427:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.404438:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367761.404448:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787367761.404451:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c55b8aab370 from 1 10000000:01000000:2.0:1787367761.404454:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000004:00080000:0.0:1787367761.404615:0:8919:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787367761.404667:0:8919:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 218692310967ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787367761.404673:0:8919:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1787367761.404755:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.404763:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.404771:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367761.404786:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411776:0@lo:101: 00000100:00100000:2.0:1787367761.404819:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.404851:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367761.405132:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808411776 00000100:00100000:0.0:1787367761.405137:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808411776 00000100:00100000:0.0:1787367761.405179:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787367761.405188:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808411776:12345-0@lo:101: 00010000:00010000:0.0:1787367761.405198:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367761.405210:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030549 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367761.405229:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030549 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367761.405239:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030549 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367761.405247:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ba00, rc 0) 00000100:00100000:0.0:1787367761.405279:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808411776:12345-0@lo:101: Request processed in 92us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367761.405285:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787367761.405378:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411776:0@lo:101: 00010000:00010000:2.0:1787367761.405399:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.405409:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367761.405459:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411904:0@lo:501: 00000100:00100000:2.0:1787367761.410185:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.410233:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803bc00 going to sleep for 11 seconds 00000004:00080000:2.0:1787367761.411290:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787367761.411580:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808411904 00000100:00100000:0.0:1787367761.411589:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808411904 00000100:00100000:0.0:1787367761.411673:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787367761.411693:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808411904:12345-0@lo:501: 00000100:00100000:0.0:1787367761.411835:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808411904:12345-0@lo:501: Request processed in 153us (1654us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787367761.411843:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787367761.411991:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808411904:0@lo:501: 10000000:01000000:2.0:1787367761.412036:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787367761.412046:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367761.412057:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787367761.418550:0:8913:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787367761.418587:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8913:1874190808412160:0@lo:7: 00000100:00100000:1.0:1787367761.418654:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.418695:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.418714:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808412032:0@lo:13: 00000100:00100000:1.0:1787367761.418740:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.418793:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808412160 00000100:00100000:1.0:1787367761.418799:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808412160 00000100:00100000:1.0:1787367761.418846:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367761.418855:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8913:x1874190808412160:12345-0@lo:7: 00000100:00100000:3.0:1787367761.422248:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808412032 00000100:00100000:3.0:1787367761.422262:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808412032 00000100:00100000:3.0:1787367761.422323:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367761.422333:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808412032:12345-0@lo:13: 00002000:00000024:3.0:1787367761.422379:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:3.0:1787367761.422467:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808412032:12345-0@lo:13: Request processed in 135us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367761.422474:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787367761.422540:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd624000 x1874190808412032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367761.422559:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808412032:0@lo:13: 00000004:00080000:0.0:1787367761.428094:0:8920:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787367761.428123:0:8920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8920:1874190808412416:0@lo:7: 00000100:00100000:3.0:1787367761.428238:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808412288:0@lo:13: 00000100:00100000:3.0:1787367761.428288:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367761.428335:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808412288 00000100:00100000:3.0:1787367761.428341:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808412288 00000100:00100000:3.0:1787367761.428409:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367761.428418:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808412288:12345-0@lo:13: 00002000:00000024:3.0:1787367761.428436:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:3.0:1787367761.428489:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808412288:12345-0@lo:13: Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367761.428495:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787367761.428517:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787367761.428544:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482623480 x1874190808412288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367761.428561:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808412288:0@lo:13: 00000100:00100000:0.0:1787367761.428705:0:8920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367761.428730:0:8920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367761.428874:0:8454:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787367761.428881:0:8454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787367761.430583:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808412416 00000100:00100000:2.0:1787367761.430594:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808412416 00000100:00100000:0.0:1787367761.430845:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787367761.430856:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8920:x1874190808412416:12345-0@lo:7: 00002000:00080000:1.0:1787367761.431409:0:8451:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787367761.431414:0:8451:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787367761.431494:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8913:x1874190808412160:12345-0@lo:7: Request processed in 12639us (12838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.431503:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787367761.431590:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd624e00 x1874190808412160/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367761.431605:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8913:1874190808412160:0@lo:7: 00000004:00080000:2.0:1787367761.431617:0:8913:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787367761.431654:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8913:1874190808412544:0@lo:5: 00000100:00100000:2.0:1787367761.431697:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367761.431726:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367761.431744:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808412544 00000100:00100000:2.0:1787367761.431749:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808412544 00000100:00100000:2.0:1787367761.431774:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367761.431781:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8913:x1874190808412544:12345-0@lo:5: 00002000:00080000:2.0:1787367761.431798:0:8454:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787367761.431836:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8913:x1874190808412544:12345-0@lo:5: Request processed in 55us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367761.431843:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787367761.433332:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd68b100 x1874190808412544/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367761.433349:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8913:1874190808412544:0@lo:5: 00000004:00080000:1.0:1787367761.433378:0:8913:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787367761.433420:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8913:1874190808412672:0@lo:5: 00000100:00100000:1.0:1787367761.433465:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.433488:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.433507:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808412672 00000100:00100000:1.0:1787367761.433512:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808412672 00000100:00100000:1.0:1787367761.433556:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367761.433564:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8913:x1874190808412672:12345-0@lo:5: 00002000:00080000:1.0:1787367761.433596:0:8454:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787367761.441777:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8913:x1874190808412672:12345-0@lo:5: Request processed in 8208us (8306us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787367761.441790:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787367761.441817:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd627100 x1874190808412672/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367761.441833:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8913:1874190808412672:0@lo:5: 00000004:00080000:3.0:1787367761.441845:0:8913:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787367761.441882:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8913:1874190808412800:0@lo:900: 00000100:00100000:3.0:1787367761.441920:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367761.441957:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6e7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.443506:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808412800 00000100:00100000:1.0:1787367761.443515:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808412800 00000100:00100000:1.0:1787367761.443561:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367761.443577:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8913:x1874190808412800:12345-0@lo:900: 00000100:00100000:1.0:1787367761.443656:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8913:x1874190808412800:12345-0@lo:900: Request processed in 80us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367761.443663:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787367761.443701:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5481bc3480 x1874190808412800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367761.443714:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8913:1874190808412800:0@lo:900: 00002000:00080000:0.0:1787367761.449981:0:8925:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787367761.449990:0:8925:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787367761.450095:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8920:x1874190808412416:12345-0@lo:7: Request processed in 19238us (21386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367761.450106:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787367761.450200:0:8920:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482623b80 x1874190808412416/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367761.450216:0:8920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8920:1874190808412416:0@lo:7: 00000004:00080000:1.0:1787367761.450229:0:8920:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787367761.450263:0:8920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8920:1874190808412928:0@lo:5: 00000100:00100000:1.0:1787367761.450316:0:8920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.450349:0:8920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367761.450384:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808412928 00000100:00100000:1.0:1787367761.450390:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808412928 00000100:00100000:1.0:1787367761.450428:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787367761.450436:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8920:x1874190808412928:12345-0@lo:5: 00002000:00080000:1.0:1787367761.450459:0:8453:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787367761.450463:0:8453:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1787367761.457414:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1787367761.457431:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787367761.457438:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787367761.458247:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8920:x1874190808412928:12345-0@lo:5: Request processed in 7806us (7926us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787367761.458259:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787367761.458288:0:8920:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd625880 x1874190808412928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367761.458301:0:8920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787367761.458316:0:8920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8920:1874190808412928:0@lo:5: 00000004:00080000:1.0:1787367761.458330:0:8920:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787367761.458393:0:8920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8920:1874190808413056:0@lo:700: 00000100:00100000:1.0:1787367761.458428:0:8920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.458461:0:8920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367761.458754:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808413056 00000100:00100000:2.0:1787367761.458760:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808413056 00000100:00100000:2.0:1787367761.458812:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367761.458822:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8920:x1874190808413056:12345-0@lo:700: 00000100:00100000:2.0:1787367761.470378:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8920:x1874190808413056:12345-0@lo:700: Request processed in 11524us (11914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367761.470393:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787367761.470413:0:8920:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd625880 x1874190808413056/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367761.470429:0:8920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8920:1874190808413056:0@lo:700: 00000004:02000040:1.0:1787367761.483756:0:8920:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1787367761.493872:0:8920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8920:1874190808413184:0@lo:5: 00000100:00100000:1.0:1787367761.493941:0:8920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367761.494128:0:8920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367761.495139:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808413184 00000100:00100000:3.0:1787367761.495149:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808413184 00000100:00100000:3.0:1787367761.495214:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787367761.495225:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8920:x1874190808413184:12345-0@lo:5: 00002000:00080000:3.0:1787367761.500692:0:8451:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787367761.500711:0:8451:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1787367761.502829:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8920:x1874190808413184:12345-0@lo:5: Request processed in 7599us (8881us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787367761.502842:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787367761.502916:0:8920:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd625880 x1874190808413184/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367777 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367761.502933:0:8920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8920:1874190808413184:0@lo:5: 00000004:00080000:0.0:1787367761.502948:0:8920:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:1.0:1787367761.518582:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1787367762.264585:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367762.841171:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367762.841192:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808413312:0@lo:41: 00000100:00100000:3.0:1787367762.841259:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367762.841383:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808413312 00000100:00100000:2.0:1787367762.841391:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808413312 00000100:00100000:2.0:1787367762.841957:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787367762.841970:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808413312:12345-0@lo:41: 00000004:00000024:2.0:1787367762.842003:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787367762.842079:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808413312:12345-0@lo:41: Request processed in 113us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367762.842086:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367762.842216:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808413312:0@lo:41: 00010000:00010000:2.0:1787367763.290484:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787367763.421118:0:8984:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787367763.421345:0:8984:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787367764.312565:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787367764.341445:0:9032:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787367764.341457:0:9032:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787367765.336560:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367765.919611:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808413440:0@lo:41: 00000100:00100000:2.0:1787367765.919692:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367765.920090:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808413440 00000100:00100000:1.0:1787367765.920099:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808413440 00000100:00100000:1.0:1787367765.920153:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787367765.920162:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808413440:12345-0@lo:41: 00000004:00000024:1.0:1787367765.920207:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787367765.920271:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808413440:12345-0@lo:41: Request processed in 109us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367765.920278:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367765.920456:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808413440:0@lo:41: 00010000:00010000:2.0:1787367766.360612:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367766.425537:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367766.425561:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808413568:0@lo:13: 00000100:00100000:3.0:1787367766.425618:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367766.425674:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808413568 00000100:00100000:3.0:1787367766.425689:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808413568 00000100:00100000:3.0:1787367766.425734:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367766.425742:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808413568:12345-0@lo:13: 00002000:00000024:3.0:1787367766.425769:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367766.425807:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808413568:12345-0@lo:13: Request processed in 66us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367766.425814:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787367766.425832:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787367766.425856:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5481bc1f80 x1874190808413568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367766.425866:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787367766.425884:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808413568:0@lo:13: 00000100:00100000:0.0:1787367766.429655:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808413824:0@lo:400: 00000100:00100000:0.0:1787367766.429714:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367766.429743:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808414336:0@lo:400: 00000100:00100000:0.0:1787367766.429771:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367766.429792:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787367766.429797:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808413696:0@lo:400: 00000100:00100000:0.0:1787367766.429821:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367766.429844:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808414208:0@lo:400: 00000100:00100000:0.0:1787367766.429863:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367766.429887:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808413824 00000100:00100000:0.0:1787367766.429893:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808413824 00000100:00100000:0.0:1787367766.429928:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808414336 00000100:00100000:0.0:1787367766.429931:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808414336 00000100:00100000:0.0:1787367766.429953:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808414208 00000100:00100000:0.0:1787367766.429955:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808414208 00000100:00100000:0.0:1787367766.429971:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787367766.429978:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808413824:12345-0@lo:400: 00000100:00100000:0.0:1787367766.430039:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808413824:12345-0@lo:400: Request processed in 61us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367766.430057:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787367766.430074:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787367766.430081:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808414336:12345-0@lo:400: 00000100:00100000:0.0:1787367766.430109:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808414336:12345-0@lo:400: Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367766.430115:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787367766.430126:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787367766.430132:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808414208:12345-0@lo:400: 00000100:00100000:0.0:1787367766.430158:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808414208:12345-0@lo:400: Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367766.430163:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787367766.430208:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482621500 x1874190808414208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367766.430221:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808414208:0@lo:400: 00010000:00080000:0.0:1787367766.430233:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482620000 x1874190808413824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367766.430240:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808413824:0@lo:400: 00010000:00080000:0.0:1787367766.430249:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482623100 x1874190808414336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367766.430256:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808414336:0@lo:400: 00000100:00100000:0.0:1787367766.430309:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808413952:0@lo:400: 00000100:00100000:0.0:1787367766.430333:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367766.430350:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808414464:0@lo:400: 00000100:00100000:0.0:1787367766.430400:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367766.430417:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367766.430423:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808414080:0@lo:400: 00000100:00100000:0.0:1787367766.430442:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367766.430587:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808414464 00000100:00100000:0.0:1787367766.430592:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808414464 00000100:00100000:0.0:1787367766.430619:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367766.430626:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808414464:12345-0@lo:400: 00000100:00100000:0.0:1787367766.430659:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808414464:12345-0@lo:400: Request processed in 34us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367766.430665:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367766.430680:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808414080 00000100:00100000:0.0:1787367766.430683:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808414080 00000100:00100000:0.0:1787367766.430711:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367766.430716:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808414080:12345-0@lo:400: 00000100:00100000:0.0:1787367766.430744:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808414080:12345-0@lo:400: Request processed in 28us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367766.430749:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367766.430772:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808414080:0@lo:400: 00010000:00080000:0.0:1787367766.430782:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482621f80 x1874190808414464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367766.430790:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787367766.430800:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808414464:0@lo:400: 00000100:00100000:0.0:1787367766.430813:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808413952 00000100:00100000:0.0:1787367766.430815:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808413952 00000100:00100000:0.0:1787367766.430833:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787367766.430838:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808413952:12345-0@lo:400: 00000100:00100000:0.0:1787367766.430863:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808413952:12345-0@lo:400: Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367766.430869:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787367766.430889:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482620e00 x1874190808413952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367766.430898:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808413952:0@lo:400: 00000100:00100000:0.0:1787367766.430924:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808413696 00000100:00100000:0.0:1787367766.430927:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808413696 00000100:00100000:0.0:1787367766.430957:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787367766.430963:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3652:x1874190808413696:12345-0@lo:400: 00000100:00100000:0.0:1787367766.431006:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3652:x1874190808413696:12345-0@lo:400: Request processed in 43us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367766.431017:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787367766.431063:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808413696:0@lo:400: 00000100:00080000:2.0:1787367766.432416:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367766.432424:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367766.432427:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367766.937713:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808414592:0@lo:13: 00000100:00100000:2.0:1787367766.937784:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367766.937958:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808414592 00000100:00100000:3.0:1787367766.937965:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808414592 00000100:00100000:3.0:1787367766.938025:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367766.938035:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808414592:12345-0@lo:13: 00002000:00000024:3.0:1787367766.938057:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367766.938103:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808414592:12345-0@lo:13: Request processed in 70us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367766.938110:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787367766.938256:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482621180 x1874190808414592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367766.938275:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808414592:0@lo:13: 00010000:00010000:0.0:1787367767.385491:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367767.961170:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367767.961195:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808414720:0@lo:41: 00000100:00100000:0.0:1787367767.961262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367767.961440:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808414720 00000100:00100000:2.0:1787367767.961447:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808414720 00000100:00100000:2.0:1787367767.961497:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787367767.961507:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808414720:12345-0@lo:41: 00000004:00000024:2.0:1787367767.961538:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787367767.961584:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808414720:12345-0@lo:41: Request processed in 78us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367767.961591:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367767.962809:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808414720:0@lo:41: 00010000:00010000:2.0:1787367768.408541:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367769.434871:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367770.457003:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367771.035610:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808414848:0@lo:41: 00000100:00100000:0.0:1787367771.035680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367771.035809:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808414848 00000100:00100000:1.0:1787367771.035817:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808414848 00000100:00100000:1.0:1787367771.035867:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787367771.035889:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808414848:12345-0@lo:41: 00000004:00000024:1.0:1787367771.035920:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787367771.035983:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808414848:12345-0@lo:41: Request processed in 95us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367771.035989:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787367771.036028:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808414848:0@lo:41: 00010000:00010000:2.0:1787367771.480584:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367771.545606:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808415104:0@lo:400: 00000100:00100000:0.0:1787367771.545673:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367771.545731:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808415616:0@lo:400: 00000100:00100000:0.0:1787367771.545755:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367771.545779:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787367771.545785:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808414976:0@lo:400: 00000100:00100000:1.0:1787367771.545791:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808415104 00000100:00100000:1.0:1787367771.545798:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808415104 00000100:00100000:0.0:1787367771.545812:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367771.545831:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808415488:0@lo:400: 00000100:00100000:1.0:1787367771.545835:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808415616 00000100:00100000:1.0:1787367771.545838:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808415616 00000100:00100000:1.0:1787367771.545864:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787367771.545871:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367771.545872:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808415104:12345-0@lo:400: 00000100:00100000:0.0:1787367771.545893:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808415232:0@lo:400: 00000100:00100000:0.0:1787367771.545921:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367771.545922:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808415104:12345-0@lo:400: Request processed in 51us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367771.545929:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787367771.545931:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808415744:0@lo:400: 00000100:00100000:1.0:1787367771.545943:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808415488 00000100:00100000:1.0:1787367771.545945:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808415488 00000100:00100000:0.0:1787367771.545964:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367771.545973:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808415232 00000100:00100000:1.0:1787367771.545975:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808415232 00000100:00100000:0.0:1787367771.545983:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787367771.545987:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787367771.545988:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808415360:0@lo:400: 00000100:00100000:1.0:1787367771.546003:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808415616:12345-0@lo:400: 00000100:00100000:0.0:1787367771.546009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367771.546027:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808415872:0@lo:400: 00000100:00100000:1.0:1787367771.546030:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808415616:12345-0@lo:400: Request processed in 38us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367771.546035:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787367771.546046:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787367771.546046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367771.546051:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808415488:12345-0@lo:400: 00000100:00100000:0.0:1787367771.546072:0:6538:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787367771.546075:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808415488:12345-0@lo:400: Request processed in 24us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367771.546078:0:6538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787367771.546086:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787367771.546094:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808414976 00000100:00100000:1.0:1787367771.546096:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787367771.546097:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808414976 00000100:00100000:1.0:1787367771.546101:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808415232:12345-0@lo:400: 00000100:00100000:0.0:1787367771.546121:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787367771.546127:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3654:x1874190808414976:12345-0@lo:400: 00000100:00100000:1.0:1787367771.546129:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808415232:12345-0@lo:400: Request processed in 29us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367771.546134:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787367771.546148:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367771.546152:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367771.546152:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3654:x1874190808414976:12345-0@lo:400: Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367771.546158:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787367771.546174:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808415744 00000100:00100000:1.0:1787367771.546177:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808415744 00000100:00100000:0.0:1787367771.546187:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808415360 00000100:00100000:0.0:1787367771.546190:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808415360 00000100:00100000:1.0:1787367771.546202:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808415872 00000100:00100000:1.0:1787367771.546204:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808415872 00000100:00100000:0.0:1787367771.546208:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787367771.546213:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808415360:12345-0@lo:400: 00000100:00100000:1.0:1787367771.546221:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367771.546226:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808415744:12345-0@lo:400: 00000100:00100000:0.0:1787367771.546243:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808415360:12345-0@lo:400: Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367771.546249:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808415744:12345-0@lo:400: Request processed in 24us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367771.546249:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787367771.546255:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367771.546263:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367771.546268:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808415872:12345-0@lo:400: 00000100:00100000:1.0:1787367771.546294:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808415872:12345-0@lo:400: Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367771.546299:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787367771.546321:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367771.547474:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808416000:0@lo:13: 00000100:00100000:2.0:1787367771.547531:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367771.547802:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808416000 00000100:00100000:3.0:1787367771.547809:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808416000 00000100:00100000:3.0:1787367771.547862:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787367771.547871:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808416000:12345-0@lo:13: 00002000:00000024:3.0:1787367771.547896:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367771.547958:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808416000:12345-0@lo:13: Request processed in 78us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367771.547979:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367771.548205:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808415360:0@lo:400: 00010000:00080000:0.0:1787367771.548222:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55912f3480 x1874190808415872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367771.548245:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808415872:0@lo:400: 00010000:00080000:0.0:1787367771.548260:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482623800 x1874190808415232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367771.548267:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808415232:0@lo:400: 00010000:00080000:0.0:1787367771.548277:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55912f0380 x1874190808415744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367771.548827:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808415744:0@lo:400: 00000100:00100000:0.0:1787367771.548885:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808414976:0@lo:400: 00010000:00080000:0.0:1787367771.548899:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482620700 x1874190808415488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367771.548908:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808415488:0@lo:400: 00010000:00080000:0.0:1787367771.548919:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482622680 x1874190808415104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367771.548926:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808415104:0@lo:400: 00010000:00080000:0.0:1787367771.548936:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482621880 x1874190808415616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367771.548942:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808415616:0@lo:400: 00010000:00080000:1.0:1787367771.550175:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd627800 x1874190808416000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367771.550197:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808416000:0@lo:13: 00000100:00100000:3.0:1787367772.056527:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367772.056555:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808416128:0@lo:13: 00000100:00100000:3.0:1787367772.056619:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367772.056771:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808416128 00000100:00100000:0.0:1787367772.056779:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808416128 00000100:00100000:0.0:1787367772.056830:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367772.056840:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808416128:12345-0@lo:13: 00002000:00000024:0.0:1787367772.056862:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367772.056925:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808416128:12345-0@lo:13: Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367772.056932:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787367772.057099:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482073800 x1874190808416128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367772.057117:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808416128:0@lo:13: 00010000:00010000:1.0:1787367772.505278:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367773.081932:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367773.081965:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808416256:0@lo:41: 00000100:00100000:2.0:1787367773.082037:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.082104:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808416256 00000100:00100000:2.0:1787367773.082111:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808416256 00000100:00100000:2.0:1787367773.082154:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787367773.082163:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808416256:12345-0@lo:41: 00000004:00000024:2.0:1787367773.082198:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787367773.082240:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808416256:12345-0@lo:41: Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367773.082248:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787367773.082289:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808416256:0@lo:41: 00000020:01000004:2.0:1787367773.193394:0:9532:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787367773.193399:0:9532:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787367773.193400:0:9532:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787367773.193532:0:9532:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c55bc4cb000 00000020:01000004:2.0:1787367773.193547:0:9532:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787367773.193560:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787367773.193581:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c5482770000) 00000020:00000080:2.0:1787367773.193603:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787367773.241310:0:9532:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787367773.241394:0:9532:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1787367773.251997:0:9532:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787367773.252486:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787367773.252499:0:9532:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787367773.252512:0:9532:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x66f5679bff03055e 00000020:01000004:3.0:1787367773.252518:0:9532:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787367773.252538:0:9532:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787367773.252542:0:9532:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787367773.252547:0:9532:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787367773.252573:0:9532:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787367773.252577:0:9532:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787367773.267668:0:9532:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787367773.267698:0:9532:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787367773.267701:0:9532:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787367773.267702:0:9532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367773.267703:0:9532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367773.267704:0:9532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367773.267705:0:9532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367773.267706:0:9532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367773.267706:0:9532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367773.267707:0:9532:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367773.267708:0:9532:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367773.267712:0:9532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367773.267712:0:9532:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787367773.267715:0:9532:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787367773.267717:0:9532:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787367773.267718:0:9532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367773.267718:0:9532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367773.267719:0:9532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367773.267719:0:9532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367773.267720:0:9532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367773.267721:0:9532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367773.267721:0:9532:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367773.267722:0:9532:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367773.267722:0:9532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367773.267723:0:9532:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787367773.267752:0:9532:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787367773.267766:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808416384:0@lo:253: 00000100:00100000:3.0:1787367773.267827:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.267891:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808416384 00000100:00100000:0.0:1787367773.267897:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808416384 00000100:00100000:3.0:1787367773.267922:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077000 going to sleep for 11 seconds 00000100:00100000:0.0:1787367773.268065:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787367773.268073:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:9532:x1874190808416384:12345-0@lo:253: 20000000:01000000:0.0:1787367773.268104:0:6532:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787367773.268108:0:6532:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787367773.268111:0:6532:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787367773.268114:0:6532:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787367773.268305:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367773.268480:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1787367773.268499:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787367773.268524:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1787367773.268529:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787367773.268541:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1787367773.268556:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1787367773.268619:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1787367773.268630:0:6532:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1787367773.268631:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1787367773.268649:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1787367773.268654:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787367773.268661:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1787367773.268664:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1787367773.268670:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1787367773.268674:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787367773.268681:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1787367773.268688:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1787367773.268735:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1787367773.268742:0:6532:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1787367773.268747:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1787367773.268757:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1787367773.268760:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787367773.268767:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1787367773.268769:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1787367773.268775:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1787367773.268779:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787367773.268785:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1787367773.268797:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1787367773.269352:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1787367773.269400:0:6532:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1787367773.269401:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1787367773.269415:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1787367773.269419:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787367773.269429:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1787367773.269433:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1787367773.269443:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1787367773.269447:0:6532:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787367773.269457:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1787367773.269481:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1787367773.269493:0:6532:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787367773.269496:0:6532:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787367773.269499:0:6532:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787367773.269538:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787367773.269540:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787367773.271071:0:9538:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787367773.271171:0:9538:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787367773.271189:0:9538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1787367773.271874:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1787367773.271900:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1787367773.271918:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1787367773.271931:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787367773.271934:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787367773.272767:0:9539:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1787367773.272806:0:9539:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1787367773.272823:0:9539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1787367773.273012:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1787367773.273036:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1787367773.273063:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1787367773.273074:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787367773.273076:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787367773.277648:0:9540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1787367773.280821:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1787367773.280855:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1787367773.280870:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1787367773.280881:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787367773.280884:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787367773.282634:0:9541:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1787367773.282696:0:9541:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1787367773.282710:0:9541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787367773.283031:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787367773.283054:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1787367773.283067:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1787367773.283076:0:6532:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787367773.283078:0:6532:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787367773.283337:0:9542:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1787367773.283538:0:9542:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1787367773.283561:0:9542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1787367773.283800:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1787367773.283822:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1787367773.283835:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:1.0:1787367773.283847:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787367773.283868:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.283883:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030454 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.283890:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03047e expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.283897:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0304bd expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.283904:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0304d9 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.283911:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0304fc expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.283931:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03051f expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.283959:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030549 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.283966:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.284003:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030549 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.284016:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030549 expref: 21 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.284030:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808416512:0@lo:104: 00000100:00100000:1.0:1787367773.284094:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367773.284181:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03051f expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.284190:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03051f expref: 21 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.284199:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808416640:0@lo:104: 00000100:00100000:1.0:1787367773.284222:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.288003:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808416512 00000100:00100000:2.0:1787367773.288018:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808416512 00010000:00010000:1.0:1787367773.288074:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0304fc expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.288089:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0304fc expref: 21 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.288218:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808416768:0@lo:104: 00000100:00100000:1.0:1787367773.288266:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367773.289175:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0304d9 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.289188:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0304d9 expref: 21 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.289198:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808416896:0@lo:104: 00000100:00100000:1.0:1787367773.289230:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.289517:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808416640 00000100:00100000:2.0:1787367773.289518:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808416768 00000100:00100000:2.0:1787367773.289526:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808416768 00000100:00100000:0.0:1787367773.289526:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808416640 00000100:00100000:2.0:1787367773.289567:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787367773.289579:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6532:x1874190808416512:12345-0@lo:104: 00010000:00010000:2.0:1787367773.289592:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.289657:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367773.289664:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6532:x1874190808416512:12345-0@lo:104: Request processed in 88us (5569us total) trans 0 rc 0/0 00010000:00010000:1.0:1787367773.289667:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0304bd expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.289675:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787367773.289704:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808416896 00000100:00100000:2.0:1787367773.289708:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808416896 00010000:00010000:3.0:1787367773.289879:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367773.289887:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.289896:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174a00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367773.289900:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.289919:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367773.289926:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367773.289932:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367773.289973:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.289980:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367773.290006:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.290014:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030550 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.290028:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367773.290029:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367773.290031:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367773.290076:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0304bd expref: 21 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.290086:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808417024:0@lo:104: 00000100:00100000:1.0:1787367773.290098:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367773.290108:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808417152:0@lo:103: 00000100:00100000:1.0:1787367773.290149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367773.290210:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.290252:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808417152 00000100:00100000:3.0:1787367773.290256:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808417152 00010000:00010000:3.0:1787367773.290277:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030549 expref: 22 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367773.290300:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367773.290307:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3651:x1874190808417152:12345-0@lo:103: 00010000:00010000:3.0:1787367773.290316:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367773.290321:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030549 expref: 22 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.290336:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030549 expref: 22 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.290377:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367773.290413:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3651:x1874190808417152:12345-0@lo:103: Request processed in 107us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367773.290421:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787367773.290611:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808417152:0@lo:103: 00010000:00010000:1.0:1787367773.290649:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03047e expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.290657:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03047e expref: 21 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.290887:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808417280:0@lo:104: 00000100:00100000:1.0:1787367773.290915:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367773.290933:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030454 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.290952:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030454 expref: 21 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.290960:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808417408:0@lo:104: 00000100:00100000:1.0:1787367773.290977:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54810ebd80 going to sleep for 11 seconds 00010000:00010000:1.0:1787367773.290992:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68ba00/0x66f5679bff030550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030549 expref: 21 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.291002:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808416512:0@lo:104: 00000100:00100000:0.0:1787367773.291105:0:6521:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787367773.291124:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.291134:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808417024 00000100:00100000:0.0:1787367773.291138:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808417024 00000100:00100000:0.0:1787367773.291158:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808417280 00000100:00100000:0.0:1787367773.291160:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808417280 00000100:00100000:0.0:1787367773.291168:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808417408 00000100:00100000:0.0:1787367773.291170:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808417408 00000100:00100000:0.0:1787367773.291181:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787367773.291188:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+8:6532:x1874190808416768:12345-0@lo:104: 00010000:00010000:0.0:1787367773.291197:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.291379:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787367773.291385:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+8:6532:x1874190808416768:12345-0@lo:104: Request processed in 198us (3119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.291392:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787367773.291407:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787367773.291414:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+7:6532:x1874190808416640:12345-0@lo:104: 00010000:00010000:0.0:1787367773.291421:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.291457:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787367773.291462:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+7:6532:x1874190808416640:12345-0@lo:104: Request processed in 51us (7241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.291475:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787367773.291489:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787367773.291495:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:6532:x1874190808416896:12345-0@lo:104: 00010000:00010000:0.0:1787367773.291502:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.291537:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787367773.291542:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:6532:x1874190808416896:12345-0@lo:104: Request processed in 48us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.291548:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787367773.291561:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787367773.291566:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6532:x1874190808417024:12345-0@lo:104: 00010000:00010000:0.0:1787367773.291573:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.291599:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787367773.291603:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:6532:x1874190808417024:12345-0@lo:104: Request processed in 38us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.291610:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787367773.291620:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367773.291626:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be765850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6532:x1874190808417280:12345-0@lo:104: 00010000:00010000:0.0:1787367773.291634:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.291827:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787367773.291834:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.291841:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672c00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367773.291844:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.291852:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367773.291858:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367773.291863:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367773.291889:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.291895:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367773.291909:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.291915:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5581672c00/0x66f5679bff0304fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030503 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.291933:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787367773.291946:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.291951:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367773.291954:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.291960:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367773.291966:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367773.291971:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367773.291985:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.291991:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367773.291996:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292002:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff03051f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030526 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292011:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367773.292014:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292028:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0400 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367773.292031:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292037:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367773.292042:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367773.292047:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367773.292060:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292065:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367773.292083:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292089:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff0304d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0304e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292098:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367773.292101:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292106:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367773.292109:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292125:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367773.292131:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367773.292137:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367773.292150:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292156:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367773.292161:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292166:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a000/0x66f5679bff0304bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0304c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292175:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367773.292176:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367773.292178:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367773.292190:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808417536:0@lo:103: 00000100:00100000:3.0:1787367773.292220:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.292251:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367773.292256:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808417664:0@lo:103: 00000100:00100000:3.0:1787367773.292275:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.292298:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808417536 00000100:00100000:3.0:1787367773.292302:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808417536 00010000:00010000:3.0:1787367773.292323:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0304fc expref: 21 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367773.292370:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808417664 00000100:00100000:3.0:1787367773.292373:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808417664 00010000:00010000:3.0:1787367773.292386:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03051f expref: 22 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367773.292401:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367773.292407:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3653:x1874190808417536:12345-0@lo:103: 00010000:00010000:3.0:1787367773.292416:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367773.292421:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0304fc expref: 22 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292429:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0304fc expref: 22 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292443:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367773.292471:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3653:x1874190808417536:12345-0@lo:103: Request processed in 64us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367773.292477:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367773.292490:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367773.292496:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3653:x1874190808417664:12345-0@lo:103: 00010000:00010000:3.0:1787367773.292513:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367773.292518:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03051f expref: 21 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292527:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03051f expref: 21 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.292535:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367773.292559:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3653:x1874190808417664:12345-0@lo:103: Request processed in 64us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367773.292565:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367773.292594:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808417664:0@lo:103: 00000100:00100000:3.0:1787367773.292602:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808417536:0@lo:103: 00010000:00010000:2.0:1787367773.292690:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367773.292707:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808417920:0@lo:103: 00000100:00100000:2.0:1787367773.292745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.292771:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367773.292777:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808417792:0@lo:103: 00000100:00100000:2.0:1787367773.292796:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.292816:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808417920 00000100:00100000:2.0:1787367773.292819:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808417920 00010000:00010000:2.0:1787367773.292834:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0304bd expref: 21 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.292849:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808417792 00000100:00100000:2.0:1787367773.292851:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808417792 00010000:00010000:2.0:1787367773.292863:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0304d9 expref: 22 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.292875:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787367773.292882:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3652:x1874190808417920:12345-0@lo:103: 00010000:00010000:2.0:1787367773.292889:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367773.292893:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0304bd expref: 22 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.292902:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0304bd expref: 22 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.292912:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367773.292951:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3652:x1874190808417920:12345-0@lo:103: Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367773.292966:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787367773.293003:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787367773.293009:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3652:x1874190808417792:12345-0@lo:103: 00010000:00010000:2.0:1787367773.293016:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367773.293020:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0304d9 expref: 21 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.293028:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0304d9 expref: 21 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.293037:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367773.293058:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3652:x1874190808417792:12345-0@lo:103: Request processed in 49us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367773.293064:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787367773.293087:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808417792:0@lo:103: 00000100:00100000:2.0:1787367773.293094:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808417920:0@lo:103: 00010000:00010000:0.0:1787367773.293387:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787367773.293394:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be765850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:6532:x1874190808417280:12345-0@lo:104: Request processed in 1769us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.293407:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367773.293441:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787367773.293449:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6532:x1874190808417408:12345-0@lo:104: 00010000:00010000:0.0:1787367773.293457:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293497:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787367773.293502:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6532:x1874190808417408:12345-0@lo:104: Request processed in 56us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.293508:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787367773.293527:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367773.293532:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293538:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0200 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367773.293541:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293548:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367773.293554:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367773.293559:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367773.293578:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293583:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367773.293600:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293607:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03047e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030485 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293618:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367773.293621:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293626:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367773.293629:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293635:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367773.293642:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367773.293647:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367773.293659:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293665:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367773.293669:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293688:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03045b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.293700:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367773.293707:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367773.293709:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367773.293809:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367773.293901:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808418176:0@lo:103: 00000100:00100000:0.0:1787367773.293928:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.293969:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367773.293975:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808418048:0@lo:103: 00000100:00100000:0.0:1787367773.293995:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.294020:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808418176 00000100:00100000:0.0:1787367773.294024:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808418176 00010000:00010000:0.0:1787367773.294041:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030454 expref: 21 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367773.294059:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808418048 00000100:00100000:0.0:1787367773.294062:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808418048 00010000:00010000:0.0:1787367773.294073:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03047e expref: 22 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367773.294088:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367773.294093:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3654:x1874190808418176:12345-0@lo:103: 00010000:00010000:0.0:1787367773.294101:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367773.294104:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030454 expref: 22 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294111:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030454 expref: 22 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294122:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367773.294146:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3654:x1874190808418176:12345-0@lo:103: Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.294152:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367773.294172:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787367773.294177:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3654:x1874190808418048:12345-0@lo:103: 00010000:00010000:0.0:1787367773.294184:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367773.294187:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03047e expref: 21 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294196:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03047e expref: 21 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294206:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294214:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294226:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294232:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294238:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294243:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294248:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787367773.294252:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294258:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294272:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.294281:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367773.294302:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3654:x1874190808418048:12345-0@lo:103: Request processed in 125us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.294307:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787367773.294333:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808418048:0@lo:103: 00000100:00100000:0.0:1787367773.294340:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808418176:0@lo:103: 00010000:00010000:2.0:1787367773.294568:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367773.294871:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673800/0x66f5679bff030503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0304fc expref: 20 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.294883:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808416768:0@lo:104: 00010000:00010000:1.0:1787367773.294902:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672800/0x66f5679bff0304e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0304d9 expref: 19 pid: 6533 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.294912:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808416896:0@lo:104: 00010000:00010000:1.0:1787367773.294923:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0304c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0304bd expref: 18 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.294932:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808417024:0@lo:104: 00010000:00010000:1.0:1787367773.294953:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68b400/0x66f5679bff030485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03047e expref: 17 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.294970:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808417280:0@lo:104: 00010000:00010000:1.0:1787367773.294982:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2175800/0x66f5679bff03045b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030454 expref: 16 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.294990:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808417408:0@lo:104: 00010000:00010000:1.0:1787367773.295001:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2174800/0x66f5679bff030526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03051f expref: 15 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.295009:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6532:1874190808416640:0@lo:104: 00010000:00010000:1.0:1787367773.295036:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.295045:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.295050:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.295055:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672200/0x66f5679bff030565 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787367773.295067:0:6532:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787367773.297911:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:9532:x1874190808416384:12345-0@lo:253: Request processed in 29830us (30075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.297924:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787367773.299522:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808416384:0@lo:253: 10000000:01000000:3.0:1787367773.299541:0:9532:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787367773.299544:0:9532:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787367773.299546:0:9532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367773.299547:0:9532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367773.299549:0:9532:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787367773.299550:0:9532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367773.299551:0:9532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367773.299552:0:9532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367773.299554:0:9532:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787367773.299555:0:9532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367773.299557:0:9532:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787367773.299577:0:9532:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c55bc4cb000 from lustre-OST0001 10000000:01000000:3.0:1787367773.299606:0:9532:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787367773.299609:0:9532:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787367773.299618:0:9532:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c55b8aab370 local copy 10000000:01000000:3.0:1787367773.299622:0:9532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787367773.299656:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.299667:0:9532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.299687:0:9532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367773.299732:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418304:0@lo:101: 00000100:00100000:3.0:1787367773.299782:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.299827:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077000 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.299952:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808418304 00000100:00100000:1.0:1787367773.299959:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808418304 00000100:00100000:1.0:1787367773.300006:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787367773.300021:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:9532:x1874190808418304:12345-0@lo:101: 00010000:00010000:1.0:1787367773.300035:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367773.300047:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673e00/0x66f5679bff030573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03056c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.300067:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673e00/0x66f5679bff030573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03056c expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.300077:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673e00/0x66f5679bff030573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03056c expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.300085:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673e00, rc 0) 00000100:00100000:1.0:1787367773.300127:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808418304:12345-0@lo:101: Request processed in 107us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.300134:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787367773.300237:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418304:0@lo:101: 00010000:00010000:3.0:1787367773.300248:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.300255:0:9532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367773.300335:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418432:0@lo:501: 00000100:00100000:3.0:1787367773.300557:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.300578:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077000 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.300646:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808418432 00000100:00100000:1.0:1787367773.300651:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808418432 00000100:00100000:1.0:1787367773.300690:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787367773.300697:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808418432:12345-0@lo:501: 00000100:00100000:1.0:1787367773.300825:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808418432:12345-0@lo:501: Request processed in 127us (268us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367773.300832:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787367773.300948:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418432:0@lo:501: 10000000:01000000:3.0:1787367773.300959:0:9532:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787367773.300974:0:9532:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787367773.300979:0:9532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.300986:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.300993:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.301016:0:9532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787367773.301045:0:9532:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c55bc4cb000 10000000:01000000:3.0:1787367773.301051:0:9532:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787367773.301056:0:9532:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787367773.301058:0:9532:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787367773.301062:0:9532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787367773.301064:0:9532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787367773.301080:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.301087:0:9532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.301094:0:9532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367773.301106:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418560:0@lo:101: 00000100:00100000:3.0:1787367773.301133:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.301195:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb540 going to sleep for 11 seconds 00010000:00010000:0.0:1787367773.301203:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367773.301212:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.301232:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174a00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367773.301236:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.301244:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367773.301252:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367773.301258:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367773.301276:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.301283:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787367773.301588:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808418688:0@lo:103: 00000100:00100000:1.0:1787367773.301619:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787367773.301685:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.301695:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff03056c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x66f5679bff030573 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.301707:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367773.301709:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367773.301711:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367773.303144:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808418688 00000100:00100000:3.0:1787367773.303155:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808418688 00000100:00100000:3.0:1787367773.303220:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367773.303229:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:3651:x1874190808418688:12345-0@lo:103: 00010000:00010000:3.0:1787367773.303242:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367773.303259:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673e00/0x66f5679bff030573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff03056c expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.303276:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367773.303321:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:3651:x1874190808418688:12345-0@lo:103: Request processed in 93us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367773.303328:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367773.303578:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808418560 00000100:00100000:2.0:1787367773.303583:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808418560 00000100:00100000:2.0:1787367773.303631:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787367773.303642:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+14:9532:x1874190808418560:12345-0@lo:101: 00010000:00010000:2.0:1787367773.303654:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367773.303669:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03057a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.304019:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03057a expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.304037:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03057a expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.304044:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82000, rc 0) 00000100:00100000:2.0:1787367773.304095:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808418560:12345-0@lo:101: Request processed in 457us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367773.304102:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787367773.304274:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418560:0@lo:101: 00010000:00010000:3.0:1787367773.304288:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.304298:0:9532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367773.304419:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418816:0@lo:501: 00000100:00100000:3.0:1787367773.304453:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.304479:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.304543:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808418688:0@lo:103: 00000100:00100000:0.0:1787367773.304644:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808418816 00000100:00100000:0.0:1787367773.304649:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808418816 00000100:00100000:0.0:1787367773.304687:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787367773.304695:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808418816:12345-0@lo:501: 00000100:00100000:0.0:1787367773.304803:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808418816:12345-0@lo:501: Request processed in 100us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.304811:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787367773.304960:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418816:0@lo:501: 00000100:00100000:1.0:1787367773.304989:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418944:0@lo:503: 00000100:00100000:1.0:1787367773.305034:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367773.305057:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787367773.305161:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808418944 00000100:00100000:0.0:1787367773.305165:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808418944 00000100:00100000:0.0:1787367773.305194:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787367773.305200:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808418944:12345-0@lo:503: 00000100:00100000:0.0:1787367773.305288:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808418944:12345-0@lo:503: Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.305294:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787367773.305408:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808418944:0@lo:503: 00000040:00080000:3.0:1787367773.305648:0:9532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787367773.305874:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419072:0@lo:502: 00000100:00100000:3.0:1787367773.305911:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.305950:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb300 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.305978:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808419072 00000100:00100000:1.0:1787367773.305983:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808419072 00000100:00100000:1.0:1787367773.306017:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787367773.306024:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808419072:12345-0@lo:502: 00000100:00100000:1.0:1787367773.306101:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808419072:12345-0@lo:502: Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.306107:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787367773.306182:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419072:0@lo:502: 00000040:00080000:3.0:1787367773.306351:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787367773.306417:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787367773.306435:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787367773.306450:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787367773.306465:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787367773.306479:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787367773.306500:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419200:0@lo:502: 00000100:00100000:3.0:1787367773.306532:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.306559:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367773.306602:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808419200 00000100:00100000:0.0:1787367773.306606:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808419200 00000100:00100000:0.0:1787367773.306636:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787367773.306642:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808419200:12345-0@lo:502: 00000100:00100000:3.0:1787367773.306932:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419200:0@lo:502: 00000040:00080000:3.0:1787367773.306979:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787367773.306992:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:0.0:1787367773.307170:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808419200:12345-0@lo:502: Request processed in 527us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.307182:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000020:01000000:0.0:1787367773.313150:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787367773.313162:0:9543:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787367773.313168:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367773.313171:0:9543:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787367773.313177:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787367773.313193:0:9543:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c55b5543370) 00000020:00000080:0.0:1787367773.313220:0:9543:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787367773.313227:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787367773.313308:0:9543:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55bc4cb000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787367773.313317:0:9543:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787367773.313324:0:9543:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x66f5679bff03058f 00010000:00010000:1.0:1787367773.326322:0:9543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1787367773.327544:0:9543:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787367773.333867:0:9543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787367773.334956:0:9543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787367773.341042:0:9543:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787367773.341299:0:9543:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787367773.356560:0:9543:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787367773.365104:0:9543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787367773.365117:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367773.365124:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367773.365126:0:9543:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787367773.365129:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367773.365133:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367773.365135:0:9543:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787367773.365138:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787367773.365140:0:9543:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787367773.365247:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367773.365316:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367773.365319:0:9543:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787367773.365324:0:9543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787367773.369184:0:9532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787367773.369219:0:9532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787367773.369241:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.369253:0:9532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367773.369452:0:9532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bc4cb000 from 1 10000000:01000000:2.0:1787367773.369457:0:9532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787367773.369492:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.369501:0:9532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.369510:0:9532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.369532:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419328:0@lo:101: 00000100:00100000:2.0:1787367773.370867:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.371776:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf540 going to sleep for 11 seconds 00000100:00100000:0.0:1787367773.372596:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808419328 00000100:00100000:0.0:1787367773.372605:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808419328 00000100:00100000:0.0:1787367773.372658:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787367773.372667:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808419328:12345-0@lo:101: 00010000:00010000:0.0:1787367773.372682:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367773.372706:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030596 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.372732:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030596 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.372744:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030596 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367773.372753:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b800, rc 0) 00000100:00100000:0.0:1787367773.372856:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419328:12345-0@lo:101: Request processed in 189us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.372864:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787367773.373621:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419328:0@lo:101: 00010000:00010000:2.0:1787367773.373642:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.373653:0:9532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.373762:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419456:0@lo:501: 00000100:00100000:2.0:1787367773.373799:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.373843:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf540 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.373848:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808419456 00000100:00100000:1.0:1787367773.373855:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808419456 00000100:00100000:1.0:1787367773.373900:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787367773.373910:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419456:12345-0@lo:501: 00000100:00100000:1.0:1787367773.374040:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419456:12345-0@lo:501: Request processed in 132us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.374055:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787367773.374059:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419456:0@lo:501: 00000100:00100000:0.0:1787367773.374092:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482073480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419584:0@lo:503: 00000100:00100000:0.0:1787367773.374139:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.374176:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077000 going to sleep for 11 seconds 00000100:00100000:2.0:1787367773.374188:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808419584 00000100:00100000:2.0:1787367773.374194:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808419584 00000100:00100000:1.0:1787367773.374240:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787367773.374318:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419584:12345-0@lo:503: 00000100:00100000:1.0:1787367773.374445:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419584:12345-0@lo:503: Request processed in 197us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.374452:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787367773.374487:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482073480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419584:0@lo:503: 00000040:00080000:2.0:1787367773.374766:0:9532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367773.374828:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419712:0@lo:502: 00000100:00100000:2.0:1787367773.374861:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.374891:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.374952:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808419712 00000100:00100000:1.0:1787367773.374956:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808419712 00000100:00100000:1.0:1787367773.374985:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787367773.374991:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419712:12345-0@lo:502: 00000100:00100000:1.0:1787367773.375078:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419712:12345-0@lo:502: Request processed in 87us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.375085:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787367773.375212:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419712:0@lo:502: 00000040:00080000:2.0:1787367773.375458:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787367773.375484:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787367773.375505:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419840:0@lo:502: 00000100:00100000:2.0:1787367773.375537:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.375559:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367773.375599:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808419840 00000100:00100000:0.0:1787367773.375604:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808419840 00000100:00100000:0.0:1787367773.375633:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787367773.375640:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419840:12345-0@lo:502: 00000100:00100000:0.0:1787367773.375722:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419840:12345-0@lo:502: Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.375729:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787367773.375810:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419840:0@lo:502: 00000040:00080000:2.0:1787367773.375850:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787367773.375858:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787367773.381428:0:9547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367773.381441:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367773.381444:0:9547:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787367773.381452:0:9547:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55bc4cb000 00000020:00000080:0.0:1787367773.381455:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787367773.381482:0:9547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367773.381485:0:9547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367773.381486:0:9547:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787367773.381490:0:9547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787367773.381680:0:9532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787367773.381705:0:9532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367773.381730:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.381740:0:9532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367773.381795:0:9532:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787367773.381798:0:9532:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c55bc4cb000 10000000:01000000:2.0:1787367773.381801:0:9532:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c55bc4cb000 10000000:01000000:2.0:1787367773.381805:0:9532:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787367773.381810:0:9532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bc4cb000 from 1 10000000:01000000:2.0:1787367773.381813:0:9532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787367773.381844:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.381851:0:9532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.381862:0:9532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.381882:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419968:0@lo:101: 00000100:00100000:2.0:1787367773.381951:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.381997:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.382105:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808419968 00000100:00100000:1.0:1787367773.382112:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808419968 00000100:00100000:1.0:1787367773.382156:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787367773.382166:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9532:x1874190808419968:12345-0@lo:101: 00010000:00010000:1.0:1787367773.382178:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367773.382189:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0305a4 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.382208:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0305a4 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.382219:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0305a4 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.382239:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672200, rc 0) 00000100:00100000:1.0:1787367773.382302:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808419968:12345-0@lo:101: Request processed in 137us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.382308:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787367773.382526:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808419968:0@lo:101: 00010000:00010000:2.0:1787367773.382539:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.382547:0:9532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.382635:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808420096:0@lo:501: 00000100:00100000:2.0:1787367773.382661:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.382691:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.382906:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808420096 00000100:00100000:1.0:1787367773.382911:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808420096 00000100:00100000:1.0:1787367773.382946:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787367773.382954:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808420096:12345-0@lo:501: 00000100:00100000:1.0:1787367773.383063:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808420096:12345-0@lo:501: Request processed in 110us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.383070:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787367773.383671:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808420096:0@lo:501: 00000100:00100000:2.0:1787367773.383705:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808420224:0@lo:503: 00000100:00100000:2.0:1787367773.383746:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.383770:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.383839:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808420224 00000100:00100000:1.0:1787367773.383843:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808420224 00000100:00100000:1.0:1787367773.383873:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787367773.383880:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808420224:12345-0@lo:503: 00000100:00100000:1.0:1787367773.383965:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808420224:12345-0@lo:503: Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.383972:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787367773.384127:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808420224:0@lo:503: 00000040:00080000:2.0:1787367773.384328:0:9532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367773.384417:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808420352:0@lo:502: 00000100:00100000:2.0:1787367773.384454:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.384475:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367773.384830:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808420352 00000100:00100000:1.0:1787367773.384835:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808420352 00000100:00100000:1.0:1787367773.384869:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787367773.384877:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808420352:12345-0@lo:502: 00000100:00100000:1.0:1787367773.384965:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808420352:12345-0@lo:502: Request processed in 89us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.384972:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787367773.385137:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808420352:0@lo:502: 00000040:00080000:2.0:1787367773.385306:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787367773.385332:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787367773.385347:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787367773.385629:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787367773.385644:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787367773.385671:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787367773.385687:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787367773.385699:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787367773.385711:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787367773.385722:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787367773.385735:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787367773.385748:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787367773.385760:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787367773.385771:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787367773.385782:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787367773.385792:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787367773.385803:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787367773.385813:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787367773.385836:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787367773.385847:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787367773.385857:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787367773.385875:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787367773.385887:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787367773.385901:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787367773.385913:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787367773.385925:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787367773.385949:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787367773.385964:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787367773.385977:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787367773.386002:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787367773.386014:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787367773.386025:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787367773.386037:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787367773.386050:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787367773.386063:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787367773.386075:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787367773.386088:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1787367773.386109:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787367773.386122:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1787367773.386132:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1787367773.386141:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1787367773.386153:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1787367773.386165:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1787367773.386177:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1787367773.386189:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1787367773.386201:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1787367773.386226:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808420480:0@lo:502: 00000100:00100000:2.0:1787367773.386272:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.386347:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367773.387540:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808420480 00000100:00100000:0.0:1787367773.387549:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808420480 00000100:00100000:0.0:1787367773.387629:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787367773.387639:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808420480:12345-0@lo:502: 00000100:00100000:0.0:1787367773.387760:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808420480:12345-0@lo:502: Request processed in 122us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.387768:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787367773.387911:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808420480:0@lo:502: 00000040:00080000:2.0:1787367773.387995:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1787367773.388008:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1787367773.388540:0:9548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787367773.388554:0:9548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c5482774d28) 00000020:00000080:2.0:1787367773.388576:0:9548:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1787367773.388664:0:9548:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55bc4cb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787367773.388668:0:9548:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bc4cb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787367773.388671:0:9548:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bc4cb000 3 00010000:00080000:2.0:1787367773.388697:0:9548:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5483358800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1787367773.394748:0:9548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1787367773.395042:0:9548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787367773.395087:0:9548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787367773.395097:0:9548:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x66f5679bff0305b9 00000100:00080000:2.0:1787367773.395107:0:9548:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367773.395112:0:9548:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c5483358800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787367773.395143:0:9548:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd68b480 x1874190808420608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787367773.395683:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808420608:0@lo:38: 00000100:00100000:3.0:1787367773.395747:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787367773.396299:0:9548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1787367773.396542:0:9548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787367773.396556:0:9548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c54827719b8) 00000020:00000080:2.0:1787367773.396575:0:9548:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1787367773.396641:0:9548:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55bc4cb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787367773.396645:0:9548:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bc4cb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787367773.396647:0:9548:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bc4cb000 3 00010000:00080000:2.0:1787367773.396672:0:9548:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c548335c800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1787367773.398222:0:9548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:0.0:1787367773.398434:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808420736:0@lo:400: 00000100:00100000:0.0:1787367773.398483:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.398509:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808421248:0@lo:400: 00000100:00100000:0.0:1787367773.398526:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.398546:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367773.398551:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808421120:0@lo:400: 00000100:00100000:0.0:1787367773.398569:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.398595:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808420864:0@lo:400: 00000100:00100000:0.0:1787367773.398618:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.398636:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808421376:0@lo:400: 00000100:00100000:0.0:1787367773.398658:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.398674:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787367773.398679:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808420992:0@lo:400: 00000100:00100000:0.0:1787367773.398699:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.398708:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808421504:0@lo:400: 00000100:00100000:0.0:1787367773.398726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.398766:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808420608 00000100:00100000:0.0:1787367773.398773:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808420608 00000100:00100000:0.0:1787367773.398794:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808420736 00000100:00100000:0.0:1787367773.398796:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808420736 00000100:00100000:0.0:1787367773.398816:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808421248 00000100:00100000:0.0:1787367773.398819:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808421248 00000100:00100000:0.0:1787367773.398841:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808421120 00000100:00100000:0.0:1787367773.398843:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808421120 00000100:00100000:0.0:1787367773.398855:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808420992 00000100:00100000:0.0:1787367773.398857:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808420992 00000100:00100000:0.0:1787367773.398887:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787367773.398895:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808420736:12345-0@lo:400: 00000100:00100000:0.0:1787367773.398953:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808420736:12345-0@lo:400: Request processed in 58us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.398960:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787367773.398976:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787367773.398981:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808421248:12345-0@lo:400: 00000100:00100000:0.0:1787367773.399008:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808421248:12345-0@lo:400: Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.399013:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787367773.399024:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787367773.399030:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808421120:12345-0@lo:400: 00000100:00100000:0.0:1787367773.399051:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808421120:12345-0@lo:400: Request processed in 23us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.399056:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787367773.399065:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367773.399070:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808420992:12345-0@lo:400: 00000100:00100000:0.0:1787367773.399095:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808420992:12345-0@lo:400: Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.399108:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367773.399127:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367773.399131:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874190808420608:12345-0@lo:38: 00010000:00080000:0.0:1787367773.399151:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1787367773.399181:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x66f5679bff0305c7 00000004:00100000:0.0:1787367773.399195:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787367773.399225:0:6540:0:(import.c:65:import_set_state_nolock()) ffff9c54832fa800 : changing import state from RECOVER to FULL 00000020:00000080:2.0:1787367773.401278:0:9548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787367773.401328:0:9548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787367773.404994:0:9548:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x66f5679bff0305ce 00000100:00080000:2.0:1787367773.405012:0:9548:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367773.405019:0:9548:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c548335c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787367773.405055:0:9548:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd68bb80 x1874190808421632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787367773.405071:0:9548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787367773.405268:0:9549:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9c55bd68ad80 x1874190808421760/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367773.405278:0:9549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587f82000 going to sleep for 0 seconds 00000100:00100000:0.0:1787367773.405561:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874190808420608:12345-0@lo:38: Request processed in 6425us (9810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.405572:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367773.405626:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808420864 00000100:00100000:0.0:1787367773.405633:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808420864 00000100:00100000:0.0:1787367773.405668:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787367773.405676:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808420864:12345-0@lo:400: 00000100:00100000:0.0:1787367773.405736:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808420864:12345-0@lo:400: Request processed in 61us (7117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.405742:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787367773.405765:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808421376 00000100:00100000:0.0:1787367773.405768:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808421376 00000100:00100000:0.0:1787367773.405793:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808421504 00000100:00100000:0.0:1787367773.405795:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808421504 00000100:00100000:0.0:1787367773.405813:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787367773.405819:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808421376:12345-0@lo:400: 00000100:00100000:0.0:1787367773.405857:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808421376:12345-0@lo:400: Request processed in 38us (7198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.405864:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787367773.405882:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367773.405887:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808421504:12345-0@lo:400: 00000100:00100000:0.0:1787367773.405915:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808421504:12345-0@lo:400: Request processed in 28us (7188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.405920:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787367773.405951:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367773.405956:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367773.405958:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787367773.406003:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482070e00 x1874190808420992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367773.406017:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808420992:0@lo:400: 00010000:00080000:0.0:1787367773.406030:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482070700 x1874190808421504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367773.406037:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808421504:0@lo:400: 00000100:00100000:0.0:1787367773.406047:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808420864:0@lo:400: 00010000:00080000:0.0:1787367773.406057:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482073100 x1874190808421376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367773.406064:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808421376:0@lo:400: 00010000:00080000:0.0:1787367773.406102:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482072680 x1874190808421120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367773.406110:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808421120:0@lo:400: 00010000:00080000:0.0:1787367773.406121:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482071180 x1874190808420736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367773.406129:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808420736:0@lo:400: 00010000:00080000:0.0:1787367773.406148:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482071500 x1874190808421248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367773.406156:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808421248:0@lo:400: 00010000:00080000:3.0:1787367773.406964:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd68b480 x1874190808420608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367773.406975:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787367773.406992:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787367773.406999:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787367773.407003:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787367773.407007:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5483358800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787367773.407014:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003f2d2ee4): req@ffff9c55bd68ad80 x1874190808421760/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367773.407030:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808420608:0@lo:38: 00000100:00100000:3.0:1787367773.407051:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808421632:0@lo:38: 00000100:00100000:3.0:1787367773.407094:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367773.408505:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808421632 00000100:00100000:0.0:1787367773.408513:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808421632 00000100:00100000:0.0:1787367773.408548:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787367773.408555:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808421632:12345-0@lo:38: 00010000:00080000:0.0:1787367773.408583:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1787367773.408614:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x66f5679bff0305d5 00000004:00100000:0.0:1787367773.408629:0:6538:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787367773.408660:0:6538:0:(import.c:65:import_set_state_nolock()) ffff9c54832ff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367773.408724:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874190808421632:12345-0@lo:38: Request processed in 167us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.408731:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787367773.408781:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd68bb80 x1874190808421632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367773.408792:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787367773.408798:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787367773.408804:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787367773.408808:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787367773.408810:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548335c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787367773.408815:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808421632:0@lo:38: 00000100:00100000:3.0:1787367773.410596:0:9549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.410624:0:9549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587f82000 going to sleep for 11 seconds 00000040:00080000:2.0:1787367773.411571:0:9548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1787367773.411700:0:9532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1787367773.411728:0:9532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787367773.411752:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.411764:0:9532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787367773.411807:0:9532:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787367773.411809:0:9532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367773.411814:0:9532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367773.411815:0:9532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367773.411816:0:9532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367773.411817:0:9532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367773.411818:0:9532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367773.411820:0:9532:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367773.411821:0:9532:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367773.411822:0:9532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367773.411823:0:9532:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787367773.411827:0:9532:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787367773.411829:0:9532:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787367773.411831:0:9532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367773.411832:0:9532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367773.411832:0:9532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367773.411833:0:9532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367773.411834:0:9532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367773.411835:0:9532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367773.411836:0:9532:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367773.411836:0:9532:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367773.411837:0:9532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367773.411838:0:9532:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787367773.411858:0:9532:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787367773.411871:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808421888:0@lo:253: 00000100:00100000:3.0:1787367773.411913:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.411953:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367773.412127:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808421888 00000100:00100000:0.0:1787367773.412134:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808421888 00000100:00100000:0.0:1787367773.412206:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787367773.412215:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9532:x1874190808421888:12345-0@lo:253: 20000000:01000000:0.0:1787367773.412244:0:6530:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787367773.412257:0:6530:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787367773.413309:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808421760 00000100:00100000:1.0:1787367773.413317:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808421760 00000100:00100000:1.0:1787367773.413393:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367773.413402:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9549:x1874190808421760:12345-0@lo:901: 00000100:00100000:1.0:1787367773.413496:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9549:x1874190808421760:12345-0@lo:901: Request processed in 95us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.413503:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787367773.413521:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787367773.413562:0:9549:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55bd68ad80 x1874190808421760/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787367789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367773.413576:0:9549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9549:1874190808421760:0@lo:901: 20000000:01000000:0.0:1787367773.421327:0:6530:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787367773.421651:0:6554:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 20000000:01000000:0.0:1787367773.421651:0:6530:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 10000000:01000000:2.0:1787367773.421656:0:6554:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787367773.421676:0:6554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.421693:0:6554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0304cb expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.421700:0:6554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030511 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.421708:0:6554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.421743:0:6554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030511 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.421780:0:6554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030511 expref: 17 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.421793:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808422016:0@lo:104: 00000100:00100000:2.0:1787367773.421857:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.421898:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808422016 00000100:00100000:3.0:1787367773.421904:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808422016 00000100:00100000:3.0:1787367773.421960:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787367773.421969:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808422016:12345-0@lo:104: 00010000:00010000:3.0:1787367773.421989:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.422015:0:6554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0304cb expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.422023:0:6554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0304cb expref: 17 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.422031:0:6554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808422144:0@lo:104: 00010000:00010000:3.0:1787367773.422033:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367773.422038:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808422016:12345-0@lo:104: Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367773.422044:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787367773.422051:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367773.422060:0:6554:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587f82000 going to sleep for 11 seconds 00000100:00100000:3.0:1787367773.422064:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808422144 00000100:00100000:3.0:1787367773.422067:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808422144 00000100:00100000:2.0:1787367773.422077:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808422016:0@lo:104: 00000100:00100000:3.0:1787367773.422091:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787367773.422097:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd688380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808422144:12345-0@lo:104: 00010000:00010000:3.0:1787367773.422104:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.422137:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787367773.422142:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd688380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:6554:x1874190808422144:12345-0@lo:104: Request processed in 46us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367773.422148:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787367773.422149:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367773.422154:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.422161:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367773.422161:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673000 already unused, calling callback (ffffffffc114ec20) 00010000:00010000:3.0:1787367773.422164:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367773.422166:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.422170:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367773.422173:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.422175:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.422180:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367773.422182:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367773.422186:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367773.422188:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367773.422191:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787367773.422213:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.422219:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787367773.422268:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808422272:0@lo:103: 00000100:00100000:1.0:1787367773.422297:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367773.422336:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.422345:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff030511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030518 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.422369:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367773.422372:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367773.422374:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367773.422531:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808422272 00000100:00100000:1.0:1787367773.422535:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808422272 00010000:00010000:1.0:1787367773.422552:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030511 expref: 18 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367773.422583:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787367773.422590:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:3651:x1874190808422272:12345-0@lo:103: 00010000:00010000:1.0:1787367773.422599:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367773.422603:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030511 expref: 18 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.422612:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030511 expref: 18 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.422637:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673200/0x66f5679bff030518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030511 expref: 18 pid: 6532 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367773.422654:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367773.422665:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.422671:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787367773.422681:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:3651:x1874190808422272:12345-0@lo:103: Request processed in 92us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367773.422687:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787367773.422714:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808422272:0@lo:103: 00010000:00010000:3.0:1787367773.422762:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.422769:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0304cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0304d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.422781:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367773.422783:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367773.422785:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367773.422820:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367773.422828:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808422400:0@lo:103: 00000100:00100000:1.0:1787367773.422852:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367773.422909:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808422400 00000100:00100000:3.0:1787367773.422914:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808422400 00010000:00010000:3.0:1787367773.422927:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0304cb expref: 17 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367773.422964:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787367773.422970:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:3651:x1874190808422400:12345-0@lo:103: 00010000:00010000:3.0:1787367773.422987:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367773.422991:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0304cb expref: 17 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.422999:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0304cb expref: 17 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.423010:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.423017:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787367773.423028:0:6525:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016949288s 00010000:00010000:3.0:1787367773.423032:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.423043:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.423049:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.423055:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.423059:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367773.423063:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.423069:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.423076:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367773.423095:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367773.423120:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:3651:x1874190808422400:12345-0@lo:103: Request processed in 151us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367773.423127:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787367773.423241:0:6554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55814a0600/0x66f5679bff0304d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0304cb expref: 16 pid: 6530 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367773.423251:0:6554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6554:1874190808422144:0@lo:104: 00000100:00100000:1.0:1787367773.423257:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808422400:0@lo:103: 00010000:00010000:2.0:1787367773.423266:0:6554:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.423274:0:6554:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.423281:0:6554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367773.423286:0:6554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55afa83800/0x66f5679bff0305dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367773.423506:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:9532:x1874190808421888:12345-0@lo:253: Request processed in 11292us (11592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367773.423513:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787367773.423620:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9532:1874190808421888:0@lo:253: 10000000:01000000:3.0:1787367773.423630:0:9532:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787367773.423633:0:9532:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787367773.423634:0:9532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367773.423635:0:9532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367773.423636:0:9532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367773.423638:0:9532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367773.423646:0:9532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367773.423647:0:9532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367773.423649:0:9532:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367773.423650:0:9532:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367773.423651:0:9532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367773.423653:0:9532:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787367773.423663:0:9532:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787367773.429921:0:9532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787367773.430238:0:9532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787367773.430838:0:9532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787367773.431176:0:9532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787367773.431497:0:9532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787367773.431844:0:9532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787367773.432960:0:9532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787367773.443120:0:9532:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787367773.443129:0:9532:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787367773.443160:0:9532:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787367773.443195:0:9532:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787367773.443211:0:9532:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787367773.443227:0:9532:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787367773.443890:0:9532:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787367773.446286:0:9532:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787367773.532798:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787367774.158766:0:9604:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787367774.159034:0:9604:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787367774.552605:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367775.578493:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367776.160076:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808422528:0@lo:41: 00000100:00100000:1.0:1787367776.160142:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367776.160184:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808422528 00000100:00100000:2.0:1787367776.160193:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808422528 00000100:00100000:2.0:1787367776.160246:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787367776.160256:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808422528:12345-0@lo:41: 00000004:00000024:2.0:1787367776.160302:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787367776.160814:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808422528:12345-0@lo:41: Request processed in 558us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367776.160823:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787367776.164065:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808422528:0@lo:41: 00010000:00010000:1.0:1787367776.600461:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367776.666950:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367776.666972:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808422656:0@lo:13: 00000100:00100000:3.0:1787367776.667067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367776.667133:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808422656 00000100:00100000:0.0:1787367776.667147:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808422656 00000100:00100000:0.0:1787367776.667202:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787367776.667214:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808422656:12345-0@lo:13: 00002000:00000024:0.0:1787367776.667241:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787367776.667259:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367776.667298:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808422656:12345-0@lo:13: Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367776.667306:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787367776.667348:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc1500 x1874190808422656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367776.667390:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808422656:0@lo:13: 00000100:00100000:1.0:1787367777.179558:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367777.179581:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808422784:0@lo:13: 00000100:00100000:1.0:1787367777.179656:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367777.179828:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808422784 00000100:00100000:2.0:1787367777.179836:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808422784 00000100:00100000:2.0:1787367777.179928:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787367777.179940:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808422784:12345-0@lo:13: 00002000:00000024:2.0:1787367777.180070:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367777.180141:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808422784:12345-0@lo:13: Request processed in 204us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367777.180161:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787367777.180200:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc692a00 x1874190808422784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367777.180216:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808422784:0@lo:13: 00000100:00080000:0.0:1787367777.180249:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787367777.625296:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367778.200550:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367778.200572:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808422912:0@lo:41: 00000100:00100000:0.0:1787367778.200686:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367778.210998:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808422912 00000100:00100000:2.0:1787367778.211011:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808422912 00000100:00100000:0.0:1787367778.211141:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367778.211152:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808422912:12345-0@lo:41: 00000004:00000024:0.0:1787367778.211189:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787367778.211272:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808422912:12345-0@lo:41: Request processed in 122us (10585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367778.211280:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367778.211334:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808422912:0@lo:41: 00010000:00010000:3.0:1787367778.648620:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367778.712846:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808423168:0@lo:400: 00000100:00100000:0.0:1787367778.712924:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713104:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808423680:0@lo:400: 00000100:00100000:0.0:1787367778.713127:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713147:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808424192:0@lo:400: 00000100:00100000:0.0:1787367778.713168:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713211:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787367778.713216:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808423040:0@lo:400: 00000100:00100000:0.0:1787367778.713243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713277:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808423552:0@lo:400: 00000100:00100000:0.0:1787367778.713298:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713313:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808424064:0@lo:400: 00000100:00100000:0.0:1787367778.713335:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713388:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808423296:0@lo:400: 00000100:00100000:0.0:1787367778.713413:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713431:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808423808:0@lo:400: 00000100:00100000:0.0:1787367778.713454:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713472:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787367778.713478:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808423424:0@lo:400: 00000100:00100000:0.0:1787367778.713498:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713508:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808423936:0@lo:400: 00000100:00100000:0.0:1787367778.713539:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367778.713569:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808423168 00000100:00100000:0.0:1787367778.713576:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808423168 00000100:00100000:0.0:1787367778.713611:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808423680 00000100:00100000:0.0:1787367778.713614:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808423680 00000100:00100000:0.0:1787367778.713638:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808424192 00000100:00080000:3.0:1787367778.713641:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367778.713646:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808424192 00000100:00100000:0.0:1787367778.713680:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808423552 00000100:00100000:0.0:1787367778.713683:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808423552 00000100:00100000:0.0:1787367778.713693:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808424064 00000100:00100000:0.0:1787367778.713695:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808424064 00000100:00100000:0.0:1787367778.713706:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808423424 00000100:00100000:0.0:1787367778.713708:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808423424 00000100:00100000:0.0:1787367778.713721:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367778.713730:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808423168:12345-0@lo:400: 00000100:00100000:0.0:1787367778.713781:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808423168:12345-0@lo:400: Request processed in 52us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367778.713788:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367778.713804:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367778.713810:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808423680:12345-0@lo:400: 00000100:00100000:0.0:1787367778.713836:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808423680:12345-0@lo:400: Request processed in 27us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367778.713842:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367778.713854:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787367778.713859:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808424192:12345-0@lo:400: 00000100:00080000:3.0:1787367778.713870:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367778.713878:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367778.713883:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808424192:12345-0@lo:400: Request processed in 25us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367778.713889:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787367778.713910:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787367778.713917:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808423552:12345-0@lo:400: 00000100:00100000:2.0:1787367778.714030:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787367778.714040:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808424064:12345-0@lo:400: 00000100:00100000:2.0:1787367778.714073:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808424064:12345-0@lo:400: Request processed in 36us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367778.714079:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787367778.714090:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787367778.714095:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808423424:12345-0@lo:400: 00000100:00100000:2.0:1787367778.714134:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808423424:12345-0@lo:400: Request processed in 39us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367778.714139:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787367778.714202:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482071500 x1874190808423424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367778.714214:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808423424:0@lo:400: 00000100:00100000:1.0:1787367778.715198:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808423040 00000100:00100000:1.0:1787367778.715205:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808423040 00000100:00100000:1.0:1787367778.715243:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787367778.715251:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:3654:x1874190808423040:12345-0@lo:400: 00000100:00100000:1.0:1787367778.715302:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:3654:x1874190808423040:12345-0@lo:400: Request processed in 51us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367778.715310:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787367778.716305:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808423552:12345-0@lo:400: Request processed in 2385us (3003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367778.716315:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787367778.716347:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808423296 00000100:00100000:0.0:1787367778.716385:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808423296 00000100:00100000:0.0:1787367778.716415:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787367778.716422:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808423296:12345-0@lo:400: 00000100:00100000:0.0:1787367778.716467:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808423296:12345-0@lo:400: Request processed in 45us (3053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367778.716473:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787367778.716492:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808423808 00000100:00100000:0.0:1787367778.716495:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808423808 00000100:00100000:0.0:1787367778.716533:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808423936 00000100:00100000:0.0:1787367778.716536:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808423936 00000100:00100000:3.0:1787367778.716546:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808423296:0@lo:400: 00000100:00100000:0.0:1787367778.716551:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367778.716556:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808423808:12345-0@lo:400: 00000100:00100000:0.0:1787367778.716595:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808423808:12345-0@lo:400: Request processed in 39us (3139us total) trans 0 rc 0/0 00000100:00080000:2.0:1787367778.716596:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367778.716601:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367778.716612:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787367778.716618:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808423936:12345-0@lo:400: 00000100:00100000:0.0:1787367778.716645:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808423936:12345-0@lo:400: Request processed in 27us (3106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367778.716651:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787367778.716682:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808423040:0@lo:400: 00010000:00080000:3.0:1787367778.716699:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482070000 x1874190808423936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787367778.716707:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482071180 x1874190808423552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367778.716710:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808423936:0@lo:400: 00000100:00100000:0.0:1787367778.716715:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808423552:0@lo:400: 00010000:00080000:3.0:1787367778.716720:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482073100 x1874190808423808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787367778.716726:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482070700 x1874190808424064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367778.716728:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808423808:0@lo:400: 00000100:00100000:0.0:1787367778.716745:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808424064:0@lo:400: 00010000:00080000:0.0:1787367778.716759:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd626300 x1874190808423168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367778.716767:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808423168:0@lo:400: 00010000:00080000:0.0:1787367778.716777:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482072680 x1874190808423680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367778.716785:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808423680:0@lo:400: 00010000:00080000:0.0:1787367778.716795:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482070e00 x1874190808424192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367778.716802:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808424192:0@lo:400: 00000001:02000400:0.0:1787367778.899863:0:9894:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787367779.677656:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787367779.688472:0:9946:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787367779.688737:0:9946:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787367780.696965:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367781.272657:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808424320:0@lo:41: 00000100:00100000:0.0:1787367781.272724:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.272822:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808424320 00000100:00100000:2.0:1787367781.272830:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808424320 00000100:00100000:2.0:1787367781.272887:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787367781.272898:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808424320:12345-0@lo:41: 10000000:01000000:3.0:1787367781.272910:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787367781.272915:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bd606800 from 39 10000000:01000000:3.0:1787367781.272918:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000004:00000024:2.0:1787367781.272927:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00010000:00010000:3.0:1787367781.272953:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.272964:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367781.272973:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808424320:12345-0@lo:41: Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.272980:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1787367781.272984:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367781.272998:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808424448:0@lo:101: 00000100:00100000:2.0:1787367781.273020:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808424320:0@lo:41: 00000100:00100000:3.0:1787367781.273026:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.273045:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832dff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367781.273101:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808424448 00000100:00100000:0.0:1787367781.273105:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808424448 00000100:00100000:0.0:1787367781.273153:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787367781.273161:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808424448:12345-0@lo:101: 00010000:00010000:0.0:1787367781.273169:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367781.273182:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0305e3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.273203:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0305e3 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.273233:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0305e3 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.273241:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ae00, rc 0) 00000100:00100000:0.0:1787367781.273276:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808424448:12345-0@lo:101: Request processed in 116us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.273281:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787367781.273350:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808424448:0@lo:101: 00010000:00010000:3.0:1787367781.273388:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.273396:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367781.273446:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808424576:0@lo:501: 00000100:00100000:3.0:1787367781.273471:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.273496:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832dff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.273549:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808424576 00000100:00100000:2.0:1787367781.273554:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808424576 00000100:00100000:2.0:1787367781.273585:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787367781.273593:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808424576:12345-0@lo:501: 00000100:00100000:2.0:1787367781.273715:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808424576:12345-0@lo:501: Request processed in 123us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.273722:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787367781.273845:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808424576:0@lo:501: 00000100:00100000:3.0:1787367781.273871:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808424704:0@lo:503: 00000100:00100000:3.0:1787367781.273932:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.273950:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832dff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.274101:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808424704 00000100:00100000:2.0:1787367781.274106:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808424704 00000100:00100000:2.0:1787367781.274135:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787367781.274141:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808424704:12345-0@lo:503: 00000100:00100000:2.0:1787367781.274219:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808424704:12345-0@lo:503: Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.274226:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787367781.274380:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808424704:0@lo:503: 00000100:00100000:3.0:1787367781.274698:0:9998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9998:1874190808424832:0@lo:502: 00000100:00100000:3.0:1787367781.274732:0:9998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.274758:0:9998:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832df240 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.274862:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808424832 00000100:00100000:2.0:1787367781.274866:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808424832 00000100:00100000:2.0:1787367781.274907:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787367781.274913:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9998:x1874190808424832:12345-0@lo:502: 00000100:00100000:2.0:1787367781.275020:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9998:x1874190808424832:12345-0@lo:502: Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.275028:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787367781.275250:0:9998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9998:1874190808424832:0@lo:502: 00000100:00100000:3.0:1787367781.275290:0:9998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9998:1874190808424960:0@lo:502: 00000100:00100000:3.0:1787367781.275322:0:9998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.275344:0:9998:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832df240 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.275414:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808424960 00000100:00100000:1.0:1787367781.275419:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808424960 00000100:00100000:1.0:1787367781.275452:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787367781.275459:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9998:x1874190808424960:12345-0@lo:502: 00000100:00100000:1.0:1787367781.275538:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:9998:x1874190808424960:12345-0@lo:502: Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.275545:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787367781.278096:0:9998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9998:1874190808424960:0@lo:502: 00000040:00080000:3.0:1787367781.278156:0:9998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787367781.278331:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787367781.278351:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367781.278400:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.278412:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367781.278423:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787367781.278425:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787367781.278428:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787367781.278461:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.278469:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.278477:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367781.278493:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425088:0@lo:101: 00000100:00100000:2.0:1787367781.278549:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.278594:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367781.278701:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808425088 00000100:00100000:0.0:1787367781.278707:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808425088 00000100:00100000:0.0:1787367781.278765:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787367781.278773:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808425088:12345-0@lo:101: 00010000:00010000:0.0:1787367781.278785:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367781.278797:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0305f1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.278817:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0305f1 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.278827:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0305f1 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.278835:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b000, rc 0) 00000100:00100000:0.0:1787367781.278875:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808425088:12345-0@lo:101: Request processed in 103us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.278891:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787367781.279473:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425088:0@lo:101: 00010000:00010000:2.0:1787367781.279487:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.279512:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367781.279565:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425216:0@lo:501: 00000100:00100000:2.0:1787367781.279594:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.279625:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.279678:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808425216 00000100:00100000:1.0:1787367781.279682:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808425216 00000100:00100000:1.0:1787367781.279715:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787367781.279722:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808425216:12345-0@lo:501: 00000100:00100000:1.0:1787367781.279843:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808425216:12345-0@lo:501: Request processed in 120us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.279849:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787367781.280257:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425216:0@lo:501: 00000100:00100000:2.0:1787367781.280287:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425344:0@lo:503: 00000100:00100000:2.0:1787367781.280338:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.280721:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367781.288403:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808425344 00000100:00100000:3.0:1787367781.288418:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808425344 00000100:00100000:3.0:1787367781.288494:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787367781.288504:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808425344:12345-0@lo:503: 00000100:00100000:3.0:1787367781.288663:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808425344:12345-0@lo:503: Request processed in 159us (8323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.288671:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787367781.288852:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425344:0@lo:503: 00000100:00100000:2.0:1787367781.289448:0:9999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9999:1874190808425472:0@lo:502: 00000100:00100000:2.0:1787367781.289490:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.289525:0:9999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367781.289619:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808425472 00000100:00100000:0.0:1787367781.289623:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808425472 00000100:00100000:0.0:1787367781.289659:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787367781.289673:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9999:x1874190808425472:12345-0@lo:502: 00000100:00100000:0.0:1787367781.289768:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9999:x1874190808425472:12345-0@lo:502: Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.289775:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787367781.290603:0:9999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9999:1874190808425472:0@lo:502: 00000020:01000000:2.0:1787367781.290632:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367781.290641:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367781.290644:0:9999:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787367781.290648:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367781.290650:0:9999:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787367781.290668:0:9999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9999:1874190808425600:0@lo:502: 00000100:00100000:2.0:1787367781.290708:0:9999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.290739:0:9999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.290794:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808425600 00000100:00100000:1.0:1787367781.290799:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808425600 00000100:00100000:1.0:1787367781.290833:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787367781.290841:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9999:x1874190808425600:12345-0@lo:502: 00000100:00100000:1.0:1787367781.290942:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:9999:x1874190808425600:12345-0@lo:502: Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.290949:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787367781.291330:0:9999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:9999:1874190808425600:0@lo:502: 00000020:01000000:2.0:1787367781.291385:0:9999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367781.291390:0:9999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367781.291392:0:9999:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787367781.291395:0:9999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787367781.291538:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787367781.291557:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787367781.291565:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.291575:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367781.291584:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787367781.291586:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bc6be800 from 39 10000000:01000000:0.0:1787367781.291589:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787367781.291610:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.291617:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.291626:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367781.291639:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425728:0@lo:101: 00000100:00100000:0.0:1787367781.291669:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.291696:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.291845:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808425728 00000100:00100000:1.0:1787367781.291850:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808425728 00000100:00100000:1.0:1787367781.291891:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787367781.291899:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808425728:12345-0@lo:101: 00010000:00010000:1.0:1787367781.291906:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367781.291918:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0305ff expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.291946:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0305ff expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.291956:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0305ff expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.291964:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672400, rc 0) 00000100:00100000:1.0:1787367781.292007:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808425728:12345-0@lo:101: Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.292013:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787367781.292161:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425728:0@lo:101: 00010000:00010000:0.0:1787367781.292173:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.292190:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367781.292237:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425856:0@lo:501: 00000100:00100000:0.0:1787367781.292261:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.292282:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.292335:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808425856 00000100:00100000:2.0:1787367781.292339:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808425856 00000100:00100000:2.0:1787367781.292397:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787367781.292405:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808425856:12345-0@lo:501: 00000100:00100000:2.0:1787367781.292502:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808425856:12345-0@lo:501: Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.292509:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787367781.292617:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425856:0@lo:501: 00000100:00100000:0.0:1787367781.292641:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425984:0@lo:503: 00000100:00100000:0.0:1787367781.292675:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.292703:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.292897:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808425984 00000100:00100000:2.0:1787367781.292902:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808425984 00000100:00100000:2.0:1787367781.292939:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787367781.292945:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808425984:12345-0@lo:503: 00000100:00100000:2.0:1787367781.293034:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808425984:12345-0@lo:503: Request processed in 89us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.293041:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787367781.293194:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808425984:0@lo:503: 00000100:00100000:1.0:1787367781.293710:0:10000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10000:1874190808426112:0@lo:502: 00000100:00100000:1.0:1787367781.293747:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.293774:0:10000:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.294071:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808426112 00000100:00100000:2.0:1787367781.294076:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808426112 00000100:00100000:2.0:1787367781.294156:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787367781.294165:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:10000:x1874190808426112:12345-0@lo:502: 00000100:00100000:2.0:1787367781.294257:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:10000:x1874190808426112:12345-0@lo:502: Request processed in 93us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.294264:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787367781.294342:0:10000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10000:1874190808426112:0@lo:502: 00000100:00100000:1.0:1787367781.294416:0:10000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10000:1874190808426240:0@lo:502: 00000100:00100000:1.0:1787367781.294450:0:10000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.326198:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808426240 00000100:00100000:2.0:1787367781.326213:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808426240 00000100:00100000:2.0:1787367781.326271:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787367781.326294:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:10000:x1874190808426240:12345-0@lo:502: 00000100:00100000:2.0:1787367781.326477:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:10000:x1874190808426240:12345-0@lo:502: Request processed in 184us (32027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.326485:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787367781.326746:0:10000:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.326768:0:10000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10000:1874190808426240:0@lo:502: 00000040:00080000:1.0:1787367781.326812:0:10000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787367781.327212:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787367781.327236:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367781.327245:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.327256:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367781.327265:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787367781.327268:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55bc6be800 from 6 10000000:01000000:2.0:1787367781.327270:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787367781.327299:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.327307:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.327315:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367781.327332:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426368:0@lo:101: 00000100:00100000:2.0:1787367781.327406:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.327430:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58540 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.327633:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808426368 00000100:00100000:1.0:1787367781.327639:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808426368 00000100:00100000:1.0:1787367781.327678:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787367781.327687:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808426368:12345-0@lo:101: 00010000:00010000:1.0:1787367781.327697:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367781.327708:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673600/0x66f5679bff030614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03060d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.327726:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673600/0x66f5679bff030614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03060d expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.327736:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673600/0x66f5679bff030614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03060d expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.327744:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673600, rc 0) 00000100:00100000:1.0:1787367781.327775:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808426368:12345-0@lo:101: Request processed in 90us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.327782:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787367781.328273:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426368:0@lo:101: 00010000:00010000:2.0:1787367781.328288:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.328308:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367781.328410:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426496:0@lo:256: 00000100:00100000:2.0:1787367781.328444:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.328468:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58540 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.328812:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808426496 00000100:00100000:1.0:1787367781.328818:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808426496 00000100:00100000:1.0:1787367781.328853:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787367781.328861:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808426496:12345-0@lo:256: 20000000:01000000:1.0:1787367781.328876:0:6533:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787367781.328901:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787367781.328904:0:6533:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787367781.329231:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808426496:12345-0@lo:256: Request processed in 369us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.329239:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787367781.329301:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426496:0@lo:256: 10000000:01000000:3.0:1787367781.329391:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367781.329399:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.329408:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367781.329417:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787367781.329420:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1787367781.329422:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787367781.329445:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.329452:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.329461:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367781.329475:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426624:0@lo:101: 00000100:00100000:3.0:1787367781.329504:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.329539:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832dff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.329797:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808426624 00000100:00100000:1.0:1787367781.329818:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808426624 00000100:00100000:1.0:1787367781.329855:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787367781.329862:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808426624:12345-0@lo:101: 00010000:00010000:1.0:1787367781.329871:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367781.329890:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03061b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.329907:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03061b expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.329916:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03061b expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.329934:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672c00, rc 0) 00000100:00100000:1.0:1787367781.330131:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808426624:12345-0@lo:101: Request processed in 105us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.330140:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787367781.330175:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426624:0@lo:101: 00010000:00010000:1.0:1787367781.330190:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.330198:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367781.330249:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426752:0@lo:501: 00000100:00100000:1.0:1787367781.330273:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.330288:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.330314:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808426752 00000100:00100000:1.0:1787367781.330317:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808426752 00000100:00100000:1.0:1787367781.330350:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787367781.330376:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808426752:12345-0@lo:501: 00000100:00100000:1.0:1787367781.330474:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808426752:12345-0@lo:501: Request processed in 118us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.330481:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787367781.330508:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426752:0@lo:501: 00000100:00100000:1.0:1787367781.330533:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426880:0@lo:503: 00000100:00100000:1.0:1787367781.330568:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.330586:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.330596:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808426880 00000100:00100000:1.0:1787367781.330599:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808426880 00000100:00100000:1.0:1787367781.330616:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787367781.331133:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808426880:12345-0@lo:503: 00000100:00100000:1.0:1787367781.331235:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808426880:12345-0@lo:503: Request processed in 106us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.331242:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787367781.331382:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808426880:0@lo:503: 00000100:00100000:0.0:1787367781.334523:0:10001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10001:1874190808427008:0@lo:502: 00000100:00100000:0.0:1787367781.334606:0:10001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.334645:0:10001:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.334735:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808427008 00000100:00100000:1.0:1787367781.334742:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808427008 00000100:00100000:1.0:1787367781.334791:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787367781.334799:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:10001:x1874190808427008:12345-0@lo:502: 00000100:00100000:1.0:1787367781.334922:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:10001:x1874190808427008:12345-0@lo:502: Request processed in 123us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.334930:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787367781.335347:0:10001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10001:1874190808427008:0@lo:502: 00000020:01000000:0.0:1787367781.335438:0:10001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787367781.335445:0:10001:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787367781.335452:0:10001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367781.335455:0:10001:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787367781.335461:0:10001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787367781.335465:0:10001:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1787367781.335485:0:10001:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787367781.335488:0:10001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787367781.335511:0:10001:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c54826b99b8) 00000020:00000080:0.0:1787367781.335534:0:10001:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1787367781.335547:0:10001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787367781.335633:0:10001:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787367781.335639:0:10001:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787367781.335646:0:10001:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff030630 00010000:00080000:0.0:1787367781.335674:0:10001:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c548252c800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787367781.335902:0:10001:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1787367781.336019:0:10001:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787367781.336031:0:10001:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787367781.336181:0:10001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367781.338333:0:10001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367781.338499:0:10001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787367781.338587:0:10001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787367781.339115:0:10002:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367781.339121:0:10002:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787367781.340040:0:10001:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787367781.340051:0:10001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787367781.340089:0:10001:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787367781.340112:0:10001:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff030637 00000100:00080000:2.0:1787367781.340121:0:10001:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367781.340126:0:10001:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c548252c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787367781.340158:0:10001:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd68b100 x1874190808427136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787367781.340517:0:10001:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787367781.340570:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808427136:0@lo:8: 00000100:00100000:0.0:1787367781.340636:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787367781.340748:0:10001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367781.340752:0:10001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367781.340754:0:10001:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787367781.340757:0:10001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367781.340761:0:10001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367781.340762:0:10001:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787367781.340764:0:10001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367781.340766:0:10001:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787367781.340789:0:10001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10001:1874190808427264:0@lo:502: 00000100:00100000:2.0:1787367781.340833:0:10001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.340859:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808427264 00000100:00100000:2.0:1787367781.340865:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808427264 00000100:00100000:2.0:1787367781.340913:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787367781.342914:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:10001:x1874190808427264:12345-0@lo:502: 00000100:00100000:2.0:1787367781.343183:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:10001:x1874190808427264:12345-0@lo:502: Request processed in 286us (2349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.343192:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787367781.343254:0:10001:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.343275:0:10001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10001:1874190808427264:0@lo:502: 00000020:01000000:2.0:1787367781.343304:0:10001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367781.343311:0:10001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367781.343313:0:10001:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787367781.343317:0:10001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:3.0:1787367781.343437:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808427136 00000100:00100000:3.0:1787367781.343444:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808427136 00000100:00100000:3.0:1787367781.343487:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787367781.343493:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3650:x1874190808427136:12345-0@lo:8: 00010000:00080000:3.0:1787367781.343516:0:8925:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1787367781.343544:0:8925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff03063e 00002000:00100000:3.0:1787367781.343557:0:8925:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c54830c2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787367781.343561:0:8925:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1787367781.343564:0:8925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787367781.343685:0:8925:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787367781.344086:0:8925:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787367781.344111:0:8925:0:(import.c:65:import_set_state_nolock()) ffff9c54830c0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367781.344171:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1874190808427136:12345-0@lo:8: Request processed in 676us (3533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.344179:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787367781.344210:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd68b100 x1874190808427136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787367791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.344220:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787367781.344227:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787367781.344234:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787367781.344239:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787367781.344242:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548252c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787367781.344266:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787367781.344271:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808427136:0@lo:8: 00000100:00100000:0.0:1787367781.344319:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808427520:0@lo:400: 00000100:00100000:0.0:1787367781.344352:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.344378:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808427392:0@lo:400: 00000100:00100000:0.0:1787367781.344395:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808428032:0@lo:400: 00000100:00100000:1.0:1787367781.344405:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.344415:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.344423:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808427904:0@lo:400: 00000100:00100000:0.0:1787367781.344428:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787367781.344439:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808427648:0@lo:400: 00000100:00100000:1.0:1787367781.344451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.344457:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.344465:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808428416:0@lo:400: 00000100:00100000:0.0:1787367781.344471:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808428160:0@lo:400: 00000100:00100000:1.0:1787367781.344487:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.344504:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787367781.344509:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808427776:0@lo:400: 00000100:00100000:1.0:1787367781.344530:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.344540:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808428288:0@lo:400: 00000100:00100000:1.0:1787367781.344557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.344579:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808427520 00000100:00100000:1.0:1787367781.344583:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808427520 00000100:00100000:1.0:1787367781.344605:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808427392 00000100:00100000:1.0:1787367781.344608:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808427392 00000100:00100000:0.0:1787367781.344697:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.344725:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808427904 00000100:00100000:0.0:1787367781.344729:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808427904 00000100:00100000:0.0:1787367781.344753:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808428416 00000100:00100000:0.0:1787367781.344756:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808428416 00000100:00100000:0.0:1787367781.344769:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808427776 00000100:00100000:0.0:1787367781.344772:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808427776 00000100:00100000:0.0:1787367781.344783:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808428288 00000100:00100000:0.0:1787367781.344785:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808428288 00000100:00100000:0.0:1787367781.344800:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787367781.344806:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808427520:12345-0@lo:400: 00000100:00100000:0.0:1787367781.344843:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808427520:12345-0@lo:400: Request processed in 37us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.344849:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787367781.344861:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367781.344866:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808427392:12345-0@lo:400: 00000100:00100000:0.0:1787367781.344909:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808427392:12345-0@lo:400: Request processed in 42us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.344915:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367781.344926:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787367781.344933:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808427904:12345-0@lo:400: 00000100:00100000:0.0:1787367781.344960:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808427904:12345-0@lo:400: Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.344965:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787367781.344984:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787367781.344998:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808428416:12345-0@lo:400: 00000100:00100000:0.0:1787367781.345026:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808428416:12345-0@lo:400: Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.345031:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787367781.345044:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787367781.345050:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808427776:12345-0@lo:400: 00000100:00100000:0.0:1787367781.345074:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808427776:12345-0@lo:400: Request processed in 25us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.345079:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787367781.345089:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787367781.345095:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808428288:12345-0@lo:400: 00000100:00100000:0.0:1787367781.345118:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808428288:12345-0@lo:400: Request processed in 24us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.345124:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787367781.345140:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808428032 00000100:00100000:0.0:1787367781.345143:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808428032 00000100:00100000:0.0:1787367781.345165:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808428160 00000100:00100000:0.0:1787367781.345168:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808428160 00000100:00100000:0.0:1787367781.345185:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787367781.345192:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808428032:12345-0@lo:400: 00000100:00100000:0.0:1787367781.345221:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808428032:12345-0@lo:400: Request processed in 30us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.345226:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787367781.345967:0:10003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10003:1874190808428544:0@lo:700: 00000100:00100000:3.0:1787367781.346005:0:10003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.346025:0:10003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832df780 going to sleep for 11 seconds 00000004:00080000:3.0:1787367781.346040:0:10002:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787367781.346101:0:10002:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 238633745232ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787367781.346108:0:10002:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:1.0:1787367781.346210:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1787367781.346233:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787367781.346242:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.346254:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367781.346263:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787367781.346266:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55834d5000 from 39 10000000:01000000:1.0:1787367781.346269:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787367781.346292:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.346299:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.346309:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367781.346344:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808428672:0@lo:101: 00000100:00100000:1.0:1787367781.346399:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.346421:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.346437:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808428672 00000100:00100000:1.0:1787367781.346441:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808428672 00000100:00100000:1.0:1787367781.346474:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787367781.346481:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808428672:12345-0@lo:101: 00010000:00010000:1.0:1787367781.346491:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787367781.346491:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787367781.346498:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808428160:12345-0@lo:400: 00010000:00010000:1.0:1787367781.346501:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030645 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.346518:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030645 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367781.346528:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030645 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367781.346533:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808428160:12345-0@lo:400: Request processed in 36us (1836us total) trans 0 rc 0/0 00010000:00010000:1.0:1787367781.346537:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673000, rc 0) 00000100:00100000:0.0:1787367781.346545:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787367781.346561:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808428672:12345-0@lo:101: Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.346563:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808427648 00000100:00100000:1.0:1787367781.346566:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787367781.346566:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808427648 00000100:00100000:0.0:1787367781.346588:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787367781.346594:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808427648:12345-0@lo:400: 00000100:00100000:1.0:1787367781.346600:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808428672:0@lo:101: 00010000:00010000:1.0:1787367781.346612:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367781.346623:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808427648:12345-0@lo:400: Request processed in 30us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.346628:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787367781.346649:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367781.346654:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367781.346656:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367781.346675:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808427648:0@lo:400: 00010000:00080000:0.0:1787367781.346689:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836ead80 x1874190808428160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.346699:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808428160:0@lo:400: 00010000:00080000:0.0:1787367781.346708:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836ebb80 x1874190808428032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.346715:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808428032:0@lo:400: 00010000:00080000:0.0:1787367781.346725:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836ea300 x1874190808427520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.346731:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808427520:0@lo:400: 00000100:00100000:2.0:1787367781.346818:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808428544 00000100:00100000:2.0:1787367781.346822:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808428544 00000100:00100000:2.0:1787367781.346853:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367781.346858:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10003:x1874190808428544:12345-0@lo:700: 00000100:00100000:2.0:1787367781.346895:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8461:1874190808428800:0@lo:700: 00000100:00100000:2.0:1787367781.346937:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.346954:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.346970:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808428800 00000100:00100000:2.0:1787367781.346973:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808428800 00000100:00100000:2.0:1787367781.346997:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367781.347003:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8461:x1874190808428800:12345-0@lo:700: 00000100:00080000:0.0:1787367781.347007:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787367781.347027:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e8380 x1874190808427776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.347036:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808427776:0@lo:400: 00010000:00080000:0.0:1787367781.347054:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e9f80 x1874190808428288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.347061:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808428288:0@lo:400: 00010000:00080000:0.0:1787367781.347071:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836eaa00 x1874190808427392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.347078:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808427392:0@lo:400: 00010000:00080000:0.0:1787367781.347088:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836eb480 x1874190808427904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.347096:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808427904:0@lo:400: 00010000:00080000:0.0:1787367781.347106:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e9180 x1874190808428416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.347112:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808428416:0@lo:400: 00010000:00010000:1.0:1787367781.348130:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367781.348207:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808428928:0@lo:501: 00000100:00100000:1.0:1787367781.348245:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.348277:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.348962:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808428928 00000100:00100000:2.0:1787367781.348969:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808428928 00000100:00100000:2.0:1787367781.349010:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787367781.349018:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808428928:12345-0@lo:501: 00000100:00100000:2.0:1787367781.349153:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808428928:12345-0@lo:501: Request processed in 135us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.349172:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787367781.349396:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808428928:0@lo:501: 00000100:00100000:3.0:1787367781.349432:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429056:0@lo:503: 00000100:00100000:3.0:1787367781.349475:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.349508:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832df6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.349573:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808429056 00000100:00100000:1.0:1787367781.349578:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808429056 00000100:00100000:1.0:1787367781.349605:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787367781.349611:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808429056:12345-0@lo:503: 00000100:00100000:1.0:1787367781.350738:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808429056:12345-0@lo:503: Request processed in 1123us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.350755:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787367781.351106:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429056:0@lo:503: 00000100:00100000:1.0:1787367781.352118:0:10004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10004:1874190808429184:0@lo:502: 00000100:00100000:1.0:1787367781.352174:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.352212:0:10004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.352297:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808429184 00000100:00100000:2.0:1787367781.352303:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808429184 00000100:00100000:2.0:1787367781.352347:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787367781.352381:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10004:x1874190808429184:12345-0@lo:502: 00000100:00100000:2.0:1787367781.352477:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10004:x1874190808429184:12345-0@lo:502: Request processed in 121us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.352484:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787367781.352793:0:10004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10004:1874190808429184:0@lo:502: 00000100:00100000:1.0:1787367781.352837:0:10004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10004:1874190808429312:0@lo:502: 00000100:00100000:1.0:1787367781.352871:0:10004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.352908:0:10004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367781.353018:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808429312 00000100:00100000:3.0:1787367781.353022:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808429312 00000100:00100000:3.0:1787367781.353054:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787367781.353061:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10004:x1874190808429312:12345-0@lo:502: 00000100:00100000:3.0:1787367781.353139:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10004:x1874190808429312:12345-0@lo:502: Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.353146:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000004:00080000:2.0:1787367781.353547:0:7470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787367781.354121:0:10004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10004:1874190808429312:0@lo:502: 00000040:00080000:1.0:1787367781.354149:0:10004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787367781.354347:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787367781.354400:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787367781.354410:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.354420:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367781.354430:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787367781.354433:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55834d5000 from 6 10000000:01000000:3.0:1787367781.354435:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787367781.354463:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.354472:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.354481:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367781.354495:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429440:0@lo:101: 00000100:00100000:3.0:1787367781.354541:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.354571:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832df000 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.355230:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808429440 00000100:00100000:2.0:1787367781.355237:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808429440 00000100:00100000:2.0:1787367781.355336:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787367781.355345:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808429440:12345-0@lo:101: 00010000:00010000:2.0:1787367781.355380:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367781.355394:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55afa82600/0x66f5679bff03065a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030653 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.355419:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55afa82600/0x66f5679bff03065a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030653 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.355429:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55afa82600/0x66f5679bff03065a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030653 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.355437:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82600, rc 0) 00000100:00100000:2.0:1787367781.355479:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808429440:12345-0@lo:101: Request processed in 135us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.355485:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787367781.355859:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429440:0@lo:101: 00010000:00010000:0.0:1787367781.355875:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.355894:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367781.356087:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429568:0@lo:256: 00000100:00100000:0.0:1787367781.356128:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.356158:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684840 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.356804:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808429568 00000100:00100000:2.0:1787367781.356818:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808429568 00000100:00100000:2.0:1787367781.356851:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787367781.356859:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808429568:12345-0@lo:256: 20000000:01000000:2.0:1787367781.356875:0:6530:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787367781.356902:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787367781.356905:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787367781.359177:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808429568:12345-0@lo:256: Request processed in 2310us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.359191:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787367781.359254:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429568:0@lo:256: 10000000:01000000:2.0:1787367781.359310:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787367781.359320:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.359331:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367781.359340:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787367781.359343:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787367781.359345:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787367781.359390:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.359398:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.359406:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367781.359422:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429696:0@lo:101: 00000100:00100000:2.0:1787367781.359465:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.359494:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.359510:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808429696 00000100:00100000:2.0:1787367781.359516:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808429696 00000100:00100000:2.0:1787367781.359548:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787367781.359556:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808429696:12345-0@lo:101: 00010000:00010000:2.0:1787367781.359567:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367781.359577:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030661 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.359598:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030661 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367781.359608:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030661 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:3.0:1787367781.359950:0:6545:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00010000:00010000:2.0:1787367781.361714:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa83e00, rc 0) 00000100:00100000:2.0:1787367781.361804:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808429696:12345-0@lo:101: Request processed in 2245us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.361813:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787367781.362101:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429696:0@lo:101: 00010000:00010000:0.0:1787367781.362139:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.362150:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367781.362226:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429824:0@lo:501: 00000100:00100000:0.0:1787367781.362265:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.362298:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55835d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.368005:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808429824 00000100:00100000:2.0:1787367781.368021:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808429824 00000100:00100000:2.0:1787367781.368085:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787367781.368095:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808429824:12345-0@lo:501: 00000100:00100000:2.0:1787367781.368257:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808429824:12345-0@lo:501: Request processed in 163us (5990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.368265:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787367781.368942:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429824:0@lo:501: 00000100:00100000:0.0:1787367781.369001:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429952:0@lo:503: 00000100:00100000:0.0:1787367781.369061:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367781.369094:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55835d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.369233:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808429952 00000100:00100000:2.0:1787367781.369245:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808429952 00000100:00100000:2.0:1787367781.369277:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787367781.369285:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808429952:12345-0@lo:503: 00000100:00100000:2.0:1787367781.369394:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808429952:12345-0@lo:503: Request processed in 109us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.369401:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787367781.369443:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808429952:0@lo:503: 00000100:00100000:2.0:1787367781.369732:0:10005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10005:1874190808430080:0@lo:502: 00000100:00100000:2.0:1787367781.369767:0:10005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.369786:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808430080 00000100:00100000:2.0:1787367781.369790:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808430080 00000100:00100000:2.0:1787367781.369809:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787367781.369816:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10005:x1874190808430080:12345-0@lo:502: 00000100:00100000:2.0:1787367781.369896:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10005:x1874190808430080:12345-0@lo:502: Request processed in 66us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.369903:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787367781.369930:0:10005:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.369942:0:10005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10005:1874190808430080:0@lo:502: 00000020:01000000:2.0:1787367781.369963:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787367781.369970:0:10005:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787367781.369976:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367781.369979:0:10005:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787367781.369984:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787367781.369988:0:10005:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:2.0:1787367781.370007:0:10005:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787367781.370011:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787367781.370024:0:10005:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c5482773370) 00000020:00000080:2.0:1787367781.370054:0:10005:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1787367781.370061:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787367781.370135:0:10005:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787367781.370141:0:10005:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787367781.370148:0:10005:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff030676 00010000:00080000:2.0:1787367781.370175:0:10005:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c54832fe000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1787367781.370420:0:10005:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1787367781.370549:0:10005:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787367781.370560:0:10005:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787367781.370737:0:10005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367781.370852:0:10005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367781.371850:0:10005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787367781.372743:0:10005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:3.0:1787367781.380596:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8461:x1874190808428800:12345-0@lo:700: Request processed in 33585us (33650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.380611:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787367781.381073:0:8461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd688000 x1874190808428800/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367781.381089:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8461:1874190808428800:0@lo:700: 40000000:02000000:2.0:1787367781.381104:0:8461:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1787367781.387164:0:10006:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367781.387174:0:10006:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787367781.390293:0:10005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787367781.390306:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787367781.390344:0:10005:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787367781.390391:0:10005:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff03067d 00000100:00080000:1.0:1787367781.390401:0:10005:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787367781.390407:0:10005:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c54832fe000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787367781.390438:0:10005:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c54836e9880 x1874190808430208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787367781.390454:0:10005:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787367781.390507:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367781.390510:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367781.390512:0:10005:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787367781.390515:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367781.390519:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367781.390520:0:10005:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787367781.390523:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787367781.390525:0:10005:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787367781.390550:0:10005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10005:1874190808430336:0@lo:502: 00000100:00100000:0.0:1787367781.391017:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808430208:0@lo:8: 00000100:00100000:0.0:1787367781.391053:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.391148:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808430208 00000100:00100000:3.0:1787367781.391155:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808430208 00000100:00100000:3.0:1787367781.391191:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367781.391198:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874190808430208:12345-0@lo:8: 00010000:00080000:3.0:1787367781.391221:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1787367781.391246:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff030684 00002000:00100000:3.0:1787367781.391259:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c54830c2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787367781.391263:0:8453:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787367781.391266:0:8453:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787367781.391327:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787367781.391348:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c54830c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367781.391418:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874190808430208:12345-0@lo:8: Request processed in 219us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.391425:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787367781.391461:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e9880 x1874190808430208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787367791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367781.391470:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787367781.391475:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787367781.391481:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787367781.391485:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787367781.391496:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54832fe000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787367781.391508:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787367781.391513:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808430208:0@lo:8: 00000100:00100000:1.0:1787367781.394021:0:10005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.394796:0:10005:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b480 going to sleep for 11 seconds 00000004:00080000:1.0:1787367781.394819:0:10006:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787367781.395388:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808430336 00000100:00100000:0.0:1787367781.395397:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808430336 00000100:00100000:0.0:1787367781.395448:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787367781.395457:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10005:x1874190808430336:12345-0@lo:502: 00000100:00100000:0.0:1787367781.395606:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10005:x1874190808430336:12345-0@lo:502: Request processed in 149us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.395615:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787367781.395840:0:10005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10005:1874190808430336:0@lo:502: 00000020:01000000:1.0:1787367781.395872:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367781.395888:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367781.395890:0:10005:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787367781.395895:0:10005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:3.0:1787367781.396892:0:10006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238684534651ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787367781.396905:0:10006:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:3.0:1787367781.397782:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1787367781.397813:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787367781.397823:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.397835:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367781.397845:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787367781.397847:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c55b8aab370 from 1 10000000:01000000:3.0:1787367781.397850:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787367781.397894:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.397902:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.397912:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367781.399575:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808430464:0@lo:101: 00000100:00100000:3.0:1787367781.400012:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.400062:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832dfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367781.400858:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808430464 00000100:00100000:0.0:1787367781.400867:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808430464 00000100:00100000:0.0:1787367781.401001:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787367781.401012:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808430464:12345-0@lo:101: 00010000:00010000:0.0:1787367781.401053:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367781.401072:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03068b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.401098:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03068b expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.401110:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03068b expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367781.401119:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a200, rc 0) 00000100:00100000:0.0:1787367781.401180:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808430464:12345-0@lo:101: Request processed in 170us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.401187:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787367781.402037:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808430464:0@lo:101: 00010000:00010000:3.0:1787367781.402076:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.402087:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367781.402154:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808430592:0@lo:501: 00000100:00100000:3.0:1787367781.402189:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.402223:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54832dfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367781.402753:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808430592 00000100:00100000:1.0:1787367781.402759:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808430592 00000100:00100000:1.0:1787367781.402792:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787367781.402800:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808430592:12345-0@lo:501: 00000100:00100000:1.0:1787367781.402892:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808430592:12345-0@lo:501: Request processed in 82us (692us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367781.402910:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787367781.403173:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808430592:0@lo:501: 10000000:01000000:3.0:1787367781.403208:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787367781.403217:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367781.403228:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367781.406116:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367781.406137:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808430720:0@lo:13: 00000100:00100000:1.0:1787367781.406201:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787367781.406241:0:10007:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787367781.406274:0:10007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10007:1874190808430848:0@lo:7: 00000100:00100000:1.0:1787367781.406299:0:10007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.406324:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808430848 00000100:00100000:1.0:1787367781.406330:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808430848 00000100:00100000:1.0:1787367781.406402:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787367781.406411:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10007:x1874190808430848:12345-0@lo:7: 00000100:00100000:2.0:1787367781.408407:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808430720 00000100:00100000:2.0:1787367781.408416:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808430720 00000100:00100000:2.0:1787367781.408464:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787367781.408474:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874190808430720:12345-0@lo:13: 00002000:00000024:2.0:1787367781.408500:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:2.0:1787367781.408568:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874190808430720:12345-0@lo:13: Request processed in 95us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.408574:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787367781.408716:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e8700 x1874190808430720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367781.408736:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808430720:0@lo:13: 00000100:00080000:1.0:1787367781.409690:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367781.409711:0:10007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b180 going to sleep for 11 seconds 00000004:00080000:0.0:1787367781.419268:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:2.0:1787367781.421308:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787367781.421316:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787367781.421544:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10003:x1874190808428544:12345-0@lo:700: Request processed in 74681us (75534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.421560:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787367781.421668:0:10003:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc3100 x1874190808428544/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367781.421682:0:10003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10003:1874190808428544:0@lo:700: 00002000:00080000:0.0:1787367781.428122:0:8454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787367781.428130:0:8454:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787367781.428219:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10007:x1874190808430848:12345-0@lo:7: Request processed in 21805us (21915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367781.428230:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787367781.428958:0:10007:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836eb480 x1874190808430848/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367781.428973:0:10007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10007:1874190808430848:0@lo:7: 00000004:00080000:1.0:1787367781.428987:0:10007:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787367781.429020:0:10007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10007:1874190808430976:0@lo:5: 00000100:00100000:1.0:1787367781.429193:0:10007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.429231:0:10007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b180 going to sleep for 11 seconds 00000100:00100000:3.0:1787367781.429293:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808430976 00000100:00100000:3.0:1787367781.429300:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808430976 00000100:00100000:3.0:1787367781.429349:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787367781.429382:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10007:x1874190808430976:12345-0@lo:5: 00002000:00080000:3.0:1787367781.429405:0:8453:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787367781.429409:0:8453:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787367781.429708:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10007:x1874190808430976:12345-0@lo:5: Request processed in 327us (513us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787367781.429728:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787367781.429894:0:10007:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836eb480 x1874190808430976/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367781.429907:0:10007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10007:1874190808430976:0@lo:5: 00000004:00080000:1.0:1787367781.429916:0:10007:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787367781.430128:0:10007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10007:1874190808431104:0@lo:700: 00000100:00100000:1.0:1787367781.430154:0:10007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.430176:0:10007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367781.430223:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808431104 00000100:00100000:2.0:1787367781.430228:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808431104 00000100:00100000:2.0:1787367781.430263:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367781.430271:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10007:x1874190808431104:12345-0@lo:700: 00000004:00080000:2.0:1787367781.437554:0:10003:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787367781.437587:0:10003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10003:1874190808431360:0@lo:7: 00000100:00100000:2.0:1787367781.437666:0:10003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.437706:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808431360 00000100:00100000:2.0:1787367781.437713:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808431360 00000100:00100000:2.0:1787367781.437773:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367781.437781:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10003:x1874190808431360:12345-0@lo:7: 00000100:00100000:3.0:1787367781.438729:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367781.438746:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808431232:0@lo:13: 00000100:00100000:3.0:1787367781.438786:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.438831:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808431232 00000100:00100000:3.0:1787367781.438835:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808431232 00000100:00100000:3.0:1787367781.438867:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367781.438875:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808431232:12345-0@lo:13: 00002000:00000024:3.0:1787367781.438899:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:3.0:1787367781.438951:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808431232:12345-0@lo:13: Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.438959:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787367781.439068:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd688000 x1874190808431232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367781.439087:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808431232:0@lo:13: 00000100:00100000:1.0:1787367781.442389:0:10003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71ae40 going to sleep for 11 seconds 00002000:00080000:3.0:1787367781.462463:0:8925:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787367781.462473:0:8925:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787367781.463318:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10003:x1874190808431360:12345-0@lo:7: Request processed in 25532us (25646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.463330:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787367781.463532:0:10003:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd68ad80 x1874190808431360/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367781.463546:0:10003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10003:1874190808431360:0@lo:7: 00000004:00080000:1.0:1787367781.463559:0:10003:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787367781.463591:0:10003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10003:1874190808431488:0@lo:5: 00000100:00100000:1.0:1787367781.463865:0:10003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.463912:0:10003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787367781.466123:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808431488 00000100:00100000:3.0:1787367781.466134:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808431488 00000100:00100000:3.0:1787367781.466186:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787367781.466196:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10003:x1874190808431488:12345-0@lo:5: 00002000:00080000:3.0:1787367781.466223:0:8453:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787367781.466296:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10003:x1874190808431488:12345-0@lo:5: Request processed in 101us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.466318:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787367781.466565:0:10003:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836ebb80 x1874190808431488/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367781.466580:0:10003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10003:1874190808431488:0@lo:5: 00000004:00080000:1.0:1787367781.466592:0:10003:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787367781.466641:0:10003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10003:1874190808431616:0@lo:5: 00000100:00100000:1.0:1787367781.466672:0:10003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.466699:0:10003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787367781.466817:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808431616 00000100:00100000:3.0:1787367781.466822:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808431616 00000100:00100000:3.0:1787367781.466859:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787367781.466867:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10003:x1874190808431616:12345-0@lo:5: 00002000:00080000:3.0:1787367781.466903:0:8454:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:2.0:1787367781.474947:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787367781.475216:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10007:x1874190808431104:12345-0@lo:700: Request processed in 44940us (45055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367781.475227:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787367781.475315:0:10007:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e8380 x1874190808431104/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367781.475326:0:10007:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787367781.475340:0:10007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10007:1874190808431104:0@lo:700: 00000100:00100000:3.0:1787367781.481463:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10003:x1874190808431616:12345-0@lo:5: Request processed in 14590us (14782us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787367781.481477:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787367781.482654:0:10003:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836ebb80 x1874190808431616/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367781.482676:0:10003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10003:1874190808431616:0@lo:5: 00000004:00080000:2.0:1787367781.482691:0:10003:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787367781.482747:0:10003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10003:1874190808431744:0@lo:900: 00000100:00100000:2.0:1787367781.482797:0:10003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367781.515897:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808431744 00000100:00100000:2.0:1787367781.515911:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808431744 00000100:00100000:2.0:1787367781.515974:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367781.515985:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10003:x1874190808431744:12345-0@lo:900: 00000100:00100000:2.0:1787367781.516085:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10003:x1874190808431744:12345-0@lo:900: Request processed in 102us (33288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367781.516093:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:02000040:1.0:1787367781.516487:0:10007:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1787367781.528906:0:10007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10007:1874190808431872:0@lo:5: 00000100:00100000:1.0:1787367781.528969:0:10007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367781.529038:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808431872 00000100:00100000:1.0:1787367781.529044:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808431872 00000100:00100000:1.0:1787367781.529092:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787367781.529101:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10007:x1874190808431872:12345-0@lo:5: 00002000:00080000:1.0:1787367781.537855:0:8453:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787367781.537874:0:8453:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1787367781.539215:0:10003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71a0c0 going to sleep for 11 seconds 00010000:00080000:2.0:1787367781.539945:0:10003:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd688a80 x1874190808431744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367781.539961:0:10003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10003:1874190808431744:0@lo:900: 00000100:00100000:1.0:1787367781.558662:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10007:x1874190808431872:12345-0@lo:5: Request processed in 29555us (29685us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787367781.558675:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787367781.558754:0:10007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b600 going to sleep for 11 seconds 00010000:00080000:1.0:1787367781.558778:0:10007:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e8a80 x1874190808431872/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367781.558794:0:10007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10007:1874190808431872:0@lo:5: 00000004:00080000:1.0:1787367781.558807:0:10007:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:2.0:1787367781.568580:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1787367781.568599:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787367781.721492:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367781.794947:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808432000:0@lo:13: 00000100:00100000:3.0:1787367781.795016:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367781.795087:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808432000 00000100:00100000:3.0:1787367781.795094:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808432000 00000100:00100000:3.0:1787367781.795145:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787367781.795155:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808432000:12345-0@lo:13: 00002000:00000024:3.0:1787367781.795182:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367781.795292:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808432000:12345-0@lo:13: Request processed in 139us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367781.795299:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787367781.795336:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc0000 x1874190808432000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367781.795391:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808432000:0@lo:13: 00000100:00100000:1.0:1787367782.298211:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367782.298235:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808432128:0@lo:13: 00000100:00100000:1.0:1787367782.298296:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367782.298385:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808432128 00000100:00100000:1.0:1787367782.298403:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808432128 00000100:00100000:1.0:1787367782.298445:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787367782.298454:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808432128:12345-0@lo:13: 00002000:00000024:1.0:1787367782.298475:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367782.298515:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808432128:12345-0@lo:13: Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367782.298522:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787367782.298558:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836eb480 x1874190808432128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367782.298602:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808432128:0@lo:13: 00010000:00010000:1.0:1787367782.745904:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787367783.125489:0:10057:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787367783.125715:0:10057:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787367783.322501:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367783.322524:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808432256:0@lo:41: 00000100:00100000:1.0:1787367783.322589:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367783.322722:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808432256 00000100:00100000:2.0:1787367783.322729:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808432256 00000100:00100000:2.0:1787367783.322777:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787367783.322786:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808432256:12345-0@lo:41: 00000004:00000024:2.0:1787367783.322824:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367783.322885:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808432256:12345-0@lo:41: Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367783.322893:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787367783.323024:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808432256:0@lo:41: 00010000:00010000:2.0:1787367783.770326:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787367784.400792:0:10106:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787367784.400805:0:10106:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1787367784.792552:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367785.817054:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367786.048684:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367786.048791:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788460928 00000100:00100000:0.0:1787367786.048800:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788460928 00000100:00100000:0.0:1787367786.048927:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:0.0:1787367786.048935:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1874190788460928:12345-192.168.203.4@tcp:250: 00010000:00080000:0.0:1787367786.048960:0:6530:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 926ebb72-6750-4035-807e-0762300bea95@192.168.203.4@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:0.0:1787367786.048987:0:6530:0:(genops.c:1385:class_connect()) connect: client 926ebb72-6750-4035-807e-0762300bea95, cookie 0x66f5679bff030699 00000100:00080000:0.0:1787367786.049106:0:6530:0:(import.c:65:import_set_state_nolock()) ffff9c548372b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367786.049169:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+5:2401:x1874190788460928:12345-192.168.203.4@tcp:250: Request processed in 233us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367786.049389:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:2.0:1787367786.053198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367786.053421:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788460800 00000100:00100000:0.0:1787367786.053430:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788460800 00000100:00100000:0.0:1787367786.053485:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:0.0:1787367786.053495:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+5:6172:x1874190788460800:12345-192.168.203.4@tcp:101: 00010000:00010000:0.0:1787367786.053512:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367786.053529:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e55a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367786.053557:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e55a expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367786.053569:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e55a expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367786.053578:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a400, rc 0) 00000100:00100000:0.0:1787367786.053636:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+6:6172:x1874190788460800:12345-192.168.203.4@tcp:101: Request processed in 142us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367786.053643:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:2.0:1787367786.060446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367786.060589:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788461056 00000100:00100000:1.0:1787367786.060598:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788461056 00000100:00100000:1.0:1787367786.060657:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:1.0:1787367786.060666:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+6:6172:x1874190788461056:12345-192.168.203.4@tcp:501: 00000100:00100000:1.0:1787367786.060778:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+6:6172:x1874190788461056:12345-192.168.203.4@tcp:501: Request processed in 112us (341us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367786.060785:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:3.0:1787367786.063665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367786.063754:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788461184 00000100:00100000:1.0:1787367786.063762:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788461184 00000100:00100000:1.0:1787367786.063811:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:1.0:1787367786.063821:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+6:6172:x1874190788461184:12345-192.168.203.4@tcp:101: 00010000:00010000:1.0:1787367786.063834:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367786.063927:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e561 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367786.063957:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e561 expref: 7 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367786.063988:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e561 expref: 7 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367786.064161:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673200, rc 0) 00000100:00100000:1.0:1787367786.064326:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+7:6172:x1874190788461184:12345-192.168.203.4@tcp:101: Request processed in 505us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367786.064332:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:2.0:1787367786.069592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367786.069929:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788461312 00000100:00100000:1.0:1787367786.069939:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788461312 00000100:00100000:1.0:1787367786.070288:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 183 00000100:00100000:1.0:1787367786.070302:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+7:6172:x1874190788461312:12345-192.168.203.4@tcp:501: 00000100:00100000:1.0:1787367786.070987:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+8:6172:x1874190788461312:12345-192.168.203.4@tcp:501: Request processed in 686us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367786.071010:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 183 00000100:00100000:2.0:1787367786.080725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367786.080816:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788461440 00000100:00100000:0.0:1787367786.080837:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788461440 00000100:00100000:0.0:1787367786.080968:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:0.0:1787367786.080979:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+8:6172:x1874190788461440:12345-192.168.203.4@tcp:503: 00000100:00100000:0.0:1787367786.081126:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+8:6172:x1874190788461440:12345-192.168.203.4@tcp:503: Request processed in 147us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367786.081134:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:3.0:1787367786.086437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367786.091168:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788461568 00000100:00100000:1.0:1787367786.091241:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788461568 00000100:00100000:1.0:1787367786.091386:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:1.0:1787367786.091398:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+8:6191:x1874190788461568:12345-192.168.203.4@tcp:502: 00000100:00100000:1.0:1787367786.091554:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+8:6191:x1874190788461568:12345-192.168.203.4@tcp:502: Request processed in 157us (5124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367786.091562:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:2.0:1787367786.140502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367786.140622:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788461696 00000100:00100000:3.0:1787367786.140631:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788461696 00000100:00100000:3.0:1787367786.140690:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:3.0:1787367786.140701:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+8:6191:x1874190788461696:12345-192.168.203.4@tcp:502: 00000100:00100000:3.0:1787367786.141008:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+8:6191:x1874190788461696:12345-192.168.203.4@tcp:502: Request processed in 308us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367786.141017:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:2.0:1787367786.164968:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367786.165089:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788461824 00000100:00100000:1.0:1787367786.165099:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788461824 00000100:00100000:1.0:1787367786.165158:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:1.0:1787367786.165169:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+8:6172:x1874190788461824:12345-192.168.203.4@tcp:101: 00010000:00010000:1.0:1787367786.165194:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367786.165211:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673800/0x66f5679bff0306ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e592 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367786.165239:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673800/0x66f5679bff0306ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e592 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367786.165250:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673800/0x66f5679bff0306ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e592 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367786.165260:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673800, rc 0) 00000100:00100000:1.0:1787367786.165320:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+9:6172:x1874190788461824:12345-192.168.203.4@tcp:101: Request processed in 153us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367786.165327:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:1.0:1787367786.169150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367786.170751:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788461952 00000100:00100000:0.0:1787367786.170762:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788461952 00000100:00100000:0.0:1787367786.170823:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:0.0:1787367786.170833:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+9:6172:x1874190788461952:12345-192.168.203.4@tcp:256: 20000000:01000000:0.0:1787367786.170921:0:6533:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787367786.170943:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787367786.170946:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787367786.170950:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787367786.170952:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787367786.170955:0:6533:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787367786.178275:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+9:6172:x1874190788461952:12345-192.168.203.4@tcp:256: Request processed in 7434us (9123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367786.178288:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:2.0:1787367786.182104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367786.182295:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788462080 00000100:00100000:3.0:1787367786.182304:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788462080 00000100:00100000:3.0:1787367786.182388:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:3.0:1787367786.182399:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+9:6172:x1874190788462080:12345-192.168.203.4@tcp:101: 00010000:00010000:3.0:1787367786.182415:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367786.182431:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e599 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367786.182459:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e599 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367786.182471:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e599 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367786.182480:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2174c00, rc 0) 00000100:00100000:3.0:1787367786.182534:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:6172:x1874190788462080:12345-192.168.203.4@tcp:101: Request processed in 137us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367786.182541:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:1.0:1787367786.184513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367786.184594:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788462208 00000100:00100000:0.0:1787367786.184601:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788462208 00000100:00100000:0.0:1787367786.184686:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:0.0:1787367786.184697:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:6172:x1874190788462208:12345-192.168.203.4@tcp:501: 00000100:00100000:0.0:1787367786.184826:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:6172:x1874190788462208:12345-192.168.203.4@tcp:501: Request processed in 130us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367786.184834:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:2.0:1787367786.195432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367786.195602:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788462336 00000100:00100000:1.0:1787367786.195611:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788462336 00000100:00100000:1.0:1787367786.195663:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:1.0:1787367786.195672:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:6172:x1874190788462336:12345-192.168.203.4@tcp:503: 00000100:00100000:1.0:1787367786.195806:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:6172:x1874190788462336:12345-192.168.203.4@tcp:503: Request processed in 134us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367786.195814:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:2.0:1787367786.204089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367786.207974:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788462464 00000100:00100000:1.0:1787367786.207986:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788462464 00000100:00100000:1.0:1787367786.208047:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:1.0:1787367786.208057:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:6196:x1874190788462464:12345-192.168.203.4@tcp:502: 00000100:00100000:1.0:1787367786.208210:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:6196:x1874190788462464:12345-192.168.203.4@tcp:502: Request processed in 153us (4130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367786.208218:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:2.0:1787367786.214660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367786.214814:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788462592 00000100:00100000:0.0:1787367786.214835:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788462592 00000100:00100000:0.0:1787367786.214895:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:0.0:1787367786.214905:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:6196:x1874190788462592:12345-192.168.203.4@tcp:502: 00000100:00100000:0.0:1787367786.215032:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:6196:x1874190788462592:12345-192.168.203.4@tcp:502: Request processed in 128us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367786.215040:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:2.0:1787367786.225113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367786.225180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367786.225277:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788462720 00000100:00100000:3.0:1787367786.225287:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788462720 00000100:00100000:3.0:1787367786.225326:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788462976 00000100:00100000:3.0:1787367786.225341:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788462976 00000100:00100000:3.0:1787367786.225386:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1787367786.225394:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874190788462720:12345-192.168.203.4@tcp:38: 00010000:00080000:3.0:1787367786.225420:0:6539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:3.0:1787367786.225462:0:6539:0:(genops.c:1385:class_connect()) connect: client 6033427c-dc64-421a-b37f-d4458dbaa527, cookie 0x66f5679bff0306bc 00000004:00100000:3.0:1787367786.225488:0:6539:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787367786.225688:0:6539:0:(import.c:65:import_set_state_nolock()) ffff9c54830c5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367786.225755:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2401:x1874190788462720:12345-192.168.203.4@tcp:38: Request processed in 350us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367786.225762:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1787367786.225779:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1787367786.225783:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874190788462976:12345-192.168.203.4@tcp:38: 00010000:00080000:3.0:1787367786.225796:0:6539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:3.0:1787367786.225857:0:6539:0:(genops.c:1385:class_connect()) connect: client 6033427c-dc64-421a-b37f-d4458dbaa527, cookie 0x66f5679bff0306c3 00000004:00100000:3.0:1787367786.225869:0:6539:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787367786.226096:0:6539:0:(import.c:65:import_set_state_nolock()) ffff9c5481bca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367786.226122:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2401:x1874190788462976:12345-192.168.203.4@tcp:38: Request processed in 337us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367786.226129:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1787367786.395957:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367786.395996:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808432384:0@lo:41: 00000100:00100000:0.0:1787367786.396068:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367786.396261:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808432384 00000100:00100000:3.0:1787367786.396268:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808432384 00000100:00100000:3.0:1787367786.396316:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787367786.396324:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808432384:12345-0@lo:41: 00000004:00000024:3.0:1787367786.396371:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787367786.396414:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808432384:12345-0@lo:41: Request processed in 90us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367786.396435:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787367786.396710:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808432640:0@lo:400: 00000100:00100000:2.0:1787367786.396739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.396756:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808433152:0@lo:400: 00000100:00100000:2.0:1787367786.396772:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.396783:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808433664:0@lo:400: 00000100:00100000:2.0:1787367786.396805:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.396832:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787367786.396838:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808432512:0@lo:400: 00000100:00100000:2.0:1787367786.396870:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.396888:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808433024:0@lo:400: 00000100:00100000:2.0:1787367786.396916:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.396930:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808433536:0@lo:400: 00000100:00100000:2.0:1787367786.396948:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.396965:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808432640 00000100:00100000:2.0:1787367786.396968:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808432640 00000100:00100000:2.0:1787367786.397004:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808433152 00000100:00100000:2.0:1787367786.397006:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808433152 00000100:00100000:2.0:1787367786.397023:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808433664 00000100:00100000:2.0:1787367786.397025:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808433664 00000100:00100000:2.0:1787367786.397034:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808433024 00000100:00100000:2.0:1787367786.397036:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808433024 00000100:00100000:2.0:1787367786.397046:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808433536 00000100:00100000:2.0:1787367786.397061:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808433536 00000100:00100000:2.0:1787367786.397082:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787367786.397090:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808432640:12345-0@lo:400: 00000100:00100000:1.0:1787367786.397092:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808432896:0@lo:400: 00000100:00100000:2.0:1787367786.397140:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808432640:12345-0@lo:400: Request processed in 51us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367786.397141:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.397151:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787367786.397165:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808433408:0@lo:400: 00000100:00100000:2.0:1787367786.397169:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787367786.397178:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808433152:12345-0@lo:400: 00000100:00100000:3.0:1787367786.397239:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808432896 00000100:00100000:3.0:1787367786.397242:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808432896 00000100:00100000:3.0:1787367786.397262:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787367786.397268:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808432896:12345-0@lo:400: 00000100:00100000:0.0:1787367786.397321:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787367786.397329:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808433664:12345-0@lo:400: 00000100:00100000:2.0:1787367786.403126:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808433152:12345-0@lo:400: Request processed in 5939us (6341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367786.403141:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787367786.403175:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787367786.403188:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808433024:12345-0@lo:400: 00000100:00100000:2.0:1787367786.403236:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808433024:12345-0@lo:400: Request processed in 53us (6319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367786.403242:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787367786.403255:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787367786.403262:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808433536:12345-0@lo:400: 00000100:00100000:2.0:1787367786.403290:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808433536:12345-0@lo:400: Request processed in 30us (6342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367786.403296:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787367786.403348:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6041f80 x1874190808433024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367786.403381:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808433024:0@lo:400: 00010000:00080000:2.0:1787367786.403395:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6042680 x1874190808433536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367786.403423:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808433536:0@lo:400: 00010000:00080000:2.0:1787367786.403436:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc510e00 x1874190808432640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367786.403445:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808432640:0@lo:400: 00010000:00080000:2.0:1787367786.403455:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6041180 x1874190808433152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367786.403463:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808433152:0@lo:400: 00000100:00100000:2.0:1787367786.403522:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808432512 00000100:00100000:2.0:1787367786.403528:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808432512 00000100:00100000:2.0:1787367786.403570:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787367786.403577:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808432512:12345-0@lo:400: 00000100:00100000:2.0:1787367786.403614:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808432512:12345-0@lo:400: Request processed in 38us (6742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367786.403620:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787367786.403655:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808432512:0@lo:400: 00000100:00100000:1.0:1787367786.403664:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.403700:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808432768:0@lo:400: 00000100:00100000:2.0:1787367786.403731:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.403753:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808433280:0@lo:400: 00000100:00100000:2.0:1787367786.403778:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808432768 00000100:00100000:2.0:1787367786.403782:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808432768 00000100:00100000:2.0:1787367786.403804:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787367786.403810:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808432768:12345-0@lo:400: 00000100:00100000:1.0:1787367786.403844:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808433920:0@lo:400: 00000100:00100000:2.0:1787367786.403864:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808432768:12345-0@lo:400: Request processed in 53us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367786.403879:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787367786.403901:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787367786.403933:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367786.403939:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787367786.403945:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808433408 00000100:00100000:1.0:1787367786.403950:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808433408 00000100:00100000:1.0:1787367786.403980:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808433920 00000100:00100000:1.0:1787367786.403982:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808433920 00000100:00100000:1.0:1787367786.403998:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787367786.404004:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808433408:12345-0@lo:400: 00000100:00100000:2.0:1787367786.404043:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787367786.404054:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808433920:12345-0@lo:400: 00000100:00100000:2.0:1787367786.404088:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808433920:12345-0@lo:400: Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367786.404093:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787367786.404119:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367786.404122:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367786.404129:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.404146:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808433792:0@lo:400: 00000100:00100000:2.0:1787367786.404165:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367786.404193:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808432384:0@lo:41: 00010000:00080000:2.0:1787367786.404212:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc513100 x1874190808432768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367786.404221:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808432768:0@lo:400: 00000100:00100000:2.0:1787367786.404234:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808433280 00000100:00100000:2.0:1787367786.404237:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808433280 00000100:00100000:2.0:1787367786.404257:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808433792 00000100:00100000:2.0:1787367786.404260:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808433792 00000100:00100000:2.0:1787367786.404272:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787367786.404277:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808433280:12345-0@lo:400: 00000100:00100000:2.0:1787367786.404305:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808433280:12345-0@lo:400: Request processed in 28us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367786.404310:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787367786.404327:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367786.404332:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808433792:12345-0@lo:400: 00000100:00100000:2.0:1787367786.404379:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808433792:12345-0@lo:400: Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367786.404384:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787367786.404395:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367786.404397:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787367786.404412:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6040000 x1874190808433280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367786.404421:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808433280:0@lo:400: 00010000:00080000:2.0:1787367786.404429:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6043100 x1874190808433792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367786.404436:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787367786.404444:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808433792:0@lo:400: 00010000:00080000:2.0:1787367786.404480:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6040e00 x1874190808433408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367786.404488:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808433408:0@lo:400: 00010000:00080000:2.0:1787367786.404496:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6040700 x1874190808433920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367786.404503:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787367786.404509:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808433920:0@lo:400: 00000100:00100000:1.0:1787367786.404630:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808433408:12345-0@lo:400: Request processed in 39us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367786.404639:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367786.406385:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808432896:12345-0@lo:400: Request processed in 9111us (9240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367786.406396:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787367786.406690:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808433664:12345-0@lo:400: Request processed in 9361us (9883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367786.406698:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787367786.406829:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6041500 x1874190808433664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367786.406841:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808433664:0@lo:400: 00000100:00100000:2.0:1787367786.407523:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808432896:0@lo:400: 00010000:00010000:2.0:1787367786.847087:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367786.904555:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367786.904594:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808434048:0@lo:13: 00000100:00100000:2.0:1787367786.904683:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367786.904790:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808434048 00000100:00100000:1.0:1787367786.904797:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808434048 00000100:00100000:1.0:1787367786.904861:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787367786.904870:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808434048:12345-0@lo:13: 00002000:00000024:1.0:1787367786.904895:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367786.904957:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808434048:12345-0@lo:13: Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367786.904964:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787367786.905418:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62ed80 x1874190808434048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367786.905436:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808434048:0@lo:13: 00000100:00100000:0.0:1787367786.905817:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367786.905828:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808434304:0@lo:13: 00000100:00100000:0.0:1787367786.905871:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367786.905910:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808434304 00000100:00100000:0.0:1787367786.905914:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808434304 00000100:00100000:0.0:1787367786.905943:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787367786.905950:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808434304:12345-0@lo:13: 00002000:00000024:0.0:1787367786.905966:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367786.906151:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808434304:12345-0@lo:13: Request processed in 200us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367786.906176:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787367786.906205:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836b8e00 x1874190808434304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367786.906219:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808434304:0@lo:13: 00000100:00100000:3.0:1787367786.906402:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367786.906413:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808434176:0@lo:13: 00000100:00100000:3.0:1787367786.906444:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367786.906884:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808434176 00000100:00100000:0.0:1787367786.906889:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808434176 00000100:00100000:0.0:1787367786.906968:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787367786.906976:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808434176:12345-0@lo:13: 00002000:00000024:0.0:1787367786.906997:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367786.907040:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808434176:12345-0@lo:13: Request processed in 65us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367786.907047:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787367786.907100:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62df80 x1874190808434176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367786.907113:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808434176:0@lo:13: 00000100:00100000:2.0:1787367787.239474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367787.239519:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367787.239610:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788463104 00000100:00100000:0.0:1787367787.239619:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788463104 00000100:00100000:0.0:1787367787.239689:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788463232 00000100:00100000:0.0:1787367787.239693:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788463232 00000100:00100000:0.0:1787367787.239719:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1787367787.239728:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:0:x1874190788463104:12345-192.168.203.4@tcp:41: 00000004:00000024:0.0:1787367787.239775:0:9404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787367787.239826:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:0:x1874190788463104:12345-192.168.203.4@tcp:41: Request processed in 98us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367787.239833:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1787367787.239860:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1787367787.239867:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:6172:x1874190788463232:12345-192.168.203.4@tcp:41: 00000004:00000024:0.0:1787367787.239881:0:9404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787367787.239920:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:6172:x1874190788463232:12345-192.168.203.4@tcp:41: Request processed in 53us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367787.239926:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00080000:2.0:1787367787.240195:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367787.240199:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367787.246103:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367787.246312:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788462848 00000100:00100000:0.0:1787367787.246321:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788462848 00000100:00100000:0.0:1787367787.246407:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1787367787.246418:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:0:x1874190788462848:12345-192.168.203.4@tcp:41: 00000004:00000024:0.0:1787367787.246449:0:9404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787367787.246516:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:0:x1874190788462848:12345-192.168.203.4@tcp:41: Request processed in 99us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367787.246524:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1787367787.254802:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367787.254942:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788463360 00000100:00100000:1.0:1787367787.254951:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788463360 00000100:00100000:1.0:1787367787.255013:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1787367787.255024:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:6172:x1874190788463360:12345-192.168.203.4@tcp:40: 00000100:00100000:1.0:1787367787.255105:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:6172:x1874190788463360:12345-192.168.203.4@tcp:40: Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367787.255113:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1787367787.262795:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367787.262849:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367787.262886:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367787.263022:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788463488 00000100:00100000:3.0:1787367787.263032:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788463488 00000100:00100000:3.0:1787367787.263071:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788463616 00000100:00100000:3.0:1787367787.263075:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788463616 00000100:00100000:3.0:1787367787.263095:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1787367787.263102:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874190788463488:12345-192.168.203.4@tcp:8: 00010000:00080000:3.0:1787367787.263132:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1787367787.263175:0:8453:0:(genops.c:1385:class_connect()) connect: client 6033427c-dc64-421a-b37f-d4458dbaa527, cookie 0x66f5679bff0306ca 00002000:00100000:3.0:1787367787.263187:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6033427c-dc64-421a-b37f-d4458dbaa527/ffff9c5481bc9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787367787.263197:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787367787.263417:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787367787.263446:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c5481bce000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367787.263515:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2401:x1874190788463488:12345-192.168.203.4@tcp:8: Request processed in 409us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367787.263525:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1787367787.263543:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1787367787.263547:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874190788463616:12345-192.168.203.4@tcp:8: 00010000:00080000:3.0:1787367787.263563:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1787367787.263593:0:8453:0:(genops.c:1385:class_connect()) connect: client 6033427c-dc64-421a-b37f-d4458dbaa527, cookie 0x66f5679bff0306d1 00002000:00100000:3.0:1787367787.263599:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6033427c-dc64-421a-b37f-d4458dbaa527/ffff9c55bd5d6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787367787.263604:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787367787.263745:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787367787.263760:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c55bd5d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367787.263785:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2401:x1874190788463616:12345-192.168.203.4@tcp:8: Request processed in 236us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367787.263791:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1787367787.264434:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788463744 00000100:00100000:2.0:1787367787.264441:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788463744 00000100:00100000:2.0:1787367787.264489:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1787367787.264496:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6033427c-dc64-421a-b37f-d4458dbaa527+6:6172:x1874190788463744:12345-192.168.203.4@tcp:900: 00000100:00100000:2.0:1787367787.264543:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6033427c-dc64-421a-b37f-d4458dbaa527+6:6172:x1874190788463744:12345-192.168.203.4@tcp:900: Request processed in 48us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367787.264550:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1787367787.264744:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367787.265486:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788463872 00000100:00100000:1.0:1787367787.265491:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788463872 00000100:00100000:1.0:1787367787.265529:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:1.0:1787367787.265537:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:2404:x1874190788463872:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1787367787.265578:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:2404:x1874190788463872:12345-192.168.203.4@tcp:400: Request processed in 41us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367787.265585:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:3.0:1787367787.266413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367787.266488:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788464000 00000100:00100000:2.0:1787367787.266493:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788464000 00000100:00100000:2.0:1787367787.266533:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1787367787.266541:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:6172:x1874190788464000:12345-192.168.203.4@tcp:33: 00000004:00080000:1.0:1787367787.311043:0:6541:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 44428us 00000004:00200000:1.0:1787367787.338308:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787367787.338446:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:6172:x1874190788464000:12345-192.168.203.4@tcp:33: Request processed in 71898us (72028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367787.338473:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1787367787.416632:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808434432:0@lo:13: 00000100:00100000:0.0:1787367787.416703:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367787.417057:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808434432 00000100:00100000:1.0:1787367787.417064:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808434432 00000100:00100000:1.0:1787367787.417106:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787367787.417116:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808434432:12345-0@lo:13: 00002000:00000024:1.0:1787367787.417135:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367787.417214:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808434432:12345-0@lo:13: Request processed in 98us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367787.417222:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787367787.417859:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62e680 x1874190808434432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367787.417879:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808434432:0@lo:13: 00000100:00100000:3.0:1787367787.565413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367787.565528:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788464128 00000100:00100000:0.0:1787367787.565538:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788464128 00000100:00100000:0.0:1787367787.565615:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1787367787.565626:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:6214:x1874190788464128:12345-192.168.203.4@tcp:101: 00010000:00010000:0.0:1787367787.565645:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367787.565717:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff0306d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e5ca expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367787.565789:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0306df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367787.565803:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0306df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367787.565815:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0306df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367787.565886:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787367787.565890:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367787.565912:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0306df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367787.565939:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff0306d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5ca expref: 8 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367787.565960:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0306df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5ca expref: 7 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367787.565968:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787367787.565971:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367787.565974:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b400, rc 0) 00000100:00100000:0.0:1787367787.566046:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:6214:x1874190788464128:12345-192.168.203.4@tcp:101: Request processed in 421us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367787.566054:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00010000:00010000:3.0:1787367787.864554:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367788.442284:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367788.442310:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808434560:0@lo:41: 00000100:00100000:0.0:1787367788.442410:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367788.443680:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808434560 00000100:00100000:2.0:1787367788.443692:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808434560 00000100:00100000:2.0:1787367788.443758:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787367788.443768:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808434560:12345-0@lo:41: 00000004:00000024:2.0:1787367788.443805:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367788.443888:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808434560:12345-0@lo:41: Request processed in 122us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367788.443909:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787367788.444107:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808434560:0@lo:41: 00010000:00010000:1.0:1787367788.888577:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367789.422549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367789.424848:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788464256 00000100:00100000:1.0:1787367789.424862:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788464256 00000100:00100000:1.0:1787367789.424955:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1787367789.424966:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:6267:x1874190788464256:12345-192.168.203.4@tcp:41: 00000004:00000024:1.0:1787367789.425015:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787367789.425092:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:6267:x1874190788464256:12345-192.168.203.4@tcp:41: Request processed in 118us (2541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367789.425100:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00080000:2.0:1787367789.425175:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367789.444408:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367789.445007:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788464384 00000100:00100000:0.0:1787367789.445015:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788464384 00000100:00100000:0.0:1787367789.445122:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1787367789.445132:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:6267:x1874190788464384:12345-192.168.203.4@tcp:41: 00000004:00000024:0.0:1787367789.445187:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787367789.445255:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:6267:x1874190788464384:12345-192.168.203.4@tcp:41: Request processed in 124us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367789.445262:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00080000:2.0:1787367789.445307:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367789.459498:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367789.459813:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788464512 00000100:00100000:1.0:1787367789.459831:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788464512 00000100:00100000:1.0:1787367789.459907:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1787367789.459917:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6033427c-dc64-421a-b37f-d4458dbaa527+6:6267:x1874190788464512:12345-192.168.203.4@tcp:13: 00002000:00000024:1.0:1787367789.459948:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787367789.460067:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367789.460399:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6033427c-dc64-421a-b37f-d4458dbaa527+6:6267:x1874190788464512:12345-192.168.203.4@tcp:13: Request processed in 482us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367789.460407:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1787367789.467536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367789.467795:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788464640 00000100:00100000:1.0:1787367789.467805:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788464640 00000001:00100000:2.0:1787367789.467822:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000100:00100000:1.0:1787367789.467879:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1787367789.468025:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6033427c-dc64-421a-b37f-d4458dbaa527+5:6267:x1874190788464640:12345-192.168.203.4@tcp:13: 00002000:00000024:1.0:1787367789.468055:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787367789.468096:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367789.468121:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6033427c-dc64-421a-b37f-d4458dbaa527+5:6267:x1874190788464640:12345-192.168.203.4@tcp:13: Request processed in 233us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367789.468140:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00010000:00010000:2.0:1787367789.921302:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367790.937589:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367791.512983:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808434816:0@lo:400: 00000100:00100000:0.0:1787367791.513056:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367791.513111:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808435328:0@lo:400: 00000100:00100000:0.0:1787367791.513136:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367791.513165:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808435840:0@lo:400: 00000100:00100000:3.0:1787367791.513181:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808434688:0@lo:400: 00000100:00100000:0.0:1787367791.513189:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367791.513228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367791.513239:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787367791.513246:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808434944:0@lo:400: 00000100:00100000:0.0:1787367791.513271:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367791.513290:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808435456:0@lo:400: 00000100:00100000:0.0:1787367791.513309:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367791.513325:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808435968:0@lo:400: 00000100:00100000:0.0:1787367791.513345:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367791.513419:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808435200:0@lo:400: 00000100:00100000:3.0:1787367791.513445:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367791.513462:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808435712:0@lo:400: 00000100:00100000:3.0:1787367791.513554:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367791.513573:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808436224:0@lo:400: 00000100:00100000:3.0:1787367791.513594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367791.513613:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787367791.513619:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808435072:0@lo:400: 00000100:00100000:3.0:1787367791.513639:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367791.513650:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808435584:0@lo:400: 00000100:00100000:0.0:1787367791.513722:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808434816 00000100:00100000:0.0:1787367791.513730:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808434816 00000100:00100000:3.0:1787367791.513737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367791.513768:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808435328 00000100:00100000:0.0:1787367791.513771:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808435328 00000100:00100000:0.0:1787367791.513792:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808435840 00000100:00100000:0.0:1787367791.513795:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808435840 00000100:00100000:0.0:1787367791.513806:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808435456 00000100:00100000:3.0:1787367791.513831:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808436096:0@lo:400: 00000100:00100000:3.0:1787367791.513853:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367791.513878:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808435712 00000100:00100000:3.0:1787367791.513882:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808435712 00000100:00100000:3.0:1787367791.513904:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808436224 00000100:00100000:3.0:1787367791.513907:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808436224 00000100:00100000:3.0:1787367791.513917:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808435584 00000100:00100000:3.0:1787367791.513919:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808435584 00000100:00100000:3.0:1787367791.513929:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808436096 00000100:00100000:3.0:1787367791.513932:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808436096 00000100:00100000:3.0:1787367791.513944:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787367791.513952:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808435712:12345-0@lo:400: 00000100:00100000:3.0:1787367791.514011:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808435712:12345-0@lo:400: Request processed in 60us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367791.514029:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787367791.514045:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787367791.514052:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808436224:12345-0@lo:400: 00000100:00100000:3.0:1787367791.514081:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808436224:12345-0@lo:400: Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367791.514087:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787367791.514098:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367791.514103:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808435584:12345-0@lo:400: 00000100:00100000:3.0:1787367791.514126:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808435584:12345-0@lo:400: Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367791.514131:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367791.514140:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367791.514146:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808436096:12345-0@lo:400: 00000100:00100000:3.0:1787367791.514167:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808436096:12345-0@lo:400: Request processed in 22us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367791.514172:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787367791.514683:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808435968 00000100:00100000:1.0:1787367791.514688:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808435968 00000100:00100000:1.0:1787367791.514711:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808435072 00000100:00100000:1.0:1787367791.514715:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808435072 00000100:00100000:1.0:1787367791.514729:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787367791.514736:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808434816:12345-0@lo:400: 00000100:00100000:1.0:1787367791.514777:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808434816:12345-0@lo:400: Request processed in 41us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367791.514784:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787367791.514797:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787367791.514804:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808435328:12345-0@lo:400: 00000100:00100000:1.0:1787367791.514842:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808435328:12345-0@lo:400: Request processed in 39us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367791.514848:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787367791.514859:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787367791.514865:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808435840:12345-0@lo:400: 00000100:00100000:1.0:1787367791.514890:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808435840:12345-0@lo:400: Request processed in 25us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367791.514895:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787367791.514905:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787367791.514910:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808435968:12345-0@lo:400: 00000100:00100000:1.0:1787367791.514935:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808435968:12345-0@lo:400: Request processed in 25us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367791.514941:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787367791.514952:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787367791.514966:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808435072:12345-0@lo:400: 00000100:00100000:1.0:1787367791.514999:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808435072:12345-0@lo:400: Request processed in 33us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367791.515006:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787367791.515030:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367791.515041:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808436352:0@lo:41: 00000100:00100000:3.0:1787367791.515048:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808435072:0@lo:400: 00010000:00080000:3.0:1787367791.515064:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa74e00 x1874190808435584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367791.515075:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808435584:0@lo:400: 00010000:00080000:3.0:1787367791.515090:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa74700 x1874190808436096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367791.515091:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367791.515104:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808436096:0@lo:400: 00010000:00080000:3.0:1787367791.515120:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa76680 x1874190808435712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367791.515131:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808434944 00000100:00100000:1.0:1787367791.515137:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808434944 00000100:00100000:3.0:1787367791.515138:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808435712:0@lo:400: 00010000:00080000:3.0:1787367791.515155:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa75880 x1874190808436224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367791.515160:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808435200 00000100:00100000:1.0:1787367791.515165:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808435200 00000100:00100000:3.0:1787367791.515166:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808436224:0@lo:400: 00000100:00100000:1.0:1787367791.515180:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808436352 00000100:00100000:1.0:1787367791.515185:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808436352 00000100:00100000:3.0:1787367791.515237:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787367791.515495:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808434944:12345-0@lo:400: 00000100:00100000:3.0:1787367791.515533:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808434944:12345-0@lo:400: Request processed in 289us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367791.515911:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808434688 00000100:00100000:2.0:1787367791.515917:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808434688 00000100:00100000:3.0:1787367791.515930:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787367791.515954:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787367791.515957:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787367791.515965:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808434688:12345-0@lo:400: 00000100:00100000:2.0:1787367791.516010:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808434688:12345-0@lo:400: Request processed in 45us (2783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367791.516018:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808435200:12345-0@lo:400: 00000100:00100000:2.0:1787367791.516019:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787367791.516058:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787367791.516062:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808435200:12345-0@lo:400: Request processed in 46us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367791.516071:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808436352:12345-0@lo:41: 00000100:00100000:3.0:1787367791.516072:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00000024:2.0:1787367791.516101:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787367791.516144:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808436352:12345-0@lo:41: Request processed in 77us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367791.516150:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787367791.516529:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808435456 00000001:00100000:3.0:1787367791.516569:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000100:00100000:0.0:1787367791.516571:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787367791.516583:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808435456:12345-0@lo:400: 00000100:00100000:0.0:1787367791.516622:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808435456:12345-0@lo:400: Request processed in 42us (3311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367791.516628:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787367791.516648:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367791.516652:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367791.516656:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367791.516658:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367791.516702:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808434688:0@lo:400: 00000100:00100000:0.0:1787367791.516717:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808434944:0@lo:400: 00000100:00100000:3.0:1787367791.516721:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808435200:0@lo:400: 00010000:00080000:0.0:1787367791.516740:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa74000 x1874190808435456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367791.516752:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808435456:0@lo:400: 00010000:00080000:0.0:1787367791.516765:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa77100 x1874190808435968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367791.516772:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808435968:0@lo:400: 00000100:00100000:0.0:1787367791.516784:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808434816:0@lo:400: 00000100:00100000:0.0:1787367791.516795:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808435328:0@lo:400: 00000100:00100000:0.0:1787367791.516807:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808435840:0@lo:400: 00000100:00100000:3.0:1787367791.517109:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808436352:0@lo:41: 00000001:00100000:2.0:1787367791.524457:0:6517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00010000:00010000:1.0:1787367791.962328:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367792.024657:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808436480:0@lo:13: 00000100:00100000:2.0:1787367792.024778:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808436608:0@lo:13: 00000100:00100000:0.0:1787367792.024859:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367792.024864:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808436736:0@lo:13: 00000100:00100000:2.0:1787367792.024930:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367792.027849:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808436480 00000100:00100000:0.0:1787367792.027862:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808436480 00000100:00100000:2.0:1787367792.027887:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367792.027967:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808436736 00000100:00100000:0.0:1787367792.027978:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808436736 00000100:00100000:0.0:1787367792.027993:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808436608 00000100:00100000:0.0:1787367792.027996:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808436608 00000100:00100000:0.0:1787367792.028010:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787367792.028018:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808436480:12345-0@lo:13: 00002000:00000024:0.0:1787367792.028048:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367792.030310:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808436480:12345-0@lo:13: Request processed in 2286us (5445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367792.030322:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787367792.030368:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787367792.030383:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808436736:12345-0@lo:13: 00002000:00000024:0.0:1787367792.030410:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367792.030467:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808436736:12345-0@lo:13: Request processed in 92us (5538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367792.030473:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787367792.030486:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367792.030493:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808436608:12345-0@lo:13: 00002000:00000024:0.0:1787367792.030523:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367792.030556:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808436608:12345-0@lo:13: Request processed in 64us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367792.030562:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787367792.030973:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa75500 x1874190808436480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367792.030995:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808436480:0@lo:13: 00010000:00080000:2.0:1787367792.031095:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6043480 x1874190808436608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367792.031134:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808436608:0@lo:13: 00010000:00080000:2.0:1787367792.031268:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482073100 x1874190808436736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367792.031281:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808436736:0@lo:13: 00000001:02000400:1.0:1787367792.340286:0:10204:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787367792.456891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367792.456933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367792.456958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367792.456977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367792.457007:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367792.457029:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788465024 00000100:00100000:0.0:1787367792.457029:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788464768 00000100:00100000:1.0:1787367792.457037:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788465024 00000100:00100000:0.0:1787367792.457040:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788464768 00000100:00100000:1.0:1787367792.457073:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788464896 00000100:00100000:1.0:1787367792.457076:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788464896 00000100:00100000:0.0:1787367792.457077:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00100000:0.0:1787367792.457084:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:2404:x1874190788464768:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1787367792.457094:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:1.0:1787367792.457100:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788465024:12345-192.168.203.4@tcp:400: 00000100:00100000:0.0:1787367792.457159:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:2404:x1874190788464768:12345-192.168.203.4@tcp:400: Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367792.457167:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00100000:0.0:1787367792.457196:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:0.0:1787367792.457202:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788464896:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1787367792.465437:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788465024:12345-192.168.203.4@tcp:400: Request processed in 8324us (8490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367792.465453:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00080000:3.0:1787367792.466545:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367792.466558:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367792.466573:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788465280 00000100:00100000:3.0:1787367792.466581:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788465280 00000100:00100000:3.0:1787367792.466712:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788465152 00000100:00100000:3.0:1787367792.466716:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788465152 00000100:00100000:3.0:1787367792.466744:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1787367792.466753:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788465280:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1787367792.466951:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788465280:12345-192.168.203.4@tcp:400: Request processed in 198us (9990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367792.466959:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1787367792.466976:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1787367792.466982:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788465152:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1787367792.467007:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788465152:12345-192.168.203.4@tcp:400: Request processed in 25us (9999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367792.467014:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00080000:1.0:1787367792.467083:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367792.467086:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367792.468994:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788464896:12345-192.168.203.4@tcp:400: Request processed in 11785us (12009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367792.469007:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1787367792.537775:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367792.537794:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808436864:0@lo:13: 00000100:00100000:2.0:1787367792.537867:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367792.537925:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808436864 00000100:00100000:2.0:1787367792.537932:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808436864 00000100:00100000:2.0:1787367792.537973:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787367792.537981:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808436864:12345-0@lo:13: 00002000:00000024:2.0:1787367792.538002:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367792.538042:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808436864:12345-0@lo:13: Request processed in 61us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367792.538048:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787367792.538081:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6043480 x1874190808436864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367792.538098:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808436864:0@lo:13: 00000001:00100000:3.0:1787367792.539192:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00010000:00010000:2.0:1787367792.985685:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367793.560688:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808436992:0@lo:41: 00000100:00100000:0.0:1787367793.560750:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367793.560888:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808436992 00000100:00100000:3.0:1787367793.560896:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808436992 00000100:00100000:3.0:1787367793.560954:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787367793.560963:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808436992:12345-0@lo:41: 00000004:00000024:3.0:1787367793.560994:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367793.561043:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808436992:12345-0@lo:41: Request processed in 80us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367793.561050:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787367793.561284:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808436992:0@lo:41: 00010000:00010000:3.0:1787367794.009084:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367795.032462:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367796.057577:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367796.633597:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808437376:0@lo:400: 00000100:00100000:3.0:1787367796.633669:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367796.633732:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808437888:0@lo:400: 00000100:00100000:3.0:1787367796.633764:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367796.633790:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808438400:0@lo:400: 00000100:00100000:3.0:1787367796.633820:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367796.634274:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787367796.634281:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808437504:0@lo:400: 00000100:00100000:3.0:1787367796.634304:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367796.634381:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808438016:0@lo:400: 00000100:00100000:3.0:1787367796.634402:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367796.634417:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808438528:0@lo:400: 00000100:00100000:3.0:1787367796.634433:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367796.634462:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808437376 00000100:00100000:3.0:1787367796.634467:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808437376 00000100:00100000:3.0:1787367796.634501:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787367796.634509:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808437376:12345-0@lo:400: 00000100:00100000:3.0:1787367796.634551:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808437376:12345-0@lo:400: Request processed in 43us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367796.634558:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787367796.634622:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808437120:0@lo:400: 00000100:00100000:2.0:1787367796.634653:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367796.634673:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808437632:0@lo:400: 00000100:00100000:2.0:1787367796.634692:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367796.634711:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808438144:0@lo:400: 00000100:00100000:2.0:1787367796.634728:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367796.634742:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808438656:0@lo:400: 00000100:00100000:2.0:1787367796.634758:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367796.634772:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787367796.634788:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808437248:0@lo:400: 00000100:00100000:2.0:1787367796.634807:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367796.636509:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808437760:0@lo:400: 00000100:00100000:2.0:1787367796.636551:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367796.638729:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808437888 00000100:00100000:0.0:1787367796.638740:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808437888 00000100:00100000:0.0:1787367796.639010:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808438400 00000100:00100000:0.0:1787367796.639014:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808438400 00000100:00100000:0.0:1787367796.639029:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808437504 00000100:00100000:0.0:1787367796.639032:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808437504 00000100:00100000:0.0:1787367796.639042:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808437248 00000100:00100000:0.0:1787367796.639045:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808437248 00000100:00100000:0.0:1787367796.639058:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787367796.639067:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808437888:12345-0@lo:400: 00000100:00100000:0.0:1787367796.639324:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808437888:12345-0@lo:400: Request processed in 257us (5558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367796.639332:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787367796.639380:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787367796.639386:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808438400:12345-0@lo:400: 00000100:00100000:0.0:1787367796.639415:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808438400:12345-0@lo:400: Request processed in 29us (5594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367796.639420:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787367796.639430:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787367796.639435:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808437504:12345-0@lo:400: 00000100:00100000:0.0:1787367796.639456:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808437504:12345-0@lo:400: Request processed in 21us (5151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367796.639461:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787367796.639470:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787367796.639475:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808437248:12345-0@lo:400: 00000100:00100000:0.0:1787367796.639501:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808437248:12345-0@lo:400: Request processed in 26us (4693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367796.639507:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787367796.639618:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808438016 00000100:00100000:3.0:1787367796.639622:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808438016 00000100:00100000:3.0:1787367796.639644:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808438528 00000100:00100000:3.0:1787367796.639647:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808438528 00000100:00100000:3.0:1787367796.639658:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808438144 00000100:00100000:3.0:1787367796.639661:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808438144 00000100:00100000:3.0:1787367796.639671:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808438656 00000100:00100000:3.0:1787367796.639673:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808438656 00000100:00100000:3.0:1787367796.639684:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787367796.639691:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808438016:12345-0@lo:400: 00000100:00100000:3.0:1787367796.639734:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808438016:12345-0@lo:400: Request processed in 43us (5330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367796.639740:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787367796.639753:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787367796.639758:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808438528:12345-0@lo:400: 00000100:00100000:3.0:1787367796.639796:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808438528:12345-0@lo:400: Request processed in 38us (5362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367796.639802:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787367796.639811:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787367796.639817:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808438144:12345-0@lo:400: 00000100:00100000:3.0:1787367796.639961:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808438144:12345-0@lo:400: Request processed in 142us (5230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367796.639967:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787367796.639979:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787367796.639985:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808438656:12345-0@lo:400: 00000100:00100000:3.0:1787367796.640013:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808438656:12345-0@lo:400: Request processed in 28us (5254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367796.640018:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787367796.640038:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808437632 00000100:00100000:3.0:1787367796.640042:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808437632 00000100:00100000:3.0:1787367796.640070:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787367796.640076:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808437632:12345-0@lo:400: 00000100:00100000:3.0:1787367796.640275:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808437632:12345-0@lo:400: Request processed in 198us (5581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367796.640281:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787367796.640320:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808437504:0@lo:400: 00010000:00080000:3.0:1787367796.640340:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55a9486680 x1874190808438016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367796.640351:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808438016:0@lo:400: 00010000:00080000:3.0:1787367796.640382:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55a9485c00 x1874190808438528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367796.640391:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808438528:0@lo:400: 00000100:00100000:3.0:1787367796.640401:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808437376:0@lo:400: 00010000:00080000:3.0:1787367796.640412:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55a9485f80 x1874190808437888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367796.640420:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808437888:0@lo:400: 00010000:00080000:3.0:1787367796.640429:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55a9486300 x1874190808438400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367796.640438:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808438400:0@lo:400: 00000100:00100000:3.0:1787367796.640499:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808437120 00000100:00100000:3.0:1787367796.640503:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808437120 00000100:00100000:3.0:1787367796.640527:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787367796.640533:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808437120:12345-0@lo:400: 00000100:00100000:3.0:1787367796.640562:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808437120:12345-0@lo:400: Request processed in 30us (5909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367796.640568:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787367796.640595:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808438784:0@lo:41: 00000100:00100000:3.0:1787367796.640767:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367796.643721:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808438784 00000100:00100000:0.0:1787367796.643733:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808438784 00000100:00100000:0.0:1787367796.643800:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787367796.643810:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808438784:12345-0@lo:41: 00000004:00000024:0.0:1787367796.643848:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787367796.643915:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808438784:12345-0@lo:41: Request processed in 107us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367796.643922:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787367796.643963:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808438784:0@lo:41: 00000100:00080000:1.0:1787367796.644224:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367796.644231:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367796.644234:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367796.657474:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808438272:0@lo:400: 00000100:00100000:2.0:1787367796.657534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367796.657580:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808437120:0@lo:400: 00000100:00100000:2.0:1787367796.657593:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808437632:0@lo:400: 00010000:00080000:2.0:1787367796.657616:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55a9484a80 x1874190808438144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367796.657627:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808438144:0@lo:400: 00010000:00080000:2.0:1787367796.657639:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55a9487480 x1874190808438656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367796.657647:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808438656:0@lo:400: 00000100:00100000:2.0:1787367796.657676:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808437248:0@lo:400: 00000100:00100000:0.0:1787367796.657817:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808437760 00000100:00100000:0.0:1787367796.657823:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808437760 00000100:00100000:0.0:1787367796.657897:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808438272 00000100:00100000:0.0:1787367796.657900:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808438272 00000100:00100000:0.0:1787367796.657916:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787367796.657924:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808437760:12345-0@lo:400: 00000100:00100000:0.0:1787367796.657970:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808437760:12345-0@lo:400: Request processed in 46us (21418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367796.657977:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787367796.657990:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787367796.657995:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808438272:12345-0@lo:400: 00000100:00100000:0.0:1787367796.658016:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808438272:12345-0@lo:400: Request processed in 21us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367796.658021:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787367796.658123:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367796.658150:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808437760:0@lo:400: 00000100:00100000:2.0:1787367796.658160:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808438272:0@lo:400: 00010000:00010000:3.0:1787367797.085947:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367797.144599:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808438912:0@lo:13: 00000100:00100000:2.0:1787367797.144668:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367797.144732:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808438912 00000100:00100000:2.0:1787367797.144739:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808438912 00000100:00100000:2.0:1787367797.144787:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787367797.144796:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808438912:12345-0@lo:13: 00002000:00000024:2.0:1787367797.144819:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367797.144865:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808438912:12345-0@lo:13: Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.144873:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787367797.144907:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc513100 x1874190808438912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367797.145089:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808439040:0@lo:13: 00000100:00100000:1.0:1787367797.145115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367797.145142:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808439040 00000100:00100000:1.0:1787367797.145145:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808439040 00000100:00100000:1.0:1787367797.145165:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787367797.145171:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808439040:12345-0@lo:13: 00002000:00000024:1.0:1787367797.145180:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367797.145204:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808439040:12345-0@lo:13: Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367797.145210:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787367797.145230:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62d880 x1874190808439040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367797.145243:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808439040:0@lo:13: 00000100:00100000:2.0:1787367797.145289:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808438912:0@lo:13: 00000100:00100000:0.0:1787367797.162091:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367797.162114:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808439168:0@lo:13: 00000100:00100000:0.0:1787367797.162172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367797.163826:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808439168 00000100:00100000:1.0:1787367797.163889:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808439168 00000100:00100000:1.0:1787367797.163943:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787367797.163951:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808439168:12345-0@lo:13: 00002000:00000024:1.0:1787367797.164088:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367797.164692:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808439168:12345-0@lo:13: Request processed in 740us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367797.164701:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787367797.179416:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62d880 x1874190808439168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367797.179442:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808439168:0@lo:13: 00000020:00000080:1.0:1787367797.260928:0:10351:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd2199570 20000000:00000080:1.0:1787367797.260945:0:10351:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c55afa90400 uarg=0000000000000000 20000000:01000000:1.0:1787367797.260996:0:10351:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787367797.260998:0:10351:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787367797.261001:0:10351:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787367797.261006:0:10351:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787367797.261015:0:10351:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787367797.261063:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787367797.261128:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787367797.264887:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1787367797.265176:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1787367797.265201:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1787367797.265215:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1787367797.265226:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787367797.265228:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787367797.274221:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1787367797.274639:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1787367797.274671:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1787367797.274690:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1787367797.274706:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787367797.274709:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787367797.276550:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1787367797.276795:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1787367797.276819:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1787367797.276833:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1787367797.276842:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787367797.276844:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787367797.277173:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1787367797.277292:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1787367797.277308:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1787367797.277320:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1787367797.277327:0:10351:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787367797.277329:0:10351:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787367797.277610:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1787367797.277906:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1787367797.277940:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1787367797.277955:0:10351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:1.0:1787367797.277966:0:10351:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787367797.277983:0:10351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.277999:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03057a expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278007:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0305a4 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278014:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0305e3 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278031:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0305f1 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278038:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0305ff expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278045:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03061b expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278051:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030645 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278058:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030661 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278064:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03068b expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278073:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e55a expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278080:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e561 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278088:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278121:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e561 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278143:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e561 expref: 9 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.278157:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439296:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367797.278262:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e55a expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278272:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e55a expref: 9 pid: 6533 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.278281:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439424:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367797.278321:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03068b expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278330:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03068b expref: 23 pid: 6533 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.278339:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439552:0@lo:104: 00000100:00100000:1.0:1787367797.278403:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367797.278437:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030661 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278446:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030661 expref: 23 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.278454:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439680:0@lo:104: 00000100:00100000:1.0:1787367797.278472:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367797.278503:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030645 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278511:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030645 expref: 23 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.278520:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439808:0@lo:104: 00000100:00100000:1.0:1787367797.278538:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367797.278551:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03061b expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.278558:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03061b expref: 23 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.278566:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439936:0@lo:104: 00000100:00100000:1.0:1787367797.278583:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367797.278746:0:6521:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787367797.278759:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808439552 00000100:00100000:2.0:1787367797.278764:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808439552 00000100:00100000:2.0:1787367797.278804:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808439680 00000100:00100000:2.0:1787367797.278807:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808439680 00000100:00100000:2.0:1787367797.278815:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808439808 00000100:00100000:2.0:1787367797.278817:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808439808 00000100:00100000:2.0:1787367797.278825:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808439936 00000100:00100000:2.0:1787367797.278827:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808439936 00000100:00100000:2.0:1787367797.278838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787367797.278845:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:10351:x1874190808439552:12345-0@lo:104: 00010000:00010000:2.0:1787367797.278862:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.278906:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367797.278912:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:10351:x1874190808439552:12345-0@lo:104: Request processed in 68us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.278930:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787367797.278944:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787367797.278950:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:10351:x1874190808439680:12345-0@lo:104: 00010000:00010000:2.0:1787367797.278956:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.278984:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787367797.278989:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:10351:x1874190808439680:12345-0@lo:104: Request processed in 40us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.278995:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787367797.279004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787367797.279009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:10351:x1874190808439808:12345-0@lo:104: 00010000:00010000:2.0:1787367797.279016:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279041:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787367797.279045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:10351:x1874190808439808:12345-0@lo:104: Request processed in 36us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.279051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787367797.279060:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787367797.279065:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd702450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10351:x1874190808439936:12345-0@lo:104: 00010000:00010000:2.0:1787367797.279076:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279099:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787367797.279103:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd702450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10351:x1874190808439936:12345-0@lo:104: Request processed in 39us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.279109:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787367797.279139:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787367797.279144:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279151:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367797.279156:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279164:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367797.279172:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367797.279178:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787367797.279199:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279204:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367797.279219:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279226:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174800/0x66f5679bff03068b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030692 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279243:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787367797.279246:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279252:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367797.279255:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279262:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367797.279269:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367797.279274:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787367797.279284:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279290:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367797.279301:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279308:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff030661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030668 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279316:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367797.279319:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279333:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673e00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367797.279336:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279343:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367797.279349:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367797.279376:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787367797.279387:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279393:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367797.279398:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279404:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5581673e00/0x66f5679bff030645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03064c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279413:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367797.279416:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279421:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367797.279424:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279439:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367797.279446:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367797.279451:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787367797.279470:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279475:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367797.279480:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279487:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff03061b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030622 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279495:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367797.279497:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367797.279498:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367797.279504:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367797.279508:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367797.279518:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808440064:0@lo:103: 00000100:00100000:2.0:1787367797.279548:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367797.279569:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367797.279574:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808440448:0@lo:103: 00000100:00100000:2.0:1787367797.279659:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367797.279688:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808440192:0@lo:103: 00000100:00100000:2.0:1787367797.279716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367797.279732:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367797.279736:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808440320:0@lo:103: 00000100:00100000:2.0:1787367797.279752:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367797.279784:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808440064 00000100:00100000:2.0:1787367797.279788:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808440064 00010000:00010000:2.0:1787367797.279805:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03068b expref: 24 pid: 6533 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367797.279819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808440448 00000100:00100000:2.0:1787367797.279821:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808440448 00010000:00010000:2.0:1787367797.279828:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03061b expref: 25 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367797.279837:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808440192 00000100:00100000:2.0:1787367797.279839:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808440192 00010000:00010000:2.0:1787367797.279846:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030661 expref: 26 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367797.279854:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808440320 00000100:00100000:2.0:1787367797.279856:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808440320 00010000:00010000:2.0:1787367797.279863:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030645 expref: 27 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367797.279873:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787367797.279879:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+27:3652:x1874190808440064:12345-0@lo:103: 00010000:00010000:2.0:1787367797.279887:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367797.279891:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03068b expref: 27 pid: 6533 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279900:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03068b expref: 27 pid: 6533 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.279919:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367797.279943:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+27:3652:x1874190808440064:12345-0@lo:103: Request processed in 64us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.279950:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787367797.279977:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787367797.279982:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+26:3652:x1874190808440448:12345-0@lo:103: 00010000:00010000:2.0:1787367797.279988:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367797.279992:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03061b expref: 26 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.280000:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03061b expref: 26 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.280009:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367797.280026:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+26:3652:x1874190808440448:12345-0@lo:103: Request processed in 44us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.280031:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787367797.280040:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787367797.280045:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3653:x1874190808440192:12345-0@lo:103: 00010000:00010000:2.0:1787367797.280051:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367797.280055:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030661 expref: 25 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.280063:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030661 expref: 25 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.280071:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367797.280096:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3653:x1874190808440192:12345-0@lo:103: Request processed in 51us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.280102:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787367797.280113:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787367797.280118:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808440320:12345-0@lo:103: 00010000:00010000:2.0:1787367797.280124:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367797.280128:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030645 expref: 24 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.280136:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030645 expref: 24 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.280145:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367797.280161:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808440320:12345-0@lo:103: Request processed in 43us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.280166:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787367797.280196:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808440320:0@lo:103: 00000100:00100000:2.0:1787367797.280204:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808440192:0@lo:103: 00000100:00100000:2.0:1787367797.280222:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808440448:0@lo:103: 00000100:00100000:2.0:1787367797.280229:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808440064:0@lo:103: 00010000:00010000:1.0:1787367797.280827:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0305ff expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.280838:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0305ff expref: 23 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.280849:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808440576:0@lo:104: 00000100:00100000:1.0:1787367797.280875:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367797.280992:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0305f1 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.281001:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0305f1 expref: 23 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.281010:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808440704:0@lo:104: 00000100:00100000:1.0:1787367797.281035:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367797.283914:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0305e3 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.284035:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0305e3 expref: 23 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.284049:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808440832:0@lo:104: 00000100:00100000:1.0:1787367797.284089:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367797.284244:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808440576 00000100:00100000:3.0:1787367797.284251:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808440576 00000100:00100000:3.0:1787367797.284287:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808440704 00000100:00100000:3.0:1787367797.284290:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808440704 00000100:00100000:3.0:1787367797.284302:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787367797.284309:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:10351:x1874190808440576:12345-0@lo:104: 00010000:00010000:3.0:1787367797.284321:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367797.284386:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367797.284391:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:10351:x1874190808440576:12345-0@lo:104: Request processed in 83us (3516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367797.284399:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787367797.284414:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787367797.284420:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10351:x1874190808440704:12345-0@lo:104: 00010000:00010000:3.0:1787367797.284427:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367797.284456:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787367797.284461:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10351:x1874190808440704:12345-0@lo:104: Request processed in 42us (3425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367797.284477:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787367797.284550:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367797.284557:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284565:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68b600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367797.284569:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284588:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367797.284601:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367797.284618:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367797.284644:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284651:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367797.284667:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284675:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b600/0x66f5679bff0305ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030606 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284687:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367797.284690:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284695:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83c00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367797.284698:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284705:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367797.284711:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367797.284716:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367797.284727:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284732:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367797.284749:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284756:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff0305f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0305f8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.284765:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367797.284766:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367797.284768:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367797.284785:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367797.284796:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808440960:0@lo:103: 00000100:00100000:0.0:1787367797.284823:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367797.284851:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367797.284857:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808441088:0@lo:103: 00000100:00100000:0.0:1787367797.284875:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367797.284896:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808440960 00000100:00100000:0.0:1787367797.284899:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808440960 00010000:00010000:0.0:1787367797.284915:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0305ff expref: 24 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367797.284944:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808441088 00000100:00100000:0.0:1787367797.284946:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808441088 00010000:00010000:0.0:1787367797.284957:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0305f1 expref: 25 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367797.284971:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787367797.284977:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3651:x1874190808440960:12345-0@lo:103: 00010000:00010000:0.0:1787367797.284986:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367797.284990:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0305ff expref: 25 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.285009:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0305ff expref: 25 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.285024:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367797.285048:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3651:x1874190808440960:12345-0@lo:103: Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.285054:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787367797.285066:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787367797.285071:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808441088:12345-0@lo:103: 00010000:00010000:0.0:1787367797.285078:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367797.285082:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0305f1 expref: 24 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.285090:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0305f1 expref: 24 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.285099:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367797.285118:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808441088:12345-0@lo:103: Request processed in 47us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.285124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787367797.285154:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808441088:0@lo:103: 00000100:00100000:0.0:1787367797.285171:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808440960:0@lo:103: 00010000:00010000:0.0:1787367797.285410:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367797.286147:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808440832 00000100:00100000:2.0:1787367797.286155:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808440832 00010000:00010000:1.0:1787367797.286477:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0305a4 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.286490:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0305a4 expref: 23 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.286506:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808441216:0@lo:104: 00000100:00100000:1.0:1787367797.286547:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367797.287048:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03057a expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367797.287058:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03057a expref: 23 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.287067:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808441344:0@lo:104: 00000100:00100000:1.0:1787367797.287090:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367797.287109:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808441216 00000100:00100000:0.0:1787367797.287113:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808441216 00000100:00100000:0.0:1787367797.287136:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787367797.287142:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:10351:x1874190808440832:12345-0@lo:104: 00010000:00010000:0.0:1787367797.287157:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287198:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787367797.287204:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:10351:x1874190808440832:12345-0@lo:104: Request processed in 62us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.287211:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787367797.287226:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787367797.287232:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10351:x1874190808441216:12345-0@lo:104: 00010000:00010000:0.0:1787367797.287239:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287266:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787367797.287270:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10351:x1874190808441216:12345-0@lo:104: Request processed in 39us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.287276:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787367797.287330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367797.287353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1787367797.287381:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367797.287386:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287394:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367797.287398:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287406:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367797.287423:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367797.287430:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367797.287449:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287455:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367797.287468:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287475:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0305e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0305ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287487:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367797.287490:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287495:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82e00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367797.287498:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287505:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367797.287511:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367797.287516:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367797.287531:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287537:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367797.287547:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287554:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa82e00/0x66f5679bff0305a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0305ab expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287561:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367797.287563:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367797.287564:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367797.287574:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788465536 00000100:00100000:0.0:1787367797.287588:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788465536 00010000:00010000:0.0:1787367797.287611:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e55a expref: 10 pid: 6533 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367797.287627:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788465408 00000100:00100000:0.0:1787367797.287630:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788465408 00010000:00010000:0.0:1787367797.287638:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e561 expref: 11 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367797.287655:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1787367797.287662:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+11:2402:x1874190788465536:12345-192.168.203.4@tcp:103: 00010000:00010000:0.0:1787367797.287671:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367797.287676:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e55a expref: 11 pid: 6533 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287685:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e55a expref: 11 pid: 6533 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287708:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367797.287738:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+11:2402:x1874190788465536:12345-192.168.203.4@tcp:103: Request processed in 77us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.287745:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1787367797.287757:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:0.0:1787367797.287763:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+10:2402:x1874190788465408:12345-192.168.203.4@tcp:103: 00010000:00010000:0.0:1787367797.287769:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367797.287785:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e561 expref: 10 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287796:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e561 expref: 10 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.287805:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367797.287820:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+10:2402:x1874190788465408:12345-192.168.203.4@tcp:103: Request processed in 57us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.287826:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:0.0:1787367797.287940:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808441472:0@lo:103: 00000100:00100000:0.0:1787367797.287963:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367797.287987:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808441600:0@lo:103: 00000100:00100000:0.0:1787367797.288004:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367797.288022:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808441472 00000100:00100000:0.0:1787367797.288025:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808441472 00010000:00010000:0.0:1787367797.288037:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0305e3 expref: 24 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367797.288048:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808441600 00000100:00100000:0.0:1787367797.288057:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808441600 00010000:00010000:0.0:1787367797.288069:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0305a4 expref: 25 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367797.288081:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367797.288087:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3654:x1874190808441472:12345-0@lo:103: 00010000:00010000:0.0:1787367797.288093:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367797.288097:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0305e3 expref: 25 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.288105:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0305e3 expref: 25 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.288115:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367797.288137:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3654:x1874190808441472:12345-0@lo:103: Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.288143:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367797.288153:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367797.288159:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808441600:12345-0@lo:103: 00010000:00010000:0.0:1787367797.288165:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367797.288169:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0305a4 expref: 24 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.288177:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0305a4 expref: 24 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.288185:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367797.288204:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808441600:12345-0@lo:103: Request processed in 45us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.288210:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367797.288256:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808441472:0@lo:103: 00000100:00100000:0.0:1787367797.288275:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808441600:0@lo:103: 00010000:00010000:0.0:1787367797.288294:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367797.289018:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54836066c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787367797.289035:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673200/0x66f5679bff0306a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e561 expref: 9 pid: 6530 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289048:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439296:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367797.289067:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68a400/0x66f5679bff0306a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e55a expref: 8 pid: 6533 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289076:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439424:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367797.289085:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68a200/0x66f5679bff030692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03068b expref: 23 pid: 6533 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289093:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439552:0@lo:104: 00010000:00010000:1.0:1787367797.289102:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55afa83e00/0x66f5679bff030668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030661 expref: 22 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289110:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439680:0@lo:104: 00010000:00010000:1.0:1787367797.289118:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673000/0x66f5679bff03064c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030645 expref: 21 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289126:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439808:0@lo:104: 00010000:00010000:1.0:1787367797.289135:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672c00/0x66f5679bff030622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03061b expref: 20 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289143:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808439936:0@lo:104: 00010000:00010000:1.0:1787367797.289152:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672400/0x66f5679bff030606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0305ff expref: 19 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289159:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808440576:0@lo:104: 00010000:00010000:1.0:1787367797.289168:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68b000/0x66f5679bff0305f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0305f1 expref: 18 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289176:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808440704:0@lo:104: 00010000:00010000:1.0:1787367797.289191:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0305ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0305e3 expref: 17 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289199:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808440832:0@lo:104: 00010000:00010000:1.0:1787367797.289207:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672200/0x66f5679bff0305ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0305a4 expref: 16 pid: 6532 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289214:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808441216:0@lo:104: 00000100:00100000:0.0:1787367797.289260:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808441344 00000100:00100000:0.0:1787367797.289265:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808441344 00000100:00100000:0.0:1787367797.289298:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367797.289304:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10351:x1874190808441344:12345-0@lo:104: 00010000:00010000:0.0:1787367797.289314:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.289382:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787367797.289387:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10351:x1874190808441344:12345-0@lo:104: Request processed in 84us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.289394:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787367797.289407:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367797.289412:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.289419:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175400 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367797.289422:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.289430:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367797.289437:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367797.289443:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367797.289469:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.289475:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367797.289487:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.289494:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2175400/0x66f5679bff03057a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030581 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.289506:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367797.289507:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367797.289509:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367797.289514:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367797.289522:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808441728:0@lo:103: 00000100:00100000:0.0:1787367797.289549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367797.289572:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808441728 00000100:00100000:0.0:1787367797.289575:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808441728 00010000:00010000:0.0:1787367797.289588:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03057a expref: 16 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367797.289904:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10351:1874190808441344:0@lo:104: 00010000:00010000:1.0:1787367797.289944:0:10351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367797.290105:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367797.290112:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:3651:x1874190808441728:12345-0@lo:103: 00010000:00010000:0.0:1787367797.290121:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367797.290126:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03057a expref: 16 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290137:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03057a expref: 16 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290149:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55afa82000/0x66f5679bff030581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03057a expref: 16 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290166:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290174:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290186:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290193:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290200:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290207:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290212:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787367797.290215:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290223:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290242:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367797.290250:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367797.290279:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:3651:x1874190808441728:12345-0@lo:103: Request processed in 168us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367797.290294:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367797.290317:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808441728:0@lo:103: 00010000:00010000:2.0:1787367797.290377:0:10351:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.290385:0:10351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367797.290402:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672800/0x66f5679bff0306e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367797.558451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367797.559554:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788465792 00000100:00100000:2.0:1787367797.559564:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788465792 00000100:00100000:2.0:1787367797.559627:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1787367797.559637:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788465792:12345-192.168.203.4@tcp:400: 00000100:00080000:0.0:1787367797.559845:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367797.560080:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788465792:12345-192.168.203.4@tcp:400: Request processed in 443us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.560089:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1787367797.560262:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367797.560319:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367797.560346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367797.560425:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788465664 00000100:00100000:1.0:1787367797.560430:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788465664 00000100:00100000:1.0:1787367797.560479:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1787367797.560487:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788465664:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1787367797.560522:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788465664:12345-192.168.203.4@tcp:400: Request processed in 37us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367797.560529:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00080000:2.0:1787367797.560731:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367797.561347:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788466048 00000100:00100000:0.0:1787367797.561440:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788466048 00000100:00100000:1.0:1787367797.561569:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788465920 00000100:00100000:1.0:1787367797.561574:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788465920 00000100:00100000:1.0:1787367797.561597:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1787367797.561605:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788466048:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1787367797.561647:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788466048:12345-192.168.203.4@tcp:400: Request processed in 42us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367797.561654:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1787367797.561667:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1787367797.561683:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788465920:12345-192.168.203.4@tcp:400: 00000100:00100000:1.0:1787367797.561708:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788465920:12345-192.168.203.4@tcp:400: Request processed in 27us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367797.561714:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00080000:2.0:1787367797.562028:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367797.562032:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367797.659645:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808441856:0@lo:13: 00000100:00100000:0.0:1787367797.659723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367797.660304:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808441856 00000100:00100000:2.0:1787367797.660313:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808441856 00000100:00100000:2.0:1787367797.660445:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787367797.660455:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808441856:12345-0@lo:13: 00002000:00000024:2.0:1787367797.660494:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367797.660542:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808441856:12345-0@lo:13: Request processed in 89us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367797.660549:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787367797.661484:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0b100 x1874190808441856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367797.661517:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808441856:0@lo:13: 00010000:00010000:0.0:1787367798.104583:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367798.680668:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367798.680705:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808441984:0@lo:41: 00000100:00100000:3.0:1787367798.680785:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367798.681102:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808441984 00000100:00100000:1.0:1787367798.681109:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808441984 00000100:00100000:1.0:1787367798.681167:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787367798.681176:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808441984:12345-0@lo:41: 00000004:00000024:1.0:1787367798.681209:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787367798.681266:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808441984:12345-0@lo:41: Request processed in 90us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367798.681273:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787367798.681555:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808441984:0@lo:41: 10000000:01000000:2.0:1787367799.128616:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787367799.128624:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bc4cb000 from 48 10000000:01000000:2.0:1787367799.128629:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787367799.128676:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.128687:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.128713:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367799.128747:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442112:0@lo:101: 00000100:00100000:2.0:1787367799.128822:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.128888:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495600 going to sleep for 11 seconds 00000100:00100000:1.0:1787367799.130173:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808442112 00000100:00100000:1.0:1787367799.130184:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808442112 00000100:00100000:1.0:1787367799.130240:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787367799.130250:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+15:6535:x1874190808442112:12345-0@lo:101: 00010000:00010000:1.0:1787367799.130262:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367799.130279:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672c00/0x66f5679bff0306f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0306ed expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367799.130301:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672c00/0x66f5679bff0306f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0306ed expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367799.130310:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672c00/0x66f5679bff0306f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0306ed expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367799.130319:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672c00, rc 0) 00000100:00100000:1.0:1787367799.130408:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808442112:12345-0@lo:101: Request processed in 160us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367799.130424:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00010000:0.0:1787367799.130559:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367799.130780:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442112:0@lo:101: 00010000:00010000:2.0:1787367799.130797:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.130807:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367799.130869:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442240:0@lo:501: 00000100:00100000:2.0:1787367799.130900:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.130933:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495600 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.131042:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808442240 00000100:00100000:3.0:1787367799.131047:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808442240 00000100:00100000:3.0:1787367799.131080:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787367799.131087:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808442240:12345-0@lo:501: 00000100:00100000:3.0:1787367799.131212:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808442240:12345-0@lo:501: Request processed in 125us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.131219:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787367799.131374:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442240:0@lo:501: 00000100:00100000:2.0:1787367799.131401:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442368:0@lo:503: 00000100:00100000:2.0:1787367799.131440:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.131467:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495600 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.131523:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808442368 00000100:00100000:3.0:1787367799.131527:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808442368 00000100:00100000:3.0:1787367799.131558:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787367799.131566:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808442368:12345-0@lo:503: 00000100:00100000:3.0:1787367799.131647:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808442368:12345-0@lo:503: Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.131654:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787367799.131832:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442368:0@lo:503: 00000100:00100000:2.0:1787367799.132378:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10369:1874190808442496:0@lo:502: 00000100:00100000:2.0:1787367799.132413:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.132440:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495900 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.132481:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808442496 00000100:00100000:3.0:1787367799.132485:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808442496 00000100:00100000:3.0:1787367799.132592:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787367799.132601:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:10369:x1874190808442496:12345-0@lo:502: 00000100:00100000:3.0:1787367799.132702:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:10369:x1874190808442496:12345-0@lo:502: Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.132709:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787367799.135115:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10369:1874190808442496:0@lo:502: 00000100:00100000:2.0:1787367799.135198:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10369:1874190808442624:0@lo:502: 00000100:00100000:2.0:1787367799.135253:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.137090:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495900 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.137268:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808442624 00000100:00100000:0.0:1787367799.137276:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808442624 00000100:00100000:0.0:1787367799.137320:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787367799.137328:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:10369:x1874190808442624:12345-0@lo:502: 00000100:00100000:0.0:1787367799.137490:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:10369:x1874190808442624:12345-0@lo:502: Request processed in 162us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.137509:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787367799.137650:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10369:1874190808442624:0@lo:502: 00000040:00080000:2.0:1787367799.137687:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787367799.137906:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787367799.137927:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787367799.137936:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.137947:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367799.138040:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787367799.138043:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787367799.138045:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787367799.138072:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.138080:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.138090:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367799.138255:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442752:0@lo:101: 00000100:00100000:0.0:1787367799.138293:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.138326:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367799.138410:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808442752 00000100:00100000:2.0:1787367799.138415:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808442752 00000100:00100000:2.0:1787367799.138439:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787367799.138445:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+16:6535:x1874190808442752:12345-0@lo:101: 00010000:00010000:2.0:1787367799.138453:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367799.138465:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55afa82200/0x66f5679bff030702 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0306fb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.138485:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55afa82200/0x66f5679bff030702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0306fb expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.138495:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55afa82200/0x66f5679bff030702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0306fb expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.138571:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82200, rc 0) 00000100:00100000:2.0:1787367799.138601:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808442752:12345-0@lo:101: Request processed in 157us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.138617:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787367799.138716:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442752:0@lo:101: 00010000:00010000:0.0:1787367799.138728:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.138735:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367799.138792:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442880:0@lo:501: 00000100:00100000:0.0:1787367799.138816:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.138840:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367799.138885:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808442880 00000100:00100000:2.0:1787367799.138890:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808442880 00000100:00100000:2.0:1787367799.138908:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787367799.138914:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808442880:12345-0@lo:501: 00000100:00100000:2.0:1787367799.139446:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808442880:12345-0@lo:501: Request processed in 531us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.139453:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787367799.139695:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808442880:0@lo:501: 00000100:00100000:0.0:1787367799.139724:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808443008:0@lo:503: 00000100:00100000:0.0:1787367799.139780:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.139837:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.139870:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808443008 00000100:00100000:3.0:1787367799.139875:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808443008 00000100:00100000:2.0:1787367799.139920:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787367799.139928:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808443008:12345-0@lo:503: 00000100:00100000:2.0:1787367799.140078:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808443008:12345-0@lo:503: Request processed in 151us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.140084:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787367799.140317:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808443008:0@lo:503: 00000100:00100000:0.0:1787367799.140809:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10370:1874190808443136:0@lo:502: 00000100:00100000:0.0:1787367799.140849:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.140878:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367799.140930:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808443136 00000100:00100000:1.0:1787367799.140936:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808443136 00000100:00100000:1.0:1787367799.141023:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787367799.141031:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:10370:x1874190808443136:12345-0@lo:502: 00000100:00100000:1.0:1787367799.141588:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:10370:x1874190808443136:12345-0@lo:502: Request processed in 557us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367799.141596:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787367799.141819:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10370:1874190808443136:0@lo:502: 00000020:01000000:0.0:1787367799.141843:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367799.141852:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367799.141854:0:10370:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787367799.141859:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787367799.141881:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10370:1874190808443264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367799.141917:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.141937:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367799.142045:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808443264 00000100:00100000:1.0:1787367799.142050:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808443264 00000100:00100000:1.0:1787367799.142247:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787367799.142256:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:10370:x1874190808443264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367799.142338:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:10370:x1874190808443264:12345-0@lo:502:llog_process_th.0 Request processed in 83us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367799.142345:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787367799.142630:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10370:1874190808443264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787367799.142652:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367799.142656:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367799.142658:0:10370:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787367799.142661:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1787367799.142847:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787367799.142869:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787367799.142879:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.142889:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367799.142899:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787367799.142901:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bd606800 from 48 10000000:01000000:3.0:1787367799.142904:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787367799.142928:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.142935:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.142943:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367799.142968:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808443392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.142997:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.143022:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6e7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.143155:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808443392 00000100:00100000:0.0:1787367799.143159:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808443392 00000100:00100000:0.0:1787367799.143194:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787367799.143201:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+17:6535:x1874190808443392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367799.143209:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367799.143219:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030709 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.143251:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030709 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.143261:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030709 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.143269:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ae00, rc 0) 00000100:00100000:0.0:1787367799.143298:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808443392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.143304:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787367799.144902:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808443392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367799.144935:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.144945:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367799.145017:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808443520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.145052:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.145084:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6e7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.145236:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808443520 00000100:00100000:0.0:1787367799.145241:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808443520 00000100:00100000:0.0:1787367799.145279:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787367799.145287:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808443520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.145419:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808443520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.145426:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787367799.145739:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808443520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.145779:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808443648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.145819:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.145843:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6e7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.145889:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808443648 00000100:00100000:0.0:1787367799.145893:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808443648 00000100:00100000:0.0:1787367799.145923:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787367799.145929:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808443648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.146015:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808443648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.146022:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787367799.146182:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808443648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.146911:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10371:1874190808443776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367799.147031:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.147063:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677180 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.147118:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808443776 00000100:00100000:3.0:1787367799.147122:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808443776 00000100:00100000:3.0:1787367799.147156:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787367799.147164:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:10371:x1874190808443776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.147257:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:10371:x1874190808443776:12345-0@lo:502:llog_process_th.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.147264:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787367799.147396:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10371:1874190808443776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367799.147434:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10371:1874190808443904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367799.147465:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367799.147485:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606900 going to sleep for 11 seconds 00000100:00100000:2.0:1787367799.147604:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808443904 00000100:00100000:2.0:1787367799.147616:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808443904 00000100:00100000:2.0:1787367799.147647:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787367799.147654:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:10371:x1874190808443904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367799.147733:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:10371:x1874190808443904:12345-0@lo:502:llog_process_th.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.147739:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787367799.147855:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10371:1874190808443904:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787367799.147876:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787367799.148228:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787367799.148247:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367799.148256:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.148266:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367799.148274:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787367799.148277:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787367799.148279:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787367799.148302:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.148316:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.148327:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367799.148342:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.148404:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.148427:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.148475:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808444032 00000100:00100000:0.0:1787367799.148479:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808444032 00000100:00100000:0.0:1787367799.148517:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787367799.148525:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+18:6535:x1874190808444032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367799.148533:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367799.148543:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68b000/0x66f5679bff03071e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030717 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.148562:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68b000/0x66f5679bff03071e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030717 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.148571:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68b000/0x66f5679bff03071e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030717 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.148578:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b000, rc 0) 00000100:00100000:0.0:1787367799.148711:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808444032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.148717:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787367799.148783:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367799.148794:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.148802:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367799.148844:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.148869:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.148887:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c2c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367799.148942:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808444160 00000100:00100000:1.0:1787367799.148946:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808444160 00000100:00100000:1.0:1787367799.149041:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787367799.149048:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808444160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367799.149210:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808444160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367799.149217:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787367799.149269:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.149294:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.149327:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.149347:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.149418:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808444288 00000100:00100000:0.0:1787367799.149423:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808444288 00000100:00100000:0.0:1787367799.149440:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787367799.149445:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808444288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.149585:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808444288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.149591:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787367799.149828:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.150394:0:10372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10372:1874190808444416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.150436:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.150460:0:10372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.150553:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808444416 00000100:00100000:0.0:1787367799.150563:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808444416 00000100:00100000:0.0:1787367799.150596:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787367799.150604:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:10372:x1874190808444416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367799.150684:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:10372:x1874190808444416:12345-0@lo:502:llog_process_th.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.150690:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787367799.150927:0:10372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10372:1874190808444416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787367799.150948:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367799.151020:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367799.151023:0:10372:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787367799.151029:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787367799.151049:0:10372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10372:1874190808444544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367799.151083:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367799.151151:0:10372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606000 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.154141:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808444544 00000100:00100000:3.0:1787367799.154168:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808444544 00000100:00100000:3.0:1787367799.154258:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787367799.154269:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:10372:x1874190808444544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.154441:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:10372:x1874190808444544:12345-0@lo:502:llog_process_th.0 Request processed in 173us (3356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.154449:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787367799.154737:0:10372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10372:1874190808444544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787367799.154778:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367799.154784:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367799.154786:0:10372:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787367799.154790:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1787367799.156936:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787367799.156977:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787367799.156988:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.157001:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367799.157011:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787367799.157014:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bc6be800 from 48 10000000:01000000:0.0:1787367799.157016:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787367799.157049:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.157057:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.157068:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367799.157088:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.157152:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.159677:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677300 going to sleep for 11 seconds 00000100:00100000:2.0:1787367799.161387:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808444672 00000100:00100000:2.0:1787367799.161409:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808444672 00000100:00100000:2.0:1787367799.161455:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787367799.161463:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:6535:x1874190808444672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367799.161478:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367799.161494:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55afa83600/0x66f5679bff03072c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030725 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.161529:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55afa83600/0x66f5679bff03072c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030725 expref: 20 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.161539:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55afa83600/0x66f5679bff03072c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030725 expref: 20 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.161548:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa83600, rc 0) 00000100:00100000:2.0:1787367799.161616:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808444672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (4464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.161623:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787367799.161810:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367799.161826:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.161835:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367799.161906:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.161938:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.161971:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677300 going to sleep for 11 seconds 00000100:00100000:2.0:1787367799.162067:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808444800 00000100:00100000:2.0:1787367799.162071:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808444800 00000100:00100000:2.0:1787367799.162088:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787367799.162094:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808444800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.162217:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808444800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.162224:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787367799.162340:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.162395:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.162436:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.162452:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677300 going to sleep for 11 seconds 00000100:00100000:2.0:1787367799.164297:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808444928 00000100:00100000:2.0:1787367799.164308:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808444928 00000100:00100000:2.0:1787367799.164349:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787367799.164379:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808444928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.164741:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808444928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 363us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.164749:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787367799.164839:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808444928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.166657:0:10373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10373:1874190808445056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367799.166731:0:10373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.166835:0:10373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.166989:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808445056 00000100:00100000:3.0:1787367799.166996:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808445056 00000100:00100000:3.0:1787367799.167034:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787367799.167042:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:10373:x1874190808445056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.167588:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:10373:x1874190808445056:12345-0@lo:502:llog_process_th.0 Request processed in 545us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.167596:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787367799.171684:0:10373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10373:1874190808445056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367799.171776:0:10373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10373:1874190808445184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367799.171843:0:10373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.171866:0:10373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.172064:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808445184 00000100:00100000:3.0:1787367799.172070:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808445184 00000100:00100000:3.0:1787367799.172116:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787367799.172123:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:10373:x1874190808445184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.172224:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:10373:x1874190808445184:12345-0@lo:502:llog_process_th.0 Request processed in 100us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.172231:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787367799.172331:0:10373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10373:1874190808445184:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787367799.172347:0:10373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787367799.172952:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787367799.173034:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367799.173044:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.173054:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367799.173064:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787367799.173066:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1787367799.173069:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787367799.173092:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.173602:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.173614:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367799.173634:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808445312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.173675:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.173700:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559123e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.173754:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808445312 00000100:00100000:3.0:1787367799.173767:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808445312 00000100:00100000:3.0:1787367799.173804:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787367799.173813:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808445312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367799.173822:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367799.173834:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55814a0400/0x66f5679bff03073a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030733 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.173863:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55814a0400/0x66f5679bff03073a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030733 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.173871:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55814a0400/0x66f5679bff03073a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030733 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.173879:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0400, rc 0) 00000100:00100000:3.0:1787367799.173918:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808445312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.173924:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787367799.174046:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808445312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367799.174058:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.174066:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367799.174129:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808445440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.174153:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.174174:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826776c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367799.174242:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808445440 00000100:00100000:1.0:1787367799.174246:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808445440 00000100:00100000:1.0:1787367799.174279:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787367799.174286:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808445440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367799.174397:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808445440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367799.174404:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787367799.174521:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808445440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.174547:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808445568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.174581:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.174601:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826776c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367799.175452:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808445568 00000100:00100000:1.0:1787367799.175459:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808445568 00000100:00100000:1.0:1787367799.175494:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787367799.175512:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808445568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367799.175627:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808445568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367799.175634:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787367799.175811:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808445568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.176326:0:10374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483796300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10374:1874190808445696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.176405:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.176431:0:10374:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624180 going to sleep for 11 seconds 00000100:00100000:1.0:1787367799.177285:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808445696 00000100:00100000:1.0:1787367799.177293:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808445696 00000100:00100000:1.0:1787367799.177339:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787367799.177349:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10374:x1874190808445696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367799.177486:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10374:x1874190808445696:12345-0@lo:502:llog_process_th.0 Request processed in 137us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367799.177493:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787367799.177633:0:10374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483796300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10374:1874190808445696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367799.177660:0:10374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367799.177675:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367799.177677:0:10374:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787367799.177683:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787367799.177707:0:10374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10374:1874190808445824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367799.177743:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.177781:0:10374:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559123ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.177889:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808445824 00000100:00100000:3.0:1787367799.177894:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808445824 00000100:00100000:3.0:1787367799.177927:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787367799.177933:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10374:x1874190808445824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.178013:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10374:x1874190808445824:12345-0@lo:502:llog_process_th.0 Request processed in 80us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.178019:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787367799.178141:0:10374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10374:1874190808445824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367799.178157:0:10374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367799.178161:0:10374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367799.178162:0:10374:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787367799.178166:0:10374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1787367799.178588:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1787367799.178610:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787367799.178619:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.178640:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367799.178651:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787367799.178654:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55834d5000 from 48 10000000:01000000:3.0:1787367799.178657:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787367799.178679:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.178686:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.178695:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367799.178707:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808445952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.178736:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.178772:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826240c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.178819:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808445952 00000100:00100000:0.0:1787367799.178824:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808445952 00000100:00100000:0.0:1787367799.178856:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787367799.178863:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808445952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367799.178871:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367799.178881:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68a400/0x66f5679bff030748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030741 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.178900:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68a400/0x66f5679bff030748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030741 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.178909:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68a400/0x66f5679bff030748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030741 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.178928:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a400, rc 0) 00000100:00100000:0.0:1787367799.178974:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808445952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.178980:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787367799.179094:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808445952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367799.179115:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.179124:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367799.179164:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.179185:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.179211:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826240c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367799.179285:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808446080 00000100:00100000:2.0:1787367799.179289:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808446080 00000100:00100000:2.0:1787367799.179317:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787367799.179323:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808446080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.179437:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808446080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.179444:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787367799.179620:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.179645:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.179678:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.179703:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826240c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367799.179740:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808446208 00000100:00100000:2.0:1787367799.179744:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808446208 00000100:00100000:2.0:1787367799.179776:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787367799.179782:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808446208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.179850:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808446208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.179856:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787367799.179915:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.180335:0:10375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10375:1874190808446336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.180404:0:10375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.180422:0:10375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624180 going to sleep for 11 seconds 00000100:00100000:1.0:1787367799.180553:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808446336 00000100:00100000:1.0:1787367799.180557:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808446336 00000100:00100000:1.0:1787367799.180591:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787367799.180598:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:10375:x1874190808446336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367799.180689:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:10375:x1874190808446336:12345-0@lo:502:llog_process_th.0 Request processed in 91us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367799.180696:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787367799.180820:0:10375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10375:1874190808446336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367799.180858:0:10375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10375:1874190808446464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367799.180890:0:10375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367799.180908:0:10375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367799.180965:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808446464 00000100:00100000:3.0:1787367799.180968:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808446464 00000100:00100000:3.0:1787367799.180987:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787367799.180993:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:10375:x1874190808446464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.181070:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:10375:x1874190808446464:12345-0@lo:502:llog_process_th.0 Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367799.181076:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787367799.181240:0:10375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10375:1874190808446464:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787367799.181257:0:10375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787367799.181576:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787367799.181594:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787367799.181601:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.181612:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367799.181621:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787367799.181623:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787367799.181626:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787367799.181652:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.181660:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.181669:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367799.181682:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.181707:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.181816:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.183642:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808446592 00000100:00100000:0.0:1787367799.183653:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808446592 00000100:00100000:0.0:1787367799.183742:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787367799.183752:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808446592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367799.183774:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367799.183790:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68a000/0x66f5679bff030756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03074f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.183812:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68a000/0x66f5679bff030756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03074f expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.183823:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68a000/0x66f5679bff030756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03074f expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.183830:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a000, rc 0) 00000100:00100000:0.0:1787367799.183904:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808446592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (2195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.183911:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787367799.184010:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367799.184026:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367799.184035:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367799.184110:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.184140:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.184169:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.184329:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808446720 00000100:00100000:0.0:1787367799.184333:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808446720 00000100:00100000:0.0:1787367799.184352:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787367799.184390:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808446720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.184484:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808446720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.184491:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787367799.188144:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.188206:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.188282:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.188327:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.188413:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808446848 00000100:00100000:0.0:1787367799.188419:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808446848 00000100:00100000:0.0:1787367799.188460:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787367799.188470:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808446848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.188587:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808446848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.188596:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787367799.189904:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808446848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367799.190671:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10376:1874190808446976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.190727:0:10376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.190805:0:10376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.190865:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808446976 00000100:00100000:0.0:1787367799.190870:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808446976 00000100:00100000:0.0:1787367799.190910:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787367799.190918:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10376:x1874190808446976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367799.192152:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10376:x1874190808446976:12345-0@lo:502:llog_process_th.0 Request processed in 1230us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.192163:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787367799.192265:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10376:1874190808446976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367799.192294:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367799.192304:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367799.192306:0:10376:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787367799.192311:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787367799.192338:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10376:1874190808447104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367799.192405:0:10376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367799.192431:0:10376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367799.192516:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808447104 00000100:00100000:2.0:1787367799.192521:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808447104 00000100:00100000:2.0:1787367799.192557:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787367799.192572:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10376:x1874190808447104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367799.192650:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10376:x1874190808447104:12345-0@lo:502:llog_process_th.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367799.192656:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787367799.192790:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10376:1874190808447104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367799.192807:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367799.192811:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367799.192812:0:10376:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787367799.192816:0:10376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787367799.193071:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1787367799.193090:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787367799.193099:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.193110:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367799.193119:0:6535:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787367799.193122:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c55b8aab370 from 1 10000000:01000000:2.0:1787367799.193125:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787367799.193147:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.193155:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.193165:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367799.193179:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808447232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.193207:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.193235:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.199072:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808447232 00000100:00100000:0.0:1787367799.199085:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808447232 00000100:00100000:0.0:1787367799.199135:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787367799.199156:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808447232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367799.199173:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367799.199189:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68bc00/0x66f5679bff030764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03075d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.199216:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68bc00/0x66f5679bff030764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03075d expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.199227:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68bc00/0x66f5679bff030764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03075d expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367799.199236:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68bc00, rc 0) 00000100:00100000:0.0:1787367799.199309:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808447232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (6101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367799.199316:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787367799.199476:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808447232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367799.199514:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030764 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.199524:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030764 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367799.199587:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808447360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367799.199619:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367799.199652:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367799.200037:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808447360 00000100:00100000:0.0:1787367799.200041:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808447360 00000100:00100000:0.0:1787367799.200074:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787367799.200082:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808447360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367799.200155:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808447360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (534us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787367799.200161:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787367799.200256:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808447360:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787367799.200280:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787367799.200286:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030764 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367799.200294:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030764 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367800.154404:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367801.176690:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367801.654663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367801.654764:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788466176 00000100:00100000:0.0:1787367801.654774:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788466176 00000100:00100000:0.0:1787367801.654840:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:0.0:1787367801.654850:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+8:6186:x1874190788466176:12345-192.168.203.4@tcp:101: 00010000:00010000:0.0:1787367801.654882:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367801.654911:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68b600/0x66f5679bff03076b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e5d1 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367801.654942:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68b600/0x66f5679bff03076b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5d1 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367801.654954:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68b600/0x66f5679bff03076b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5d1 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367801.654963:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b600, rc 0) 00000100:00100000:0.0:1787367801.655024:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+9:6186:x1874190788466176:12345-192.168.203.4@tcp:101: Request processed in 176us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.655031:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:1.0:1787367801.658149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367801.658280:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788466304 00000100:00100000:0.0:1787367801.658288:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788466304 00000100:00100000:0.0:1787367801.658449:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:0.0:1787367801.658461:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+9:6186:x1874190788466304:12345-192.168.203.4@tcp:501: 00000100:00100000:0.0:1787367801.658851:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+9:6186:x1874190788466304:12345-192.168.203.4@tcp:501: Request processed in 392us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.658859:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:1.0:1787367801.662615:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367801.667352:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788466432 00000100:00100000:3.0:1787367801.667392:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788466432 00000100:00100000:3.0:1787367801.667467:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:3.0:1787367801.667479:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+9:6186:x1874190788466432:12345-192.168.203.4@tcp:503: 00000100:00100000:3.0:1787367801.667630:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+9:6186:x1874190788466432:12345-192.168.203.4@tcp:503: Request processed in 152us (5022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367801.667638:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:1.0:1787367801.674981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367801.675092:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788466560 00000100:00100000:0.0:1787367801.675102:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788466560 00000100:00100000:0.0:1787367801.675155:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:0.0:1787367801.675165:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+9:6679:x1874190788466560:12345-192.168.203.4@tcp:502: 00000100:00100000:0.0:1787367801.675537:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+9:6679:x1874190788466560:12345-192.168.203.4@tcp:502: Request processed in 167us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.675556:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:3.0:1787367801.681951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367801.682124:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788466688 00000100:00100000:2.0:1787367801.682131:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788466688 00000100:00100000:2.0:1787367801.682256:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:2.0:1787367801.682266:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+9:6679:x1874190788466688:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787367801.682438:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+9:6679:x1874190788466688:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 173us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367801.682446:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:1.0:1787367801.688968:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367801.689100:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788466816 00000100:00100000:0.0:1787367801.689110:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788466816 00000100:00100000:0.0:1787367801.689162:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:0.0:1787367801.689173:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+9:6186:x1874190788466816:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367801.689201:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367801.689245:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613bc00/0x66f5679bff030772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e5d8 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367801.689275:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613bc00/0x66f5679bff030772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5d8 expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367801.689287:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613bc00/0x66f5679bff030772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5d8 expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367801.689296:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613bc00, rc 0) 00000100:00100000:0.0:1787367801.689399:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:6186:x1874190788466816:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 228us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.689405:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:1.0:1787367801.695254:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367801.695529:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788466944 00000100:00100000:2.0:1787367801.695539:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788466944 00000100:00100000:2.0:1787367801.695603:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:2.0:1787367801.695627:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:6186:x1874190788466944:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367801.695732:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:6186:x1874190788466944:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 107us (487us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787367801.696255:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:3.0:1787367801.752665:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808447616:0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.752756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.752759:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808447872:0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.752800:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.752845:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808448384:0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.752853:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808448128:0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.752871:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.752890:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808448896:0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.752911:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.752922:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367801.752938:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808448640:0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.752953:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787367801.752967:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.752970:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808447744:0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.752993:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787367801.753002:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808447488:0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.753006:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.753034:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808448256:0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.753043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.753064:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367801.753087:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808448000:0@lo:400:kworker.0 00000100:00100000:2.0:1787367801.753398:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808448384 00000100:00100000:2.0:1787367801.753405:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808448384 00000100:00100000:2.0:1787367801.753452:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808448896 00000100:00100000:2.0:1787367801.753456:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808448896 00000100:00100000:3.0:1787367801.755814:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.755814:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808448768:0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.755862:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808448512:0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.755919:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.755923:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367801.755937:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808449024:0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.755962:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.755969:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808447616 00000100:00100000:0.0:1787367801.755977:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808447616 00000100:00100000:3.0:1787367801.755984:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808449152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367801.756007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367801.756016:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808447872 00000100:00100000:0.0:1787367801.756022:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808447872 00000100:00100000:3.0:1787367801.756045:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808448128 00000100:00100000:3.0:1787367801.756049:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808448128 00000100:00100000:3.0:1787367801.756069:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808448640 00000100:00100000:3.0:1787367801.756071:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808448640 00000100:00100000:3.0:1787367801.756081:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808448256 00000100:00100000:3.0:1787367801.756084:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808448256 00000100:00100000:3.0:1787367801.756096:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808448768 00000100:00100000:3.0:1787367801.756099:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808448768 00000100:00100000:0.0:1787367801.756113:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787367801.756124:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808447616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.756129:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787367801.756140:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808448128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.756195:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808447616:12345-0@lo:400:kworker.0 Request processed in 72us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.756204:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787367801.756291:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787367801.756300:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808448640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.756332:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808448640:12345-0@lo:400:kworker.0 Request processed in 34us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.756338:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787367801.756352:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787367801.756378:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808448256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.756524:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808448256:12345-0@lo:400:kworker.0 Request processed in 147us (3461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.756531:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787367801.756543:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787367801.756561:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808447872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.756592:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808447872:12345-0@lo:400:kworker.0 Request processed in 31us (3792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.756597:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787367801.756609:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787367801.756614:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808448768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.756640:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808448768:12345-0@lo:400:kworker.0 Request processed in 26us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.756646:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1787367801.756681:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afad9f80 x1874190808448256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367801.756694:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808448256:0@lo:400:kworker.0 00010000:00080000:0.0:1787367801.756705:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afada680 x1874190808448768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367801.756714:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808448768:0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.756723:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808447872:0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.756774:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808447744 00000100:00100000:0.0:1787367801.756778:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808447744 00000100:00100000:0.0:1787367801.756798:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808448000 00000100:00100000:0.0:1787367801.756801:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808448000 00000100:00100000:0.0:1787367801.756811:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808449152 00000100:00100000:0.0:1787367801.756813:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808449152 00000100:00100000:2.0:1787367801.756902:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787367801.756905:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787367801.756916:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808447744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.756958:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808447744:12345-0@lo:400:kworker.0 Request processed in 45us (3954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.756973:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787367801.756985:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787367801.756990:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808448000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.757020:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808448000:12345-0@lo:400:kworker.0 Request processed in 30us (3904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.757027:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787367801.757050:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808448384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.757144:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787367801.757153:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808449152:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367801.757164:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808448384:12345-0@lo:400:kworker.0 Request processed in 245us (4286us total) trans 0 rc 0/0 00000004:00000024:0.0:1787367801.757178:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787367801.757211:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808449152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.758581:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787367801.758633:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808447744:0@lo:400:kworker.0 00010000:00080000:0.0:1787367801.758649:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afad9180 x1874190808448384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367801.758658:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808448384:0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.758722:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808447488 00000100:00100000:0.0:1787367801.758728:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808447488 00000100:00100000:0.0:1787367801.758775:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787367801.758783:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808447488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.758843:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808447488:12345-0@lo:400:kworker.0 Request processed in 60us (5800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.758849:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787367801.758891:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808448512 00000100:00100000:0.0:1787367801.758906:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808448512 00000100:00100000:1.0:1787367801.760029:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787367801.760048:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808448896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367801.760111:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808448896:12345-0@lo:400:kworker.0 Request processed in 71us (7190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367801.760127:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787367801.760145:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808449024 00000100:00100000:1.0:1787367801.760150:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808449024 00000100:00100000:1.0:1787367801.760172:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787367801.760178:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808449024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367801.760209:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808449024:12345-0@lo:400:kworker.0 Request processed in 31us (4248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367801.760216:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787367801.760251:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afad9500 x1874190808448896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367801.760262:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808448896:0@lo:400:kworker.0 00000100:00080000:1.0:1787367801.760303:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367801.760308:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367801.760311:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367801.760314:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367801.760376:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808449152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367801.760389:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808447488:0@lo:400:kworker.0 00000100:00100000:1.0:1787367801.760401:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808448000:0@lo:400:kworker.0 00010000:00080000:1.0:1787367801.760413:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadb100 x1874190808449024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367801.760423:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808449024:0@lo:400:kworker.0 00000100:00100000:1.0:1787367801.760435:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808448128:0@lo:400:kworker.0 00000100:00100000:1.0:1787367801.760446:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808448640:0@lo:400:kworker.0 00000100:00100000:1.0:1787367801.760465:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808447616:0@lo:400:kworker.0 00000100:00100000:3.0:1787367801.764629:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808448128:12345-0@lo:400:kworker.0 Request processed in 58us (3285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367801.764665:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787367801.765863:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787367801.765930:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787367801.765950:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808448512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367801.766049:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808448512:12345-0@lo:400:kworker.0 Request processed in 109us (10135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367801.766056:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787367801.766785:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afad8000 x1874190808448512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367801.766800:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808448512:0@lo:400:kworker.0 00010000:00010000:0.0:1787367802.201759:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367802.264711:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367802.264734:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808449280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367802.264820:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367802.265030:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808449280 00000100:00100000:1.0:1787367802.265037:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808449280 00000100:00100000:1.0:1787367802.265087:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787367802.265096:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808449280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367802.265122:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367802.265171:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808449280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367802.265178:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787367802.265215:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0a680 x1874190808449280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367802.265232:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808449280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367802.265642:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808449408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367802.265673:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367802.265699:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808449408 00000100:00100000:1.0:1787367802.265704:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808449408 00000100:00100000:1.0:1787367802.265727:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787367802.265733:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808449408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367802.265753:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367802.265944:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808449536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367802.277065:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808449408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11321us (11381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367802.277079:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787367802.277152:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c00a80 x1874190808449408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367802.277176:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808449408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367802.277409:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367802.278588:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808449536 00000100:00100000:1.0:1787367802.278598:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808449536 00000100:00100000:1.0:1787367802.278643:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787367802.278652:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808449536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367802.278681:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367802.278751:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808449536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367802.278758:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787367802.280618:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0a680 x1874190808449536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367802.280643:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808449536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367802.680429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367802.680482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367802.680513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367802.680532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367802.680555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367802.680596:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788467328 00000100:00100000:0.0:1787367802.680614:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788467328 00000100:00100000:0.0:1787367802.680667:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788467200 00000100:00100000:3.0:1787367802.680688:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788467072 00000100:00100000:3.0:1787367802.680692:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788467072 00000100:00100000:3.0:1787367802.680724:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:3.0:1787367802.680744:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:2405:x1874190788467072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367802.680809:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:2405:x1874190788467072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367802.680816:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:1.0:1787367802.680846:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:1.0:1787367802.680855:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788467328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367802.680899:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788467328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367802.680906:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:1.0:1787367802.680932:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788467584 00000100:00100000:1.0:1787367802.680934:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788467584 00000100:00100000:1.0:1787367802.680973:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788467456 00000100:00100000:1.0:1787367802.680975:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788467456 00000100:00100000:1.0:1787367802.681002:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1787367802.681009:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788467584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367802.681040:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788467584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367802.681046:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1787367802.681060:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1787367802.681067:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788467456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367802.681108:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788467456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367802.681130:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00080000:1.0:1787367802.681150:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367802.681155:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367802.681158:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367802.681870:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788467200 00000100:00100000:0.0:1787367802.681934:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:0.0:1787367802.681943:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788467200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367802.681983:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788467200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367802.681990:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00080000:1.0:1787367802.682409:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1787367802.712522:0:10413:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc90488b0 20000000:00000080:3.0:1787367802.712538:0:10413:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c54835ae400 uarg=0000000000000000 20000000:01000000:3.0:1787367802.712577:0:10413:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787367802.712583:0:10413:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787367802.712587:0:10413:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787367802.717328:0:10414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787367802.718108:0:10413:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787367802.725934:0:10413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787367802.725990:0:10413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787367802.726006:0:10413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787367802.726022:0:10413:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787367802.726040:0:10413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726076:0:10413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55c2175a00/0x66f5679bff030415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03040e expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726084:0:10413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03041c expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726092:0:10413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030470 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726099:0:10413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030596 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726108:0:10413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e599 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726116:0:10413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726154:0:10413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e599 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726169:0:10413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e599 expref: 9 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367802.726183:0:10413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808449664:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367802.726280:0:10413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030596 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726288:0:10413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030596 expref: 23 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367802.726304:0:10413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808449792:0@lo:104: 00000100:00100000:0.0:1787367802.726339:0:10413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367802.726406:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808449792 00000100:00100000:0.0:1787367802.726413:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808449792 00000100:00100000:0.0:1787367802.726455:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367802.726463:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10413:x1874190808449792:12345-0@lo:104: 00010000:00010000:0.0:1787367802.726475:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726517:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787367802.726522:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10413:x1874190808449792:12345-0@lo:104: Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367802.726528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1787367802.726548:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367802.726553:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726561:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83a00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367802.726564:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726572:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367802.726579:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367802.726585:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787367802.726630:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726636:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367802.726654:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.726661:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa83a00/0x66f5679bff030596 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03059d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.726954:0:10413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030470 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.726966:0:10413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030470 expref: 23 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367802.726975:0:10413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808450048:0@lo:104: 00000100:00100000:1.0:1787367802.727008:0:10413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367802.727039:0:10413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03041c expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.727047:0:10413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03041c expref: 23 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367802.727057:0:10413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808450176:0@lo:104: 00010000:00010000:1.0:1787367802.727082:0:10413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55c2175a00/0x66f5679bff030415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03040e expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.727091:0:10413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55c2175a00/0x66f5679bff030415 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03040e expref: 23 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367802.727098:0:10413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808450304:0@lo:104: 00000100:00100000:1.0:1787367802.727115:0:10413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787367802.727135:0:10413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808449792:0@lo:104: 00000100:00100000:1.0:1787367802.727182:0:6521:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787367802.727200:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367802.727215:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367802.727223:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808450048 00000100:00100000:1.0:1787367802.727227:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808450048 00000100:00100000:1.0:1787367802.727250:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808450176 00000100:00100000:1.0:1787367802.727253:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808450176 00000100:00100000:1.0:1787367802.727263:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808450304 00000100:00100000:1.0:1787367802.727266:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808450304 00000100:00100000:1.0:1787367802.727278:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787367802.727286:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483643850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:10413:x1874190808450048:12345-0@lo:104: 00010000:00010000:1.0:1787367802.727295:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.727341:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367802.727346:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483643850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:10413:x1874190808450048:12345-0@lo:104: Request processed in 62us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367802.727384:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787367802.727429:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787367802.727436:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:10413:x1874190808450176:12345-0@lo:104: 00010000:00010000:1.0:1787367802.727444:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.727481:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787367802.727486:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:10413:x1874190808450176:12345-0@lo:104: Request processed in 51us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367802.727492:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787367802.727503:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787367802.727508:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10413:x1874190808450304:12345-0@lo:104: 00010000:00010000:1.0:1787367802.727521:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.727549:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787367802.727554:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:10413:x1874190808450304:12345-0@lo:104: Request processed in 47us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367802.727560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787367802.727586:0:10413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808450048:0@lo:104: 00000100:00100000:1.0:1787367802.727594:0:10413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808450176:0@lo:104: 00000100:00100000:1.0:1787367802.727599:0:10413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808450304:0@lo:104: 00010000:00010000:1.0:1787367802.727617:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787367802.727621:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.727628:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68be00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787367802.727631:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.727640:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367802.727646:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367802.727652:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787367802.727801:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367802.727807:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727812:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ac00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367802.727815:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727821:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367802.727828:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367802.727833:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787367802.727847:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727853:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367802.727870:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727887:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ac00/0x66f5679bff03041c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030423 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727898:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367802.727901:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727906:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175c00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367802.727909:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727916:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367802.727922:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367802.727927:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787367802.727938:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727943:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367802.727949:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727955:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff03040e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030415 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.727963:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367802.727968:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367802.727970:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367802.727977:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367802.727988:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808450688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367802.728018:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367802.728040:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367802.728045:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808450560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367802.728065:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367802.728089:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808450688 00000100:00100000:0.0:1787367802.728093:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808450688 00010000:00010000:0.0:1787367802.728112:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55c2175a00/0x66f5679bff030415 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03040e expref: 24 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367802.728131:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808450560 00000100:00100000:0.0:1787367802.728134:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808450560 00010000:00010000:0.0:1787367802.728145:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03041c expref: 25 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367802.728161:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787367802.728167:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3654:x1874190808450688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367802.728176:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367802.728180:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55c2175a00/0x66f5679bff030415 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03040e expref: 25 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.728190:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55c2175a00/0x66f5679bff030415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03040e expref: 25 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.728203:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2175a00/0x66f5679bff030415 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03040e expref: 25 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.728223:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367802.728246:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808450688:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367802.728252:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787367802.728263:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787367802.728269:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:3654:x1874190808450560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367802.728275:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367802.728279:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03041c expref: 23 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.728288:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03041c expref: 23 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.728297:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2175600/0x66f5679bff030423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03041c expref: 23 pid: 6532 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.728305:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367802.728320:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3654:x1874190808450560:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367802.728325:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787367802.728351:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808450560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367802.728373:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808450688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367802.728426:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.728434:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367802.728447:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.728454:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68be00/0x66f5679bff030470 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030477 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.728466:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367802.728468:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367802.728469:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367802.728505:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808450432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367802.728527:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367802.728549:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367802.728553:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808449920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367802.728571:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367802.729170:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808450432 00000100:00100000:0.0:1787367802.729176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808450432 00010000:00010000:0.0:1787367802.729194:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030470 expref: 22 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367802.729570:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808449920 00000100:00100000:0.0:1787367802.729575:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808449920 00010000:00010000:0.0:1787367802.729589:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030596 expref: 23 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367802.729617:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787367802.729624:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:3651:x1874190808450432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367802.729633:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367802.729637:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030470 expref: 23 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.729647:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030470 expref: 23 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.729660:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55814a0a00/0x66f5679bff030477 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030470 expref: 23 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.730892:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367802.730972:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3651:x1874190808450432:12345-0@lo:103:ldlm_bl.0 Request processed in 1345us (2441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367802.730982:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787367802.731007:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787367802.731016:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3651:x1874190808449920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367802.731028:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367802.731035:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030596 expref: 21 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.731046:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030596 expref: 21 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.731070:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68b800/0x66f5679bff03059d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030596 expref: 21 pid: 6533 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367802.731081:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367802.731105:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:3651:x1874190808449920:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367802.731111:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787367802.732137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367802.732182:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808449920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367802.732192:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808450432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367802.732224:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788467712 00000100:00100000:3.0:1787367802.732230:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788467712 00010000:00010000:3.0:1787367802.732337:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e599 expref: 10 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367802.732391:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:3.0:1787367802.732462:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:926ebb72-6750-4035-807e-0762300bea95+10:2402:x1874190788467712:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367802.732474:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367802.732480:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e599 expref: 10 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.732493:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e599 expref: 10 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.732512:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.732520:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.732537:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.732544:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.732550:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.732557:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.732563:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367802.732566:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.732574:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.732905:0:10413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2174c00/0x66f5679bff0306b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e599 expref: 10 pid: 6532 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367802.732919:0:10413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10413:1874190808449664:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367802.732947:0:10413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.732956:0:10413:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367802.732962:0:10413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.734174:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.734191:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613a200/0x66f5679bff030779 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367802.734209:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367802.734801:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:926ebb72-6750-4035-807e-0762300bea95+9:2402:x1874190788467712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 2117us (2444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367802.734813:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:3.0:1787367802.784016:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367802.784041:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808450816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367802.784111:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367802.784180:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808450816 00000100:00100000:3.0:1787367802.784187:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808450816 00000100:00100000:3.0:1787367802.784232:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787367802.784242:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808450816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367802.784262:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367802.784304:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808450816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367802.784311:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787367802.784350:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0aa00 x1874190808450816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367802.784391:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808450816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367803.224578:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367803.706242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367803.706323:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788467840 00000100:00100000:1.0:1787367803.706332:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788467840 00000100:00100000:1.0:1787367803.706437:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:1.0:1787367803.706456:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+9:6186:x1874190788467840:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367803.706472:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367803.706492:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e5df expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367803.706517:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5df expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367803.706534:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5df expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367803.706542:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673000, rc 0) 00000100:00100000:1.0:1787367803.706591:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:6186:x1874190788467840:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 138us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367803.706598:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:1.0:1787367803.710903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367803.711137:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788467968 00000100:00100000:3.0:1787367803.711159:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788467968 00000100:00100000:3.0:1787367803.711212:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:3.0:1787367803.711223:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:6186:x1874190788467968:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367803.711379:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:6186:x1874190788467968:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 157us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367803.711387:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:3.0:1787367803.713468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367803.719078:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788468096 00000100:00100000:3.0:1787367803.719090:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788468096 00000100:00100000:3.0:1787367803.719148:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00100000:3.0:1787367803.719157:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:6186:x1874190788468096:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367803.719291:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:6186:x1874190788468096:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 135us (5829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367803.719300:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00100000:1.0:1787367803.728530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367803.728611:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788468224 00000100:00100000:2.0:1787367803.728620:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788468224 00000100:00100000:2.0:1787367803.728665:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 253 00000100:00100000:2.0:1787367803.728675:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:6737:x1874190788468224:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787367803.728861:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:6737:x1874190788468224:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 186us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367803.728870:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 253 00000100:00100000:1.0:1787367803.731893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367803.731982:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788468352 00000100:00100000:3.0:1787367803.731992:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788468352 00000100:00100000:3.0:1787367803.732044:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:3.0:1787367803.732054:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:6737:x1874190788468352:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787367803.732192:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:6737:x1874190788468352:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 139us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367803.732201:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:0.0:1787367803.800857:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808450944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787367803.800927:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367803.801758:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808450944 00000100:00100000:2.0:1787367803.801766:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808450944 00000100:00100000:2.0:1787367803.801952:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787367803.801963:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808450944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367803.801996:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367803.802097:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808450944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367803.802105:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787367803.802191:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808450944:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787367804.249713:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787367804.377389:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787367804.377399:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bc4cb000 from 4 10000000:01000000:1.0:1787367804.377405:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787367804.377459:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367804.377471:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367804.377482:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367804.377523:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787367804.377590:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367804.377653:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.380262:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808451072 00000100:00100000:3.0:1787367804.380277:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808451072 00000100:00100000:3.0:1787367804.380371:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787367804.380382:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808451072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367804.380420:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367804.380440:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030787 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.380468:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030787 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.380480:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030787 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.380489:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a1600, rc 0) 00000100:00100000:3.0:1787367804.380568:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808451072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (2978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.380576:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787367804.380632:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367804.380651:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.380661:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367804.380748:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.380782:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.380815:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54835e3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.380830:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808451200 00000100:00100000:3.0:1787367804.380834:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808451200 00000100:00100000:3.0:1787367804.380857:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787367804.380864:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808451200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.380971:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808451200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.380978:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787367804.381008:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.381034:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.381088:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.381100:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54835e3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.381110:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808451328 00000100:00100000:3.0:1787367804.381113:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808451328 00000100:00100000:3.0:1787367804.381131:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787367804.381136:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808451328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.381201:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808451328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.381208:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787367804.381245:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.381461:0:10481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10481:1874190808451456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.381491:0:10481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.381506:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808451456 00000100:00100000:3.0:1787367804.381509:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808451456 00000100:00100000:3.0:1787367804.381525:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787367804.381530:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10481:x1874190808451456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.381582:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10481:x1874190808451456:12345-0@lo:502:llog_process_th.0 Request processed in 52us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.381589:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787367804.381614:0:10481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54835e3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.381623:0:10481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10481:1874190808451456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367804.381639:0:10481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367804.381646:0:10481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367804.381648:0:10481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787367804.381654:0:10481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55bc4cb000 00000020:00000080:3.0:1787367804.381656:0:10481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787367804.381735:0:10481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10481:1874190808451584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.381762:0:10481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.381776:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808451584 00000100:00100000:3.0:1787367804.381779:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808451584 00000100:00100000:3.0:1787367804.381794:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787367804.381799:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10481:x1874190808451584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.381844:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:10481:x1874190808451584:12345-0@lo:502:llog_process_th.0 Request processed in 44us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.381851:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787367804.381873:0:10481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54835e3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.381881:0:10481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10481:1874190808451584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367804.381894:0:10481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367804.381898:0:10481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367804.381899:0:10481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787367804.381902:0:10481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787367804.381943:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787367804.381956:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367804.381963:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.381972:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367804.381986:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367804.381989:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bd606800 from 4 10000000:01000000:3.0:1787367804.381991:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367804.382009:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.382016:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.382024:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367804.382035:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.382054:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.382064:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54835e3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.382073:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808451712 00000100:00100000:3.0:1787367804.382076:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808451712 00000100:00100000:3.0:1787367804.382091:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787367804.382096:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808451712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367804.382102:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367804.382110:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030795 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.382125:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030795 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.382134:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030795 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.382153:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2174c00, rc 0) 00000100:00100000:3.0:1787367804.382176:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808451712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.382181:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787367804.382206:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367804.382216:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.382224:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367804.382256:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.382275:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.382285:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54835e3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.382294:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808451840 00000100:00100000:3.0:1787367804.382297:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808451840 00000100:00100000:3.0:1787367804.382311:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787367804.382316:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808451840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.382394:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808451840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.382400:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787367804.382423:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.382441:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.382474:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.382488:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54835e3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.382496:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808451968 00000100:00100000:3.0:1787367804.382499:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808451968 00000100:00100000:3.0:1787367804.382514:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787367804.382519:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808451968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.382568:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808451968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 48us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.382574:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787367804.382601:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808451968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.382797:0:10482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10482:1874190808452096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.382824:0:10482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.382838:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808452096 00000100:00100000:3.0:1787367804.382841:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808452096 00000100:00100000:3.0:1787367804.382856:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787367804.382861:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:10482:x1874190808452096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.382908:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:10482:x1874190808452096:12345-0@lo:502:llog_process_th.0 Request processed in 46us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.382914:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787367804.382936:0:10482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b61536c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.382944:0:10482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10482:1874190808452096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367804.382959:0:10482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367804.382964:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367804.382966:0:10482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787367804.382970:0:10482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55bd606800 00000020:00000080:3.0:1787367804.382972:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787367804.383014:0:10482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10482:1874190808452224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.383047:0:10482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.383061:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808452224 00000100:00100000:3.0:1787367804.383063:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808452224 00000100:00100000:3.0:1787367804.383078:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787367804.383083:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:10482:x1874190808452224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.383126:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:10482:x1874190808452224:12345-0@lo:502:llog_process_th.0 Request processed in 42us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.383132:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787367804.383152:0:10482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b61536c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.383161:0:10482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10482:1874190808452224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367804.383173:0:10482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367804.383177:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367804.383178:0:10482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787367804.383181:0:10482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787367804.383212:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787367804.383225:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367804.383230:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.383240:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367804.383248:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367804.383250:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bc6be800 from 4 10000000:01000000:3.0:1787367804.383252:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367804.383267:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.383273:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.383286:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367804.383297:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808452352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.383317:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.383327:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b61536c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.383336:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808452352 00000100:00100000:3.0:1787367804.383338:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808452352 00000100:00100000:3.0:1787367804.383381:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787367804.383387:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808452352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367804.383393:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367804.383402:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0307a3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.383415:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0307a3 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.383424:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0307a3 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.383431:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175a00, rc 0) 00000100:00100000:3.0:1787367804.383451:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808452352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.383457:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787367804.383487:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808452352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367804.383496:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.383508:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367804.383540:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808452480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.383560:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.383570:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b61536c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.383578:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808452480 00000100:00100000:3.0:1787367804.383581:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808452480 00000100:00100000:3.0:1787367804.383596:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787367804.383601:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808452480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.383655:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808452480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.383661:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787367804.383683:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808452480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.383700:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808452608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.399438:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.399558:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808452608 00000100:00100000:3.0:1787367804.399568:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808452608 00000100:00100000:3.0:1787367804.399614:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787367804.399624:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808452608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.399770:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808452608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.399778:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787367804.399900:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b61536c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.399930:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808452608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367804.406922:0:10484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10484:1874190808452736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367804.407013:0:10484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367804.408523:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808452736 00000100:00100000:0.0:1787367804.408535:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808452736 00000100:00100000:3.0:1787367804.416398:0:10484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5598213900 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.416668:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787367804.416686:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10484:x1874190808452736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.416870:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10484:x1874190808452736:12345-0@lo:502:llog_process_th.0 Request processed in 192us (9857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.416880:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787367804.416956:0:10484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10484:1874190808452736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367804.416995:0:10484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367804.417006:0:10484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367804.417009:0:10484:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787367804.417017:0:10484:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55bc6be800 00000020:00000080:3.0:1787367804.417019:0:10484:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787367804.423779:0:10484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10484:1874190808452864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.423880:0:10484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.423919:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808452864 00000100:00100000:3.0:1787367804.423926:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808452864 00000100:00100000:3.0:1787367804.423974:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787367804.423986:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10484:x1874190808452864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.424167:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:10484:x1874190808452864:12345-0@lo:502:llog_process_th.0 Request processed in 182us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.424175:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787367804.424230:0:10484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6153240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.424252:0:10484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10484:1874190808452864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367804.424280:0:10484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367804.424292:0:10484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367804.424295:0:10484:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787367804.424298:0:10484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787367804.424396:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787367804.424414:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367804.424423:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.424434:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367804.424444:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367804.424446:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55834d5000 from 4 10000000:01000000:3.0:1787367804.424449:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367804.424472:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.424479:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.424488:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367804.424502:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808452992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.424529:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367804.439335:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808452992 00000100:00100000:3.0:1787367804.439347:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6153240 going to sleep for 11 seconds 00000100:00100000:0.0:1787367804.439353:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808452992 00000100:00100000:0.0:1787367804.439458:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787367804.439469:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808452992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367804.439489:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367804.439510:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0307b1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367804.439540:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0307b1 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367804.439630:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0307b1 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367804.439652:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613ae00, rc 0) 00000100:00100000:0.0:1787367804.439869:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808452992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 402us (15338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367804.439877:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787367804.441248:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808452992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367804.441282:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.441296:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367804.441421:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808453120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.441485:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.441523:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6153240 going to sleep for 11 seconds 00000100:00100000:0.0:1787367804.441646:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808453120 00000100:00100000:0.0:1787367804.441653:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808453120 00000100:00100000:0.0:1787367804.441717:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787367804.441735:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808453120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367804.441879:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808453120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367804.441886:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787367804.442613:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808453120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.442651:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808453248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.442703:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367804.442742:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6153240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.442762:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808453248 00000100:00100000:3.0:1787367804.442767:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808453248 00000100:00100000:3.0:1787367804.442805:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787367804.442812:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808453248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367804.442902:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808453248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.442910:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787367804.442952:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808453248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367804.448426:0:10487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10487:1874190808453376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367804.448522:0:10487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367804.448635:0:10487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54810f4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367804.452025:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808453376 00000100:00100000:3.0:1787367804.452039:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808453376 00000100:00100000:3.0:1787367804.452116:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787367804.452127:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:10487:x1874190808453376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.452288:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:10487:x1874190808453376:12345-0@lo:502:llog_process_th.0 Request processed in 164us (3766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.452297:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787367804.453172:0:10487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10487:1874190808453376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367804.453222:0:10487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367804.453232:0:10487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367804.453234:0:10487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787367804.453246:0:10487:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55834d5000 00000020:00000080:2.0:1787367804.453249:0:10487:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787367804.453340:0:10487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10487:1874190808453504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367804.453406:0:10487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367804.453434:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808453504 00000100:00100000:2.0:1787367804.453439:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808453504 00000100:00100000:3.0:1787367804.453464:0:10487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54810f4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787367804.453471:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787367804.453478:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:10487:x1874190808453504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367804.455394:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:10487:x1874190808453504:12345-0@lo:502:llog_process_th.0 Request processed in 1908us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367804.455407:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787367804.455672:0:10487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:10487:1874190808453504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367804.455779:0:10487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367804.455787:0:10487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367804.455789:0:10487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787367804.455797:0:10487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787367804.456974:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787367804.456999:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367804.457009:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367804.457021:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367805.273522:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367806.305368:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367806.872732:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808453632:0@lo:400:kworker.0 00000100:00100000:0.0:1787367806.872801:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367806.873547:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808453632 00000100:00100000:3.0:1787367806.873555:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808453632 00000100:00100000:3.0:1787367806.873605:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787367806.873615:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808453632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367806.873957:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808454144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367806.873990:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.874132:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808454016:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874160:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.874179:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808454528:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874195:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.874207:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808455040:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874222:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.874237:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787367806.874242:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808454656:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874260:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.874273:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808455168:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874288:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.874310:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808454016 00000100:00100000:2.0:1787367806.874315:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808454016 00000100:00100000:2.0:1787367806.874341:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808454528 00000100:00100000:2.0:1787367806.874343:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808454528 00000100:00100000:2.0:1787367806.874374:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808455040 00000100:00100000:2.0:1787367806.874376:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808455040 00000100:00100000:2.0:1787367806.874389:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787367806.874395:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808454016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874440:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808454016:12345-0@lo:400:kworker.0 Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.874459:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787367806.874473:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787367806.874478:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808454528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874506:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808454528:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.874512:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787367806.874522:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787367806.874527:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808455040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874552:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808455040:12345-0@lo:400:kworker.0 Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.874558:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787367806.874578:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808454656 00000100:00100000:2.0:1787367806.874581:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808454656 00000100:00100000:2.0:1787367806.874601:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808455168 00000100:00100000:2.0:1787367806.874603:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808455168 00000100:00100000:2.0:1787367806.874618:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787367806.874623:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808454656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874648:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808454656:12345-0@lo:400:kworker.0 Request processed in 25us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.874664:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787367806.874866:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787367806.874873:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808455168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.874901:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808455168:12345-0@lo:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.874906:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787367806.874932:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367806.874935:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367806.874938:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787367806.874965:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c00000 x1874190808454656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367806.874978:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808454656:0@lo:400:kworker.0 00010000:00080000:2.0:1787367806.874986:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c01880 x1874190808455168/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367806.874994:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808455168:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875003:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808454016:0@lo:400:kworker.0 00010000:00080000:2.0:1787367806.875010:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c01180 x1874190808454528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367806.875018:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808454528:0@lo:400:kworker.0 00010000:00080000:2.0:1787367806.875025:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c00a80 x1874190808455040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367806.875032:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808455040:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875075:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808453760:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875101:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.875120:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808454272:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875139:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.875155:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808454784:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.875189:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808455296:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875221:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.875239:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787367806.875245:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808453888:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875265:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.875281:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808454400:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.875314:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808454912:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875330:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367806.875351:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808454144 00000100:00100000:2.0:1787367806.875375:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808454144 00000100:00100000:2.0:1787367806.875397:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808454272 00000100:00100000:2.0:1787367806.875399:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808454272 00000100:00100000:2.0:1787367806.875409:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808453888 00000100:00100000:2.0:1787367806.875411:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808453888 00000100:00100000:2.0:1787367806.875421:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787367806.875441:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808454144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787367806.875481:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787367806.875517:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808454144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.875523:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787367806.875536:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787367806.875542:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808454272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875573:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808454272:12345-0@lo:400:kworker.0 Request processed in 32us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.875579:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787367806.875589:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787367806.875596:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808453888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875631:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808453888:12345-0@lo:400:kworker.0 Request processed in 36us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.875637:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787367806.875665:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808453760 00000100:00100000:2.0:1787367806.875737:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808453760 00000100:00100000:2.0:1787367806.875755:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808454400 00000100:00100000:2.0:1787367806.875758:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808454400 00000100:00100000:2.0:1787367806.875776:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808454912 00000100:00100000:2.0:1787367806.875779:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808454912 00000100:00100000:2.0:1787367806.875791:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787367806.875797:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808453760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875826:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808453760:12345-0@lo:400:kworker.0 Request processed in 29us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.875831:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787367806.875843:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787367806.875848:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808454400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875873:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808454400:12345-0@lo:400:kworker.0 Request processed in 25us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.875879:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787367806.875896:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787367806.875902:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808454912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.875927:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808454912:12345-0@lo:400:kworker.0 Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.875933:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787367806.875950:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808454784 00000100:00100000:2.0:1787367806.875953:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808454784 00000100:00100000:2.0:1787367806.875973:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808455296 00000100:00100000:2.0:1787367806.875983:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808455296 00000100:00100000:2.0:1787367806.876008:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787367806.876013:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808454784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.876043:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808454784:12345-0@lo:400:kworker.0 Request processed in 30us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.876049:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787367806.876058:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787367806.876064:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b62fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808455296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.876088:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b62fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808455296:12345-0@lo:400:kworker.0 Request processed in 25us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367806.876093:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787367806.876231:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367806.876235:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367806.876237:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367806.876266:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808453888:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.876277:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808454400:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.876287:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808454912:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.876297:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808453760:0@lo:400:kworker.0 00000100:00100000:2.0:1787367806.876305:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808454272:0@lo:400:kworker.0 00010000:00080000:2.0:1787367806.876321:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c00e00 x1874190808454784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367806.876330:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808454784:0@lo:400:kworker.0 00010000:00080000:2.0:1787367806.876342:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c02680 x1874190808455296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367806.876385:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808455296:0@lo:400:kworker.0 00000100:00100000:3.0:1787367806.876827:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808453632:12345-0@lo:400:kworker.0 Request processed in 3211us (4023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367806.876837:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787367806.890502:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808453632:0@lo:400:kworker.0 00000100:00100000:0.0:1787367806.890559:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808454144:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787367807.321722:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367807.384743:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808455424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367807.384831:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367807.384996:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808455424 00000100:00100000:1.0:1787367807.385004:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808455424 00000100:00100000:1.0:1787367807.385057:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787367807.385066:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808455424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367807.385095:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367807.385144:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808455424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367807.385152:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787367807.385189:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c08380 x1874190808455424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367807.385206:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808455424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367807.385640:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808455552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367807.385669:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367807.385695:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367807.385711:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808455680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367807.385735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367807.385755:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808455552 00000100:00100000:1.0:1787367807.385759:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808455552 00000100:00100000:1.0:1787367807.385776:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808455680 00000100:00100000:1.0:1787367807.385779:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808455680 00000100:00100000:1.0:1787367807.385791:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787367807.386145:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808455552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367807.386163:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367807.387517:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808455552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1370us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367807.387529:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787367807.387557:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787367807.387569:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808455680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367807.387586:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367807.387628:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808455680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367807.387634:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787367807.390907:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c08380 x1874190808455552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367807.390933:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808455552:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787367807.390960:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0b480 x1874190808455680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367807.390986:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808455680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367807.796666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367807.796718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367807.796748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367807.796767:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367807.796788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367807.796815:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788468864 00000100:00100000:0.0:1787367807.796823:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788468864 00000100:00100000:0.0:1787367807.796875:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788468992 00000100:00100000:0.0:1787367807.796879:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788468992 00000100:00100000:0.0:1787367807.796899:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1787367807.796908:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788468864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367807.796970:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788468864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367807.796978:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1787367807.797070:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:0.0:1787367807.797078:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788468992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367807.797104:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788468992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367807.797111:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:0.0:1787367807.797129:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788468480 00000100:00100000:0.0:1787367807.797133:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788468480 00000100:00100000:0.0:1787367807.797239:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 276 00000100:00100000:0.0:1787367807.797246:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:2405:x1874190788468480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367807.797447:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:2405:x1874190788468480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 200us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367807.797454:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 276 00000100:00100000:0.0:1787367807.797484:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788468608 00000100:00100000:0.0:1787367807.797487:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788468608 00000100:00100000:0.0:1787367807.797515:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788468736 00000100:00100000:0.0:1787367807.797518:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788468736 00000100:00100000:0.0:1787367807.797620:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:0.0:1787367807.797628:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788468608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367807.797656:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788468608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367807.797662:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:0.0:1787367807.797674:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1787367807.797679:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788468736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367807.797712:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788468736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367807.797719:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00080000:0.0:1787367807.797740:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367807.797744:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367807.797746:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367807.797749:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367807.900279:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367807.900312:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808455808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367807.900395:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367807.900488:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808455808 00000100:00100000:0.0:1787367807.900495:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808455808 00000100:00100000:0.0:1787367807.900551:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367807.900559:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808455808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367807.900578:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367807.901450:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808455808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 889us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367807.901460:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787367807.901672:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c09f80 x1874190808455808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367807.901693:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808455808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367808.345525:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367808.923247:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367808.923269:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808455936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787367808.923332:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367808.923412:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808455936 00000100:00100000:0.0:1787367808.923419:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808455936 00000100:00100000:0.0:1787367808.923461:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787367808.923470:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808455936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787367808.923511:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787367808.923552:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808455936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367808.923560:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787367808.923613:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808455936:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787367809.241014:0:10713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787367809.370535:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367810.394473:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367811.417647:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367811.997135:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808456064:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.997204:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.997245:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808456576:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.997271:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.997287:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808457088:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.997309:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.997326:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808457600:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.997380:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.997404:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787367811.997410:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808456192:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.997434:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.997450:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808456704:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.997470:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.997486:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808457216:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.997505:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.997532:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808456320:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.997554:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.997571:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808456832:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.997591:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.998001:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808457344:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.998027:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.998042:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787367811.998047:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808456448:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.998066:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.998075:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808456960:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.998093:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.998118:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808457472:0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.998136:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367811.998167:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808457088 00000100:00100000:1.0:1787367811.998174:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808457088 00000100:00100000:3.0:1787367811.998191:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808457600 00000100:00100000:3.0:1787367811.998195:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808457600 00000100:00100000:3.0:1787367811.998216:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808457472 00000100:00100000:1.0:1787367811.998216:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808456960 00000100:00100000:3.0:1787367811.998219:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808457472 00000100:00100000:1.0:1787367811.998219:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808456960 00000100:00100000:3.0:1787367811.998234:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787367811.998242:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808457600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367811.998290:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808456064 00000100:00100000:3.0:1787367811.998292:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808457600:12345-0@lo:400:kworker.0 Request processed in 50us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367811.998293:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808456064 00000100:00100000:2.0:1787367811.998325:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787367811.998332:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808456064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367811.998390:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808456064:12345-0@lo:400:kworker.0 Request processed in 58us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367811.998396:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787367811.998424:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808456576 00000100:00100000:2.0:1787367811.998428:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808456576 00000100:00100000:2.0:1787367811.998447:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808456320 00000100:00100000:2.0:1787367811.998449:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808456320 00000100:00100000:2.0:1787367811.998461:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787367811.998467:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808456576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367811.998499:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808456576:12345-0@lo:400:kworker.0 Request processed in 31us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367811.998505:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787367811.998516:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787367811.998522:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808456320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367811.998551:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808456320:12345-0@lo:400:kworker.0 Request processed in 30us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367811.998557:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787367811.999514:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787367811.999525:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808457088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.999570:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808457088:12345-0@lo:400:kworker.0 Request processed in 49us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367811.999577:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787367811.999597:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787367811.999920:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808457472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367811.999955:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808457472:12345-0@lo:400:kworker.0 Request processed in 353us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367811.999962:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787367811.999975:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787367811.999981:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808456960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367812.000007:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808456960:12345-0@lo:400:kworker.0 Request processed in 26us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.000012:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787367812.000037:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808456192 00000100:00100000:1.0:1787367812.000042:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808456192 00000100:00100000:1.0:1787367812.000062:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808456704 00000100:00100000:1.0:1787367812.000064:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808456704 00000100:00100000:1.0:1787367812.000078:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808457216 00000100:00100000:1.0:1787367812.000081:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808457216 00000100:00100000:1.0:1787367812.000091:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808456832 00000100:00100000:1.0:1787367812.000093:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808456832 00000100:00100000:1.0:1787367812.000104:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808457344 00000100:00100000:1.0:1787367812.000106:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808457344 00000100:00100000:1.0:1787367812.000117:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808456448 00000100:00100000:1.0:1787367812.000119:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808456448 00000100:00100000:1.0:1787367812.000131:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787367812.000137:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808456192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367812.000174:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808456192:12345-0@lo:400:kworker.0 Request processed in 37us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.000181:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787367812.000193:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787367812.000198:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808456704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367812.000222:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808456704:12345-0@lo:400:kworker.0 Request processed in 24us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.000227:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787367812.000237:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787367812.000242:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808457216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367812.000265:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808457216:12345-0@lo:400:kworker.0 Request processed in 23us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.000271:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787367812.000283:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787367812.000289:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808456832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367812.000312:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808456832:12345-0@lo:400:kworker.0 Request processed in 24us (2721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.000317:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787367812.000327:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787367812.000332:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808457344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367812.002468:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808457344:12345-0@lo:400:kworker.0 Request processed in 22us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.002489:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787367812.002524:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787367812.002535:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808456448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367812.003636:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787367812.004076:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787367812.004082:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367812.004086:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367812.004088:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367812.004129:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808456448:0@lo:400:kworker.0 00010000:00080000:3.0:1787367812.004147:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0aa00 x1874190808456960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367812.004158:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808456960:0@lo:400:kworker.0 00010000:00080000:3.0:1787367812.004169:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0b100 x1874190808457472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367812.004177:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808457472:0@lo:400:kworker.0 00000100:00100000:3.0:1787367812.004188:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808456320:0@lo:400:kworker.0 00010000:00080000:3.0:1787367812.004199:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c08a80 x1874190808456832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367812.004207:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808456832:0@lo:400:kworker.0 00010000:00080000:3.0:1787367812.004218:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0a680 x1874190808457344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367812.004225:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808457344:0@lo:400:kworker.0 00000100:00100000:3.0:1787367812.004268:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808456192:0@lo:400:kworker.0 00000100:00100000:3.0:1787367812.004278:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808456704:0@lo:400:kworker.0 00000100:00100000:3.0:1787367812.004286:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808457216:0@lo:400:kworker.0 00000100:00100000:3.0:1787367812.004295:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808456064:0@lo:400:kworker.0 00000100:00100000:3.0:1787367812.004314:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808456576:0@lo:400:kworker.0 00010000:00080000:3.0:1787367812.004324:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c09500 x1874190808457088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367812.004331:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808457088:0@lo:400:kworker.0 00010000:00080000:3.0:1787367812.004341:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa74000 x1874190808457600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367812.004349:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808457600:0@lo:400:kworker.0 00000100:00100000:1.0:1787367812.005153:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808456448:12345-0@lo:400:kworker.0 Request processed in 2618us (7081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.005164:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787367812.007584:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367812.007618:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808457728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367812.007693:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367812.007743:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808457728 00000100:00100000:3.0:1787367812.007751:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808457728 00000100:00100000:3.0:1787367812.007795:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787367812.007804:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808457728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367812.007846:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367812.007902:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808457728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367812.007909:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787367812.007934:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808457728:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787367812.443411:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367812.506321:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808457856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367812.506405:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367812.506464:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367812.506479:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808457984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367812.506505:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367812.506543:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808457856 00000100:00100000:0.0:1787367812.506550:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808457856 00000100:00100000:0.0:1787367812.506583:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808457984 00000100:00100000:0.0:1787367812.506587:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808457984 00000100:00100000:0.0:1787367812.506602:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367812.506610:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808457856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367812.506636:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367812.506694:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808457856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367812.506701:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367812.506717:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787367812.506723:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808457984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367812.506743:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367812.506765:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808457984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367812.506771:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787367812.506804:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afad8000 x1874190808457984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367812.506932:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808457984:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787367812.506946:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afad9f80 x1874190808457856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367812.506957:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808457856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367812.513255:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367812.513277:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808458112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367812.513341:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367812.518269:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808458112 00000100:00100000:0.0:1787367812.518292:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808458112 00000100:00100000:0.0:1787367812.518452:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787367812.518463:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808458112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367812.518493:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367812.518577:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808458112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (5235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367812.518585:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787367812.518842:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afad9f80 x1874190808458112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367812.518861:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808458112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367812.923477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367812.923521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367812.923545:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367812.923567:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367812.923622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367812.923650:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788469120 00000100:00100000:1.0:1787367812.923659:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788469120 00000100:00100000:1.0:1787367812.923715:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 278 00000100:00100000:1.0:1787367812.923725:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:2403:x1874190788469120:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367812.923787:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:2403:x1874190788469120:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.923796:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 278 00000100:00100000:1.0:1787367812.923826:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788469248 00000100:00100000:1.0:1787367812.923829:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788469248 00000100:00100000:1.0:1787367812.923862:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788469376 00000100:00100000:1.0:1787367812.923866:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788469376 00000100:00100000:1.0:1787367812.923888:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1787367812.923894:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788469248:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367812.923923:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788469248:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.923930:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1787367812.923942:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:1.0:1787367812.923948:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788469376:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367812.923987:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788469376:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.923993:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:1.0:1787367812.924010:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788469504 00000100:00100000:1.0:1787367812.924014:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788469504 00000100:00100000:1.0:1787367812.924037:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788469632 00000100:00100000:1.0:1787367812.924040:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788469632 00000100:00100000:1.0:1787367812.924060:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1787367812.924066:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2401:x1874190788469504:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:1.0:1787367812.924089:0:8453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0306ca 00000100:00080000:1.0:1787367812.924099:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c5481bce000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787367812.924141:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787367812.924254:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+2:2401:x1874190788469504:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 188us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.924261:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1787367812.924273:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1787367812.924279:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2401:x1874190788469632:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:1.0:1787367812.924290:0:8453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0306d1 00000100:00080000:1.0:1787367812.924296:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c55bd5d3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787367812.924320:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787367812.924424:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+2:2401:x1874190788469632:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 144us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367812.924430:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00080000:1.0:1787367812.924564:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367812.924568:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367812.924571:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367812.924580:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787367812.924650:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367812.924656:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367813.026950:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367813.026972:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808458240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367813.027040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367813.027107:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808458240 00000100:00100000:2.0:1787367813.027114:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808458240 00000100:00100000:2.0:1787367813.027162:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787367813.027172:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808458240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367813.027193:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367813.027234:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808458240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367813.027241:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787367813.027260:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787367813.027286:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c02d80 x1874190808458240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367813.027303:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808458240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367813.468291:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367814.040607:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808458368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787367814.040694:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367814.040880:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808458368 00000100:00100000:0.0:1787367814.040888:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808458368 00000100:00100000:0.0:1787367814.041105:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787367814.041116:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808458368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787367814.041149:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787367814.041240:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808458368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367814.041257:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787367814.046256:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808458368:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787367814.488437:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787367814.683181:0:10957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing yml_node 00010000:00010000:0.0:1787367815.521513:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367816.536653:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367817.113147:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808458624:0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.113218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367817.113283:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808459136:0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.113307:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367817.113333:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808459648:0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.113373:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367817.113400:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787367817.113407:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808458752:0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.113432:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367817.113447:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808459264:0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.113486:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367817.113525:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808459776:0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.113548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367817.113573:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808458624 00000100:00100000:1.0:1787367817.113580:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808458624 00000100:00100000:1.0:1787367817.113614:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808459136 00000100:00100000:1.0:1787367817.113616:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808459136 00000100:00100000:1.0:1787367817.113649:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808459648 00000100:00100000:1.0:1787367817.113652:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808459648 00000100:00100000:1.0:1787367817.113667:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808459264 00000100:00100000:1.0:1787367817.113671:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808459264 00000100:00100000:1.0:1787367817.113682:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808459776 00000100:00100000:1.0:1787367817.113685:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808459776 00000100:00100000:1.0:1787367817.113701:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787367817.113709:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808458624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.113769:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808458624:12345-0@lo:400:kworker.0 Request processed in 59us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367817.113776:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787367817.113956:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787367817.113966:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808459136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367817.114000:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808459136:12345-0@lo:400:kworker.0 Request processed in 37us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367817.114013:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787367817.114026:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787367817.114033:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808459648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367817.114059:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808459648:12345-0@lo:400:kworker.0 Request processed in 28us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367817.114065:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787367817.114075:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787367817.114081:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808459264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367817.114106:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808459264:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367817.114112:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787367817.114128:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787367817.114134:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808459776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367817.114157:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808459776:12345-0@lo:400:kworker.0 Request processed in 23us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367817.114162:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787367817.114178:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787367817.114181:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787367817.114236:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482622d80 x1874190808459264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367817.114249:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808459264:0@lo:400:kworker.0 00010000:00080000:2.0:1787367817.114258:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd624700 x1874190808459776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367817.114266:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808459776:0@lo:400:kworker.0 00000100:00100000:2.0:1787367817.114282:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808458624:0@lo:400:kworker.0 00000100:00100000:2.0:1787367817.114289:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808459136:0@lo:400:kworker.0 00000100:00100000:2.0:1787367817.114296:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808459648:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114453:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808458880:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114486:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367817.114522:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808459392:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114546:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367817.114560:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808459904:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114588:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367817.114611:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787367817.114617:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808458496:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114652:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367817.114670:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808459008:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367817.114718:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808459520:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114738:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367817.114750:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808460032:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114769:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367817.114807:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808458752 00000100:00100000:0.0:1787367817.114812:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808458752 00000100:00100000:0.0:1787367817.114840:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808459008 00000100:00100000:0.0:1787367817.114842:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808459008 00000100:00100000:0.0:1787367817.114856:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787367817.114860:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808458752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114898:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808458752:12345-0@lo:400:kworker.0 Request processed in 37us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367817.114904:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787367817.114916:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787367817.114922:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808459008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.114951:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808459008:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367817.114957:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787367817.114982:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808459008:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.115002:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808458752:0@lo:400:kworker.0 00000100:00100000:2.0:1787367817.115196:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808458880 00000100:00100000:2.0:1787367817.115200:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808458880 00000100:00100000:2.0:1787367817.115233:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787367817.115239:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808458880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367817.115269:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808458880:12345-0@lo:400:kworker.0 Request processed in 31us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367817.115274:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787367817.115387:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808459392 00000100:00100000:1.0:1787367817.115390:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808459392 00000100:00100000:1.0:1787367817.115417:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808459904 00000100:00100000:1.0:1787367817.115420:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808459904 00000100:00100000:1.0:1787367817.115431:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808459520 00000100:00100000:1.0:1787367817.115434:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808459520 00000100:00100000:1.0:1787367817.115445:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808460032 00000100:00100000:1.0:1787367817.115447:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808460032 00000100:00100000:1.0:1787367817.115460:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787367817.115466:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808459392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.115515:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808459392:12345-0@lo:400:kworker.0 Request processed in 49us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367817.115522:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787367817.115534:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787367817.115539:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808459904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.115567:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808459904:12345-0@lo:400:kworker.0 Request processed in 28us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367817.115572:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787367817.115581:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787367817.115586:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808459520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.115610:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808459520:12345-0@lo:400:kworker.0 Request processed in 24us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367817.115616:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787367817.115627:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787367817.115653:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808460032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367817.115679:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808460032:12345-0@lo:400:kworker.0 Request processed in 29us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367817.115684:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787367817.115706:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367817.115715:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808460160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367817.115742:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787367817.115764:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367817.115767:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367817.115774:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808460160 00000100:00100000:1.0:1787367817.115777:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808460160 00000100:00100000:1.0:1787367817.115985:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787367817.115992:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808460160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787367817.116014:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787367817.116050:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808460160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367817.116056:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787367817.116085:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808460160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367817.116204:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808458496 00000100:00100000:3.0:1787367817.116209:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808458496 00000100:00100000:3.0:1787367817.116246:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787367817.116254:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808458496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367817.116286:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808458496:12345-0@lo:400:kworker.0 Request processed in 34us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367817.116300:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787367817.118005:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808458496:0@lo:400:kworker.0 00010000:00080000:0.0:1787367817.118027:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482623800 x1874190808459520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367817.118040:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808459520:0@lo:400:kworker.0 00010000:00080000:0.0:1787367817.118068:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd626a00 x1874190808460032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367817.118077:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808460032:0@lo:400:kworker.0 00000100:00100000:0.0:1787367817.118090:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808458880:0@lo:400:kworker.0 00010000:00080000:0.0:1787367817.118104:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482620000 x1874190808459392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367817.118112:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808459392:0@lo:400:kworker.0 00010000:00080000:0.0:1787367817.118123:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd625c00 x1874190808459904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367817.118131:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808459904:0@lo:400:kworker.0 00010000:00010000:3.0:1787367817.562455:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367817.624985:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808460288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367817.625057:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367817.625278:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808460416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367817.625315:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367817.625512:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808460288 00000100:00100000:1.0:1787367817.625520:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808460288 00000100:00100000:1.0:1787367817.625555:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808460416 00000100:00100000:1.0:1787367817.625558:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808460416 00000100:00100000:1.0:1787367817.625574:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787367817.625582:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808460288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367817.625611:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367817.625672:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808460288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367817.625693:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787367817.625708:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787367817.625714:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808460416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367817.625723:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367817.625759:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808460416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367817.625764:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787367817.626066:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f1f80 x1874190808460288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367817.626083:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808460288:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787367817.626113:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afaddc00 x1874190808460416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367817.626124:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808460416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367817.627648:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367817.627663:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808460544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367817.627711:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367817.628762:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808460544 00000100:00100000:1.0:1787367817.628774:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808460544 00000100:00100000:1.0:1787367817.628832:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787367817.628842:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808460544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367817.628876:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367817.628940:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808460544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367817.628946:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787367817.629032:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f1180 x1874190808460544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367817.629052:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808460544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367818.049167:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367818.049215:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367818.049253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367818.049347:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788469760 00000100:00100000:2.0:1787367818.049388:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788469760 00000100:00100000:2.0:1787367818.049444:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 280 00000100:00100000:2.0:1787367818.049454:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:2403:x1874190788469760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367818.049519:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:2403:x1874190788469760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367818.049527:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 280 00000100:00100000:0.0:1787367818.049769:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788470016 00000100:00100000:0.0:1787367818.049774:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788470016 00000100:00100000:0.0:1787367818.049816:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788469888 00000100:00100000:0.0:1787367818.049819:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788469888 00000100:00100000:0.0:1787367818.049838:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:0.0:1787367818.049846:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788470016:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367818.049880:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788470016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367818.049886:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:0.0:1787367818.049896:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:0.0:1787367818.049902:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788469888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367818.049924:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788469888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367818.049948:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00080000:2.0:1787367818.058534:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367818.058545:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787367818.137756:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367818.137781:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808460672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367818.137850:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367818.137989:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808460672 00000100:00100000:0.0:1787367818.137997:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808460672 00000100:00100000:0.0:1787367818.138051:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787367818.138061:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808460672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367818.138083:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367818.138127:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808460672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367818.138135:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787367818.138222:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd627800 x1874190808460672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367818.138241:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808460672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367818.586969:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787367818.665190:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:0.0:1787367818.665199:0:9534:0:(genops.c:885:class_export_put()) final put ffff9c55bd5d6000/6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:1.0:1787367818.666980:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd5d6000/6033427c-dc64-421a-b37f-d4458dbaa527 for lustre-OST0001 00000020:00000080:1.0:1787367818.667037:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55bd5d3800 for lustre-OST0001 00000001:00100000:1.0:1787367818.670059:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:1.0:1787367818.670069:0:8447:0:(genops.c:885:class_export_put()) final put ffff9c5481bc9000/6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:2.0:1787367818.670463:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5481bc9000/6033427c-dc64-421a-b37f-d4458dbaa527 for lustre-OST0000 00000020:00000080:2.0:1787367818.670515:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5481bce000 for lustre-OST0000 00000100:00100000:0.0:1787367819.161181:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808460800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787367819.162564:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367819.162678:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808460800 00000100:00100000:2.0:1787367819.162685:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808460800 00000100:00100000:2.0:1787367819.162728:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787367819.162738:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808460800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367819.162770:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367819.162818:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808460800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367819.162825:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787367819.163903:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808460800:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787367819.441474:0:11141:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.45 00010000:00010000:0.0:1787367819.612073:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367820.632773:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367821.657650:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787367822.021080:0:11238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.45 00000100:00100000:3.0:1787367822.233566:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367822.233589:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808460928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367822.233670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367822.233924:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808460928 00000100:00100000:0.0:1787367822.233932:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808460928 00000100:00100000:0.0:1787367822.233983:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787367822.233993:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808460928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787367822.234025:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787367822.234081:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808460928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367822.234106:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787367822.234286:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808460928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367822.237023:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808461056:0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237090:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367822.237137:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808461568:0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237163:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367822.237187:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808462080:0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367822.237232:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787367822.237238:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808461440:0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367822.237278:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808461952:0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367822.237319:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808462464:0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237339:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367822.237412:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808461568 00000100:00100000:3.0:1787367822.237418:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808461568 00000100:00100000:3.0:1787367822.237464:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808462080 00000100:00100000:3.0:1787367822.237468:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808462080 00000100:00100000:3.0:1787367822.237488:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787367822.237497:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808461568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237717:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808461568:12345-0@lo:400:kworker.0 Request processed in 219us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367822.237725:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787367822.237743:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787367822.237750:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808462080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237778:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808462080:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367822.237784:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787367822.237806:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808461952 00000100:00100000:3.0:1787367822.237809:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808461952 00000100:00100000:3.0:1787367822.237834:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808462464 00000100:00100000:3.0:1787367822.237837:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808462464 00000100:00100000:3.0:1787367822.237853:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787367822.237860:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808461952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237891:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808461952:12345-0@lo:400:kworker.0 Request processed in 32us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367822.237898:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787367822.237909:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787367822.237915:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808462464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.237940:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808462464:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367822.237956:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787367822.237992:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afade680 x1874190808461952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367822.238007:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808461952:0@lo:400:kworker.0 00010000:00080000:3.0:1787367822.238019:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afaddc00 x1874190808462464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367822.238027:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808462464:0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.238037:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808461568:0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.238046:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808462080:0@lo:400:kworker.0 00000100:00100000:1.0:1787367822.238155:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808461056 00000100:00100000:1.0:1787367822.238166:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808461056 00000100:00100000:1.0:1787367822.238194:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787367822.238201:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808461056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367822.238236:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808461056:12345-0@lo:400:kworker.0 Request processed in 36us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367822.238242:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787367822.238424:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808461184:0@lo:400:kworker.0 00000100:00100000:0.0:1787367822.238456:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367822.238501:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808461696:0@lo:400:kworker.0 00000100:00100000:0.0:1787367822.238524:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367822.238539:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808462208:0@lo:400:kworker.0 00000100:00100000:0.0:1787367822.238708:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367822.238726:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787367822.238732:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808461312:0@lo:400:kworker.0 00000100:00100000:0.0:1787367822.238754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367822.238765:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808461824:0@lo:400:kworker.0 00000100:00100000:0.0:1787367822.238786:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367822.238801:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808462336:0@lo:400:kworker.0 00000100:00100000:0.0:1787367822.238820:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367822.243076:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808461184 00000100:00100000:3.0:1787367822.243090:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808461184 00000100:00100000:3.0:1787367822.243139:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808461696 00000100:00100000:3.0:1787367822.243142:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808461696 00000100:00100000:3.0:1787367822.243157:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808462208 00000100:00100000:3.0:1787367822.243160:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808462208 00000100:00100000:2.0:1787367822.243318:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808461440 00000100:00100000:2.0:1787367822.243323:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808461440 00000100:00100000:2.0:1787367822.243372:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787367822.243382:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808461440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.243499:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808461440:12345-0@lo:400:kworker.0 Request processed in 118us (6235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367822.243507:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787367822.243538:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787367822.243543:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367822.243546:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367822.243548:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367822.243557:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808461312 00000100:00100000:2.0:1787367822.243560:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808461312 00000100:00100000:2.0:1787367822.243577:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787367822.243584:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808461184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.243642:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808461184:12345-0@lo:400:kworker.0 Request processed in 59us (5186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367822.243649:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787367822.243663:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787367822.243670:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808461696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.243697:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808461696:12345-0@lo:400:kworker.0 Request processed in 28us (5172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367822.243703:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787367822.243713:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787367822.243718:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808461312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.243742:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808461312:12345-0@lo:400:kworker.0 Request processed in 25us (4988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367822.243747:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787367822.243788:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808461312:0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.243801:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808461184:0@lo:400:kworker.0 00010000:00080000:2.0:1787367822.243822:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadc000 x1874190808461696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367822.243832:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808461696:0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.243889:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808461440:0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.243899:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808461056:0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.243921:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808461824 00000100:00100000:2.0:1787367822.243924:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808461824 00000100:00100000:2.0:1787367822.243952:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808462336 00000100:00100000:2.0:1787367822.243955:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808462336 00000100:00100000:2.0:1787367822.243972:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787367822.243979:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808461824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.244013:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808461824:12345-0@lo:400:kworker.0 Request processed in 35us (5226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367822.244018:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787367822.244028:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787367822.244034:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808462336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367822.244062:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808462336:12345-0@lo:400:kworker.0 Request processed in 29us (5241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367822.244067:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787367822.244079:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367822.244081:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787367822.244095:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadce00 x1874190808461824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367822.244103:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808461824:0@lo:400:kworker.0 00010000:00080000:2.0:1787367822.244123:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadc380 x1874190808462336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367822.244131:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808462336:0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.244736:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787367822.244742:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808462208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367822.244792:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808462208:12345-0@lo:400:kworker.0 Request processed in 50us (6084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367822.244798:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1787367822.244833:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadf100 x1874190808462208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367822.244842:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808462208:0@lo:400:kworker.0 00000100:00080000:1.0:1787367822.245675:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787367822.680801:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367822.745346:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808462592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367822.745446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367822.745525:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808462592 00000100:00100000:3.0:1787367822.745533:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808462592 00000100:00100000:3.0:1787367822.745573:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787367822.745581:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808462592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787367822.745619:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367822.745675:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808462592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367822.745683:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787367822.745716:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482072300 x1874190808462592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367822.745735:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808462592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367822.745816:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367822.745825:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808462720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367822.745854:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367822.746002:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808462720 00000100:00100000:3.0:1787367822.746006:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808462720 00000100:00100000:3.0:1787367822.746025:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787367822.746031:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808462720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787367822.746046:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367822.746084:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808462720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367822.746090:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787367822.746144:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f1c00 x1874190808462720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367822.746156:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808462720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367822.747101:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808462848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367822.747137:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367822.747289:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808462848 00000100:00100000:1.0:1787367822.747295:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808462848 00000100:00100000:1.0:1787367822.747330:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787367822.747337:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808462848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367822.747349:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367822.747415:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808462848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367822.747422:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787367822.747469:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadf100 x1874190808462848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367822.747484:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808462848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367823.161067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367823.161118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367823.161147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367823.161174:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788470400 00000100:00100000:1.0:1787367823.161182:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788470400 00000100:00100000:1.0:1787367823.161240:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788470272 00000100:00100000:1.0:1787367823.161243:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788470272 00000100:00100000:1.0:1787367823.161267:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:1.0:1787367823.161277:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788470400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367823.161372:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788470400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367823.161380:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:1.0:1787367823.161403:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:1.0:1787367823.161409:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788470272:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367823.161431:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788470272:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367823.161438:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00080000:1.0:1787367823.161452:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367823.161455:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367823.165809:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788470144 00000100:00100000:0.0:1787367823.165837:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788470144 00000100:00100000:0.0:1787367823.165901:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 282 00000100:00100000:0.0:1787367823.165912:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:2405:x1874190788470144:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367823.165976:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:2405:x1874190788470144:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 67us (4917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367823.165984:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 282 00000100:00100000:0.0:1787367823.256486:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808462976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367823.256555:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367823.256661:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808462976 00000100:00100000:1.0:1787367823.256668:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808462976 00000100:00100000:1.0:1787367823.256714:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787367823.256723:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808462976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367823.256752:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367823.261886:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808462976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5156us (5322us total) trans 0 rc 0/0 00010000:00080000:0.0:1787367823.261886:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482072300 x1874190808462976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367823.261905:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787367823.261915:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808462976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367823.706156:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367824.283340:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367824.283386:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808463104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367824.283460:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367824.283623:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808463104 00000100:00100000:2.0:1787367824.283631:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808463104 00000100:00100000:2.0:1787367824.283687:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787367824.283696:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808463104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367824.283725:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367824.283791:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808463104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367824.283798:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787367824.284385:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808463104:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787367824.728752:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787367825.186737:0:11335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.45 00010000:00010000:3.0:1787367825.753301:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367826.784780:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367826.897948:0:11384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 21 23:03:45 EDT 2026 00000100:00100000:1.0:1787367827.352861:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367827.352883:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808463232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367827.352959:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367827.353131:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808463232 00000100:00100000:0.0:1787367827.353139:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808463232 00000100:00100000:0.0:1787367827.353191:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787367827.353200:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808463232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787367827.353230:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787367827.353287:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808463232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367827.353293:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787367827.353333:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808463232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367827.353629:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808463488:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.353672:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.353693:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808464000:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.353725:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.353744:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808464512:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.353764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.353784:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787367827.353790:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808463616:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.353809:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.353829:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808464128:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.353850:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.353866:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808464640:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.353885:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.353914:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808463488 00000100:00100000:3.0:1787367827.353918:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808463488 00000100:00100000:3.0:1787367827.353940:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808464000 00000100:00100000:3.0:1787367827.353942:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808464000 00000100:00100000:3.0:1787367827.353963:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808464512 00000100:00100000:3.0:1787367827.353966:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808464512 00000100:00100000:3.0:1787367827.353976:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808463616 00000100:00100000:3.0:1787367827.353979:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808463616 00000100:00100000:3.0:1787367827.353991:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787367827.353997:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808463488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354038:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808463488:12345-0@lo:400:kworker.0 Request processed in 41us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.354044:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787367827.354057:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787367827.354063:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808464000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354097:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808464000:12345-0@lo:400:kworker.0 Request processed in 35us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.354103:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787367827.354114:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787367827.354119:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808464512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354142:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808464512:12345-0@lo:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.354146:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787367827.354155:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787367827.354161:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808463616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354189:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808463616:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.354194:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787367827.354219:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808464128 00000100:00100000:3.0:1787367827.354222:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808464128 00000100:00100000:3.0:1787367827.354241:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808464640 00000100:00100000:3.0:1787367827.354244:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808464640 00000100:00100000:3.0:1787367827.354258:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787367827.354276:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808464128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354305:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808464128:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.354311:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787367827.354322:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787367827.354327:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808464640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354350:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808464640:12345-0@lo:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.354386:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787367827.354402:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367827.354405:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787367827.354408:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367827.354417:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808463744:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354444:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.354461:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808464256:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.354498:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808464768:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354517:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.354531:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787367827.354536:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808463360:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354561:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.354594:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808463872:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354615:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.354630:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808464384:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354650:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367827.354674:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808463360 00000100:00100000:3.0:1787367827.354677:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808463360 00000100:00100000:3.0:1787367827.354702:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787367827.354709:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808463360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354742:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808463360:12345-0@lo:400:kworker.0 Request processed in 35us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.354748:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787367827.354771:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808463872 00000100:00100000:3.0:1787367827.354780:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808463872 00000100:00100000:3.0:1787367827.354803:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808464384 00000100:00100000:3.0:1787367827.354806:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808464384 00000100:00100000:3.0:1787367827.354822:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787367827.354827:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808463872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354855:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808463872:12345-0@lo:400:kworker.0 Request processed in 28us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.354862:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787367827.354872:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787367827.354878:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808464384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.354902:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808464384:12345-0@lo:400:kworker.0 Request processed in 24us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.354907:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1787367827.354924:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367827.354934:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808464256 00000100:00100000:3.0:1787367827.354937:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808464256 00000100:00100000:3.0:1787367827.354955:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808464768 00000100:00100000:3.0:1787367827.354958:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808464768 00000100:00100000:3.0:1787367827.354971:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787367827.354976:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808464256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.355004:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808464256:12345-0@lo:400:kworker.0 Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.355009:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787367827.355020:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787367827.355026:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808464768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.355051:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808464768:12345-0@lo:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367827.355067:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787367827.355082:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367827.355084:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367827.355109:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808463360:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.355121:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808463872:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.355130:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808464384:0@lo:400:kworker.0 00010000:00080000:3.0:1787367827.355142:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c08700 x1874190808464256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367827.355152:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808464256:0@lo:400:kworker.0 00010000:00080000:3.0:1787367827.355162:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c08a80 x1874190808464768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367827.355170:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808464768:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.355203:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808463616:0@lo:400:kworker.0 00010000:00080000:3.0:1787367827.355213:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c09f80 x1874190808464128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367827.355222:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808464128:0@lo:400:kworker.0 00010000:00080000:3.0:1787367827.355231:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0a680 x1874190808464640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367827.355239:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808464640:0@lo:400:kworker.0 00000100:00100000:3.0:1787367827.355249:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808463488:0@lo:400:kworker.0 00010000:00080000:3.0:1787367827.355258:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c08380 x1874190808464000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367827.355274:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808464000:0@lo:400:kworker.0 00010000:00080000:3.0:1787367827.355286:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c08000 x1874190808464512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367827.355295:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808464512:0@lo:400:kworker.0 00000100:00100000:1.0:1787367827.356759:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808463744 00000100:00100000:1.0:1787367827.356771:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808463744 00000100:00100000:1.0:1787367827.356820:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787367827.356829:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808463744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367827.356920:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808463744:12345-0@lo:400:kworker.0 Request processed in 92us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367827.356928:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787367827.358885:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808463744:0@lo:400:kworker.0 00010000:00010000:0.0:1787367827.803816:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367827.864796:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808465024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367827.864866:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367827.864956:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367827.864965:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808464896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367827.864991:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367827.865105:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808465024 00000100:00100000:0.0:1787367827.865113:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808465024 00000100:00100000:0.0:1787367827.865148:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808464896 00000100:00100000:0.0:1787367827.865151:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808464896 00000100:00100000:0.0:1787367827.865184:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787367827.865192:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808465024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367827.865220:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367827.865275:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808465024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367827.865282:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787367827.865298:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787367827.865304:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808464896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367827.865318:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367827.865348:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808464896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367827.865371:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787367827.865586:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadc000 x1874190808464896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367827.865604:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808464896:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787367827.865634:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f2300 x1874190808465024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367827.865645:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808465024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367827.865885:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367827.865895:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808465152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367827.865943:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367827.866098:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808465152 00000100:00100000:0.0:1787367827.866103:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808465152 00000100:00100000:0.0:1787367827.866134:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787367827.866142:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808465152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367827.866155:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367827.866195:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808465152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367827.866203:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787367827.866379:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f3800 x1874190808465152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367827.866395:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808465152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367828.276288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367828.276396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367828.276419:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367828.276446:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788470784 00000100:00100000:2.0:1787367828.276454:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788470784 00000100:00100000:2.0:1787367828.276507:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788470656 00000100:00100000:2.0:1787367828.276511:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788470656 00000100:00100000:2.0:1787367828.276534:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:2.0:1787367828.276544:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788470784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367828.276619:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788470784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367828.276626:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:2.0:1787367828.276641:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1787367828.276648:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788470656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367828.276672:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788470656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367828.276677:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00080000:2.0:1787367828.276692:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367828.276696:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367828.278294:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788470528 00000100:00100000:0.0:1787367828.278303:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788470528 00000100:00100000:0.0:1787367828.278338:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 284 00000100:00100000:0.0:1787367828.278345:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:2402:x1874190788470528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367828.278415:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+10:2402:x1874190788470528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 70us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367828.278436:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 284 00000100:00100000:1.0:1787367828.379839:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367828.379861:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808465280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367828.379945:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367828.380005:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808465280 00000100:00100000:1.0:1787367828.380013:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808465280 00000100:00100000:1.0:1787367828.380057:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787367828.380067:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808465280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367828.380087:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367828.380129:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808465280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367828.380137:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787367828.380175:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c02300 x1874190808465280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367828.380193:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808465280:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367828.831973:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367829.403042:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367829.403064:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808465408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787367829.403129:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367829.403199:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808465408 00000100:00100000:2.0:1787367829.403206:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808465408 00000100:00100000:2.0:1787367829.403249:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787367829.403258:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808465408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367829.403300:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367829.403341:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808465408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367829.403348:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787367829.403777:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808465408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787367829.849264:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367830.873603:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367831.905897:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367832.473255:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367832.473312:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367832.473333:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808465664:0@lo:400:kworker.0 00000100:00100000:2.0:1787367832.473444:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367832.473656:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808465664 00000100:00100000:0.0:1787367832.473663:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808465664 00000100:00100000:0.0:1787367832.473721:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787367832.473731:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808465664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.473785:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808465664:12345-0@lo:400:kworker.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367832.473792:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787367832.473858:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808465664:0@lo:400:kworker.0 00000100:00100000:2.0:1787367832.474096:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367832.474105:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808465792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367832.474137:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367832.474167:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808465792 00000100:00100000:2.0:1787367832.474171:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808465792 00000100:00100000:2.0:1787367832.474197:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787367832.474203:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808465792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787367832.474228:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787367832.474278:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808465792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367832.474285:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787367832.474328:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808465792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367832.474952:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808465536:0@lo:400:kworker.0 00000100:00100000:3.0:1787367832.474990:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367832.475026:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808465536 00000100:00100000:3.0:1787367832.475031:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808465536 00000100:00100000:3.0:1787367832.475062:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787367832.475068:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808465536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367832.475103:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808465536:12345-0@lo:400:kworker.0 Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367832.475109:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787367832.475143:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808465536:0@lo:400:kworker.0 00000100:00100000:2.0:1787367832.476141:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808465920:0@lo:400:kworker.0 00000100:00100000:2.0:1787367832.476287:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367832.476382:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808465920 00000100:00100000:3.0:1787367832.476387:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808465920 00000100:00100000:3.0:1787367832.476433:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787367832.476441:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808465920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.476670:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808466304:0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.476709:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367832.476740:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808466304 00000100:00100000:0.0:1787367832.476744:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808466304 00000100:00100000:0.0:1787367832.476777:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787367832.476784:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808466304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.476818:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808466304:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367832.476825:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1787367832.476843:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787367832.476868:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afaded80 x1874190808466304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367832.476880:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808466304:0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.476899:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808466048:0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.476933:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367832.476955:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367832.476961:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808466176:0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.476982:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367832.477005:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808466048 00000100:00100000:0.0:1787367832.477008:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808466048 00000100:00100000:0.0:1787367832.477032:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787367832.477038:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808466048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.477073:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808466048:12345-0@lo:400:kworker.0 Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367832.477080:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787367832.477095:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808466176 00000100:00100000:0.0:1787367832.477098:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808466176 00000100:00100000:0.0:1787367832.477121:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787367832.477127:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808466176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.477155:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808466176:12345-0@lo:400:kworker.0 Request processed in 29us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367832.477162:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1787367832.477175:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367832.477195:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808466176:0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.477204:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808466048:0@lo:400:kworker.0 00000100:00100000:3.0:1787367832.477571:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808465920:12345-0@lo:400:kworker.0 Request processed in 1129us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367832.477578:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787367832.478138:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808466816:0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.478170:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367832.478199:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787367832.478204:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808466432:0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.478248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367832.478273:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808466944:0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.478294:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367832.478322:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808466432 00000100:00100000:0.0:1787367832.478326:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808466432 00000100:00100000:0.0:1787367832.478380:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808466944 00000100:00100000:0.0:1787367832.478384:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808466944 00000100:00100000:1.0:1787367832.478490:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808466816 00000100:00100000:1.0:1787367832.478494:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808466816 00000100:00100000:1.0:1787367832.478523:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787367832.478548:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808466816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367832.478600:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808466816:12345-0@lo:400:kworker.0 Request processed in 44us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367832.478607:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787367832.479010:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787367832.479019:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808466432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.479052:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808466432:12345-0@lo:400:kworker.0 Request processed in 35us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367832.479057:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787367832.479069:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787367832.479075:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808466944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.479100:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808466944:12345-0@lo:400:kworker.0 Request processed in 25us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367832.479105:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787367832.479124:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367832.479128:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367832.479130:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787367832.479154:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadd500 x1874190808466432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367832.479166:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808466432:0@lo:400:kworker.0 00010000:00080000:0.0:1787367832.479177:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afade680 x1874190808466944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367832.479184:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808466944:0@lo:400:kworker.0 00010000:00080000:0.0:1787367832.479193:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afaddc00 x1874190808466816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367832.479209:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808466816:0@lo:400:kworker.0 00000100:00100000:3.0:1787367832.479295:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808466688:0@lo:400:kworker.0 00000100:00100000:3.0:1787367832.479326:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367832.479385:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787367832.479392:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808466560:0@lo:400:kworker.0 00000100:00100000:3.0:1787367832.479527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367832.479562:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808467072:0@lo:400:kworker.0 00000100:00100000:3.0:1787367832.479584:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367832.479814:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808465920:0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.479957:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808466688 00000100:00100000:0.0:1787367832.479962:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808466688 00000100:00100000:0.0:1787367832.480000:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787367832.480007:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808466688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367832.480046:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808466688:12345-0@lo:400:kworker.0 Request processed in 39us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367832.480052:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787367832.480146:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367832.480177:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808466560 00000100:00100000:1.0:1787367832.480181:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808466560 00000100:00100000:1.0:1787367832.480570:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808467072 00000100:00100000:1.0:1787367832.480574:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808467072 00000100:00100000:3.0:1787367832.480798:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787367832.480809:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808466560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367832.480849:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808466560:12345-0@lo:400:kworker.0 Request processed in 42us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367832.480855:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787367832.480903:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadc000 x1874190808466560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367832.480916:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808466560:0@lo:400:kworker.0 00000100:00100000:3.0:1787367832.480928:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808466688:0@lo:400:kworker.0 00000100:00080000:2.0:1787367832.481031:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367832.481034:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367832.481146:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787367832.481153:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808467072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367832.481200:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808467072:12345-0@lo:400:kworker.0 Request processed in 48us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367832.481206:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787367832.481261:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afaded80 x1874190808467072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367832.481271:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808467072:0@lo:400:kworker.0 00010000:00010000:3.0:1787367832.921448:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367832.984559:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808467328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367832.984584:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808467200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367832.984632:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367832.984661:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367832.984881:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808467328 00000100:00100000:1.0:1787367832.984889:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808467328 00000100:00100000:1.0:1787367832.984925:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808467200 00000100:00100000:1.0:1787367832.984928:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808467200 00000100:00100000:1.0:1787367832.984945:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787367832.984954:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808467456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367832.984958:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808467328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367832.984989:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787367832.984993:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367832.985051:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808467328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367832.985059:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787367832.985073:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808467456 00000100:00100000:1.0:1787367832.985076:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808467456 00000100:00100000:1.0:1787367832.985090:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787367832.985096:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808467200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367832.985105:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1787367832.985245:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0a680 x1874190808467328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367832.985266:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808467328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367832.985291:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808467200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367832.985299:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787367832.985324:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787367832.985332:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808467456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367832.985348:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367832.985510:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808467456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 178us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367832.985517:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787367832.989872:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afaded80 x1874190808467456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787367832.989880:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c02300 x1874190808467200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367832.989911:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808467200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367832.991072:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808467456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367833.396191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367833.396336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367833.396401:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788471168 00000100:00100000:1.0:1787367833.396412:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788471168 00000100:00100000:2.0:1787367833.396422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367833.396502:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788471040 00000100:00100000:1.0:1787367833.396506:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788471040 00000100:00100000:1.0:1787367833.396543:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:1.0:1787367833.396553:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788471168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367833.396869:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:2.0:1787367833.396880:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788471040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367833.396922:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788471040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367833.396929:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:1.0:1787367833.396939:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788471168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 385us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367833.396948:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00080000:1.0:1787367833.396972:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367833.396977:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367833.401980:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788470912 00000100:00100000:3.0:1787367833.401993:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788470912 00000100:00100000:3.0:1787367833.402104:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 286 00000100:00100000:3.0:1787367833.402115:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:2403:x1874190788470912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367833.402206:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:2403:x1874190788470912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 93us (6024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367833.402215:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 286 00000100:00100000:0.0:1787367833.505281:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367833.505304:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808467584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367833.505823:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367833.505973:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808467584 00000100:00100000:2.0:1787367833.505981:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808467584 00000100:00100000:2.0:1787367833.506032:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787367833.506042:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808467584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367833.506063:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367833.506111:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808467584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367833.506128:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787367833.506166:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6041f80 x1874190808467584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367833.506184:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808467584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367833.945787:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367834.523757:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808467712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367834.523830:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367834.535026:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808467712 00000100:00100000:2.0:1787367834.535043:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808467712 00000100:00100000:2.0:1787367834.535124:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787367834.535135:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808467712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367834.535175:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367834.535254:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808467712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (11424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367834.535262:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787367834.537000:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808467712:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787367834.968556:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367835.994548:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367837.016521:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367837.592873:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808467840:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593029:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593086:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808468352:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593115:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593135:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808468864:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593158:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593185:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808469376:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593206:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593231:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787367837.593237:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808467968:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593260:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593277:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808468480:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593296:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593309:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808468992:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593371:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808468224:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593394:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593411:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808468736:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593428:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593440:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808469248:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593473:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787367837.593478:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808468096:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593510:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593528:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808468608:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367837.593557:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808469120:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.593576:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367837.593687:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808467840 00000100:00100000:1.0:1787367837.593694:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808467840 00000100:00100000:1.0:1787367837.593739:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787367837.593749:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808467840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.593799:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808467840:12345-0@lo:400:kworker.0 Request processed in 52us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.593807:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787367837.593836:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808467968 00000100:00100000:1.0:1787367837.593839:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808467968 00000100:00100000:1.0:1787367837.593856:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808468480 00000100:00100000:1.0:1787367837.593859:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808468480 00000100:00100000:1.0:1787367837.593879:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808468992 00000100:00100000:1.0:1787367837.593882:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808468992 00000100:00100000:1.0:1787367837.593893:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808468224 00000100:00100000:1.0:1787367837.593895:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808468224 00000100:00100000:1.0:1787367837.593904:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808468608 00000100:00100000:1.0:1787367837.593906:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808468608 00000100:00100000:1.0:1787367837.593917:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808469120 00000100:00100000:1.0:1787367837.593919:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808469120 00000100:00100000:1.0:1787367837.593931:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787367837.593948:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808467968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.593981:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808467968:12345-0@lo:400:kworker.0 Request processed in 43us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.593988:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787367837.593998:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787367837.594004:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808468480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594031:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808468480:12345-0@lo:400:kworker.0 Request processed in 27us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.594036:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787367837.594069:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787367837.594075:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808468992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594101:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808468992:12345-0@lo:400:kworker.0 Request processed in 27us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.594107:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787367837.594117:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787367837.594122:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808468224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594146:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808468224:12345-0@lo:400:kworker.0 Request processed in 24us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.594151:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787367837.594162:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787367837.594167:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808468608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594191:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808468608:12345-0@lo:400:kworker.0 Request processed in 25us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.594197:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787367837.594207:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787367837.594212:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808469120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594235:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808469120:12345-0@lo:400:kworker.0 Request processed in 23us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.594240:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787367837.594255:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808468864 00000100:00100000:1.0:1787367837.594259:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808468864 00000100:00100000:1.0:1787367837.594275:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808469376 00000100:00100000:1.0:1787367837.594277:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808469376 00000100:00100000:1.0:1787367837.594286:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808468736 00000100:00100000:1.0:1787367837.594289:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808468736 00000100:00100000:1.0:1787367837.594298:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808469248 00000100:00100000:1.0:1787367837.594307:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808469248 00000100:00100000:1.0:1787367837.594322:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787367837.594327:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808468864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594382:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808468864:12345-0@lo:400:kworker.0 Request processed in 54us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.594388:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787367837.594399:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787367837.594406:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808469376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594430:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808469376:12345-0@lo:400:kworker.0 Request processed in 25us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.594435:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787367837.594445:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787367837.594451:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808468736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594476:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808468736:12345-0@lo:400:kworker.0 Request processed in 25us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.594482:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787367837.594491:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787367837.594506:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808469248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594532:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808469248:12345-0@lo:400:kworker.0 Request processed in 37us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367837.594538:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787367837.594557:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367837.594561:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367837.594563:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367837.594565:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367837.594605:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808467968:0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594628:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808468480:0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594637:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808468992:0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.594646:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808467840:0@lo:400:kworker.0 00010000:00080000:1.0:1787367837.594657:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c18000 x1874190808468864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367837.594667:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808468864:0@lo:400:kworker.0 00010000:00080000:1.0:1787367837.594677:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c1b100 x1874190808469376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367837.594684:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808469376:0@lo:400:kworker.0 00010000:00080000:0.0:1787367837.595144:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c1a680 x1874190808469120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367837.595154:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808469120:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.595173:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808468224:0@lo:400:kworker.0 00010000:00080000:0.0:1787367837.595182:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c19180 x1874190808468736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367837.595189:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808468736:0@lo:400:kworker.0 00010000:00080000:0.0:1787367837.595197:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c19500 x1874190808469248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367837.595204:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808469248:0@lo:400:kworker.0 00010000:00080000:0.0:1787367837.595222:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c02300 x1874190808468608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367837.595229:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808468608:0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.595248:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808468352 00000100:00100000:0.0:1787367837.595253:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808468352 00000100:00100000:0.0:1787367837.595293:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808468096 00000100:00100000:0.0:1787367837.595297:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808468096 00000100:00100000:0.0:1787367837.595317:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787367837.595324:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808468352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.595386:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808468352:12345-0@lo:400:kworker.0 Request processed in 62us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367837.595393:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787367837.595407:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787367837.595412:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808468096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367837.595444:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808468096:12345-0@lo:400:kworker.0 Request processed in 32us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367837.595450:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787367837.595517:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808468096:0@lo:400:kworker.0 00000100:00100000:1.0:1787367837.596471:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808469504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367837.596522:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367837.596558:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808469504 00000100:00100000:1.0:1787367837.596562:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808469504 00000100:00100000:3.0:1787367837.606227:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808468352:0@lo:400:kworker.0 00000100:00100000:3.0:1787367837.606285:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787367837.606300:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808469504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367837.606336:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367837.606442:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808469504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (9919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367837.606450:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787367837.615551:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808469504:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787367838.045571:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367838.114803:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808469632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367838.114868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367838.115045:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808469888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367838.115071:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367838.115483:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808469760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367838.115523:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367838.115653:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808469632 00000100:00100000:1.0:1787367838.115660:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808469632 00000100:00100000:1.0:1787367838.115690:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808469888 00000100:00100000:1.0:1787367838.115692:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808469888 00000100:00100000:1.0:1787367838.115700:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808469760 00000100:00100000:1.0:1787367838.115702:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808469760 00000100:00100000:1.0:1787367838.115713:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787367838.115721:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808469632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367838.115747:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367838.115805:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808469632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367838.115812:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787367838.115827:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787367838.115832:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808469888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367838.115845:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367838.115870:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808469888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367838.115876:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787367838.115886:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787367838.115891:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808469760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367838.115898:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367838.115915:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808469760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367838.115920:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787367838.116033:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c18e00 x1874190808469632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367838.116051:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808469632:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787367838.116179:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0a680 x1874190808469888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367838.116191:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808469888:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787367838.117518:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c18700 x1874190808469760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367838.117537:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808469760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367838.528176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367838.528217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367838.528247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367838.528274:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788471552 00000100:00100000:2.0:1787367838.528283:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788471552 00000100:00100000:2.0:1787367838.528339:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788471424 00000100:00100000:2.0:1787367838.528343:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788471424 00000100:00100000:2.0:1787367838.528384:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1787367838.528394:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788471552:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367838.528460:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788471552:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 68us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367838.528482:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1787367838.528509:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:2.0:1787367838.528516:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788471424:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367838.528542:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788471424:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367838.528548:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00080000:2.0:1787367838.528567:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367838.528570:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367838.529010:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788471296 00000100:00100000:3.0:1787367838.529017:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788471296 00000100:00100000:3.0:1787367838.532028:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 288 00000100:00100000:3.0:1787367838.532051:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:2404:x1874190788471296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367838.532132:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+10:2404:x1874190788471296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 90us (3964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367838.532155:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 288 00000100:00100000:3.0:1787367838.616589:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808470016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367838.616662:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367838.616774:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808470016 00000100:00100000:1.0:1787367838.616797:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808470016 00000100:00100000:1.0:1787367838.616860:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787367838.616871:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808470016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367838.616909:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367838.619445:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808470016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2567us (2774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367838.619459:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787367838.619929:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836eaa00 x1874190808470016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367838.619954:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808470016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787367839.076997:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367839.644612:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367839.644645:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808470144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787367839.644734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367839.645273:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808470144 00000100:00100000:2.0:1787367839.645281:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808470144 00000100:00100000:2.0:1787367839.645337:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787367839.645346:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808470144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367839.645406:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367839.645463:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808470144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367839.645471:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787367839.645897:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808470144:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787367840.092676:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367841.116533:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787367841.225323:0:12013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:04:00 (1787367840) === 00000100:00100000:2.0:1787367841.834512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367841.834771:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788471680 00000100:00100000:1.0:1787367841.834782:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788471680 00000100:00100000:1.0:1787367841.834854:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 289 00000100:00100000:1.0:1787367841.834878:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+10:8750:x1874190788471680:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787367841.834895:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367841.834913:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673e00/0x66f5679bff0307bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e5e6 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367841.834941:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673e00/0x66f5679bff0307bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5e6 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367841.834951:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673e00/0x66f5679bff0307bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5e6 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367841.834960:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673e00, rc 0) 00000100:00100000:1.0:1787367841.835025:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+11:8750:x1874190788471680:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 148us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367841.835032:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 289 00000100:00100000:3.0:1787367841.847555:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367841.847791:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788471808 00000100:00100000:2.0:1787367841.847810:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788471808 00000100:00100000:2.0:1787367841.847865:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 290 00000100:00100000:2.0:1787367841.847874:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+11:8750:x1874190788471808:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787367841.848448:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+11:8750:x1874190788471808:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 572us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367841.848457:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 290 00000100:00100000:2.0:1787367841.854663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367841.854853:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788471936 00000100:00100000:3.0:1787367841.854863:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788471936 00000100:00100000:3.0:1787367841.854917:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 291 00000100:00100000:3.0:1787367841.854927:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+11:8750:x1874190788471936:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787367841.855093:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+11:8750:x1874190788471936:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 167us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367841.855102:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 291 00000100:00100000:3.0:1787367841.871133:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367841.871247:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788472064 00000100:00100000:1.0:1787367841.871257:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788472064 00000100:00100000:1.0:1787367841.871310:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 292 00000100:00100000:1.0:1787367841.871320:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+11:8754:x1874190788472064:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787367841.871522:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+11:8754:x1874190788472064:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 202us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367841.871530:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 292 00000100:00100000:1.0:1787367841.909015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367841.909726:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788472192 00000100:00100000:2.0:1787367841.909737:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788472192 00000100:00100000:2.0:1787367841.909858:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 293 00000100:00100000:2.0:1787367841.909870:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+11:8754:x1874190788472192:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787367841.910033:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+11:8754:x1874190788472192:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 164us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367841.910041:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 293 00000100:00100000:2.0:1787367841.917696:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367841.917903:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788472320 00000100:00100000:3.0:1787367841.917912:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788472320 00000100:00100000:3.0:1787367841.917973:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 294 00000100:00100000:3.0:1787367841.917983:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+11:8754:x1874190788472320:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787367841.918141:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+11:8754:x1874190788472320:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 159us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367841.918563:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 294 00000100:00100000:3.0:1787367841.927649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367841.928646:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788472448 00000100:00100000:2.0:1787367841.928657:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788472448 00000100:00100000:2.0:1787367841.928719:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 295 00000100:00100000:2.0:1787367841.928730:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+11:8750:x1874190788472448:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787367841.928747:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367841.928763:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55afa82c00/0x66f5679bff0307c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e617 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367841.928790:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55afa82c00/0x66f5679bff0307c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e617 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367841.928812:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55afa82c00/0x66f5679bff0307c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e617 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367841.928822:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82c00, rc 0) 00000100:00100000:2.0:1787367841.928898:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+12:8750:x1874190788472448:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 170us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367841.928905:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 295 00000100:00100000:2.0:1787367841.934929:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367841.966098:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788472576 00000100:00100000:3.0:1787367841.966113:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788472576 00000100:00100000:2.0:1787367841.985940:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 296 00000100:00100000:2.0:1787367841.985956:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+12:8750:x1874190788472576:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787367841.985981:0:6533:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787367841.986005:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787367841.986009:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787367841.986012:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787367841.986015:0:6533:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787367841.986017:0:6533:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787367841.988089:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+12:8750:x1874190788472576:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 2125us (53156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367841.988231:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 296 00000100:00100000:0.0:1787367841.994053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367841.994261:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788472704 00000100:00100000:1.0:1787367841.994270:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788472704 00000100:00100000:1.0:1787367841.994422:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:1.0:1787367841.994434:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+12:8750:x1874190788472704:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787367841.995100:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367841.995119:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e61e expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367841.995147:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e61e expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367841.995158:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e61e expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367841.995167:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672400, rc 0) 00000100:00100000:1.0:1787367841.995413:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:8750:x1874190788472704:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 980us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367841.995421:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:1.0:1787367842.000278:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367842.000845:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788472832 00000100:00100000:2.0:1787367842.000854:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788472832 00000100:00100000:2.0:1787367842.000948:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 298 00000100:00100000:2.0:1787367842.000959:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:8750:x1874190788472832:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787367842.001106:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:8750:x1874190788472832:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 148us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367842.001114:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 298 00000100:00100000:2.0:1787367842.003151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367842.003238:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788472960 00000100:00100000:1.0:1787367842.003247:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788472960 00000100:00100000:1.0:1787367842.003428:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 299 00000100:00100000:1.0:1787367842.003449:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:8750:x1874190788472960:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787367842.003622:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:8750:x1874190788472960:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 185us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367842.003631:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 299 00000100:00100000:0.0:1787367842.010554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367842.011018:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788473088 00000100:00100000:2.0:1787367842.011029:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788473088 00000100:00100000:2.0:1787367842.011088:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 300 00000100:00100000:2.0:1787367842.011098:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:8757:x1874190788473088:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787367842.011250:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:8757:x1874190788473088:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 153us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367842.011259:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 300 00000100:00100000:3.0:1787367842.016108:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367842.016267:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788473216 00000100:00100000:1.0:1787367842.016276:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788473216 00000100:00100000:1.0:1787367842.016333:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 301 00000100:00100000:1.0:1787367842.016343:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:8757:x1874190788473216:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787367842.016540:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:8757:x1874190788473216:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 196us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367842.016554:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 301 00000100:00100000:3.0:1787367842.023997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367842.024056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367842.024204:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788473984 00000100:00100000:0.0:1787367842.024213:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788473984 00000100:00100000:0.0:1787367842.024282:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788474112 00000100:00100000:0.0:1787367842.024286:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788474112 00000100:00100000:0.0:1787367842.024312:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:0.0:1787367842.024322:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788473984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367842.024420:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788473984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 98us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.024428:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:0.0:1787367842.024447:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:0.0:1787367842.024460:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788474112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367842.024498:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788474112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.024506:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00080000:1.0:1787367842.025430:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367842.025437:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367842.030958:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367842.031007:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367842.036601:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788473344 00000100:00100000:1.0:1787367842.036615:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788473344 00000100:00100000:1.0:1787367842.036662:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788473600 00000100:00100000:1.0:1787367842.036664:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788473600 00000100:00100000:1.0:1787367842.036687:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1787367842.036693:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874190788473344:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787367842.036717:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 376539eb-750a-402c-b2b9-1c135ada549f@192.168.203.4@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:1.0:1787367842.036743:0:6538:0:(genops.c:1385:class_connect()) connect: client 376539eb-750a-402c-b2b9-1c135ada549f, cookie 0x66f5679bff0307d4 00000004:00100000:1.0:1787367842.036763:0:6538:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787367842.036871:0:6538:0:(import.c:65:import_set_state_nolock()) ffff9c548367b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367842.036939:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2401:x1874190788473344:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 245us (5990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367842.036944:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1787367842.036956:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1787367842.036960:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874190788473600:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787367842.036969:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 376539eb-750a-402c-b2b9-1c135ada549f@192.168.203.4@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:1.0:1787367842.036983:0:6538:0:(genops.c:1385:class_connect()) connect: client 376539eb-750a-402c-b2b9-1c135ada549f, cookie 0x66f5679bff0307db 00000004:00100000:1.0:1787367842.036992:0:6538:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787367842.037039:0:6538:0:(import.c:65:import_set_state_nolock()) ffff9c548367c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367842.037065:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2401:x1874190788473600:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 104us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367842.037070:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1787367842.044061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367842.044088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367842.044107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367842.044220:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788473856 00000100:00100000:1.0:1787367842.044228:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788473856 00000100:00100000:1.0:1787367842.044299:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788473728 00000100:00100000:1.0:1787367842.044302:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788473728 00000100:00100000:1.0:1787367842.044316:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788473472 00000100:00100000:1.0:1787367842.044318:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788473472 00000100:00100000:1.0:1787367842.044331:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1787367842.044339:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+7:8750:x1874190788473856:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787367842.044399:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367842.044930:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1787367842.044943:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:0:x1874190788473728:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787367842.044963:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367842.045018:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:0:x1874190788473728:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 78us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367842.045026:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1787367842.045045:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:3.0:1787367842.045052:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+7:0:x1874190788473472:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787367842.045063:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367842.045088:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+7:0:x1874190788473472:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 36us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367842.045094:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00080000:2.0:1787367842.046104:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787367842.046111:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367842.046332:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:8750:x1874190788473856:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 1990us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367842.046342:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1787367842.048895:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367842.049010:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788474240 00000100:00100000:0.0:1787367842.049029:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788474240 00000100:00100000:0.0:1787367842.049089:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1787367842.049100:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:8750:x1874190788474240:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787367842.049187:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:8750:x1874190788474240:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.049195:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1787367842.052815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367842.052960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367842.055693:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788474368 00000100:00100000:1.0:1787367842.055709:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788474368 00000100:00100000:1.0:1787367842.055762:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788474496 00000100:00100000:1.0:1787367842.055766:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788474496 00000100:00100000:1.0:1787367842.055808:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1787367842.055817:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874190788474368:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787367842.055847:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 376539eb-750a-402c-b2b9-1c135ada549f@192.168.203.4@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:1.0:1787367842.055873:0:8453:0:(genops.c:1385:class_connect()) connect: client 376539eb-750a-402c-b2b9-1c135ada549f, cookie 0x66f5679bff0307e2 00002000:00100000:1.0:1787367842.055882:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 376539eb-750a-402c-b2b9-1c135ada549f/ffff9c5598409800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787367842.055895:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787367842.055952:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787367842.055986:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c548335c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367842.056047:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:2401:x1874190788474368:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 229us (3240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367842.056076:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1787367842.056084:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874190788474496:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787367842.056103:0:8451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 376539eb-750a-402c-b2b9-1c135ada549f@192.168.203.4@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:2.0:1787367842.056122:0:8451:0:(genops.c:1385:class_connect()) connect: client 376539eb-750a-402c-b2b9-1c135ada549f, cookie 0x66f5679bff0307e9 00002000:00100000:2.0:1787367842.056128:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 376539eb-750a-402c-b2b9-1c135ada549f/ffff9c5482778800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787367842.056139:0:8451:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787367842.056178:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787367842.056194:0:8451:0:(import.c:65:import_set_state_nolock()) ffff9c548277d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787367842.056221:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2401:x1874190788474496:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 136us (3261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367842.056229:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1787367842.056446:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1787367842.056504:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367842.056613:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788474624 00000100:00100000:1.0:1787367842.056619:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788474624 00000100:00100000:1.0:1787367842.056659:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1787367842.056666:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:376539eb-750a-402c-b2b9-1c135ada549f+6:8750:x1874190788474624:12345-192.168.203.4@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787367842.056872:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:376539eb-750a-402c-b2b9-1c135ada549f+6:8750:x1874190788474624:12345-192.168.203.4@tcp:900:mount.lustre.0 Request processed in 206us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367842.056879:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1787367842.058525:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367842.058759:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788474752 00000100:00100000:2.0:1787367842.058768:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788474752 00000100:00100000:2.0:1787367842.058818:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1787367842.058827:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:8750:x1874190788474752:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787367842.058921:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787367842.058990:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:8750:x1874190788474752:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 163us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367842.058997:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00010000:00010000:1.0:1787367842.136858:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367842.712747:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808470400:0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.712821:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367842.712877:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808470912:0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.712901:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367842.712923:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808471424:0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.712944:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367842.712972:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787367842.712978:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808470528:0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713010:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367842.713026:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808471040:0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713047:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367842.713071:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808471552:0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713103:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367842.713132:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808470400 00000100:00100000:0.0:1787367842.713140:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808470400 00000100:00100000:0.0:1787367842.713190:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808470912 00000100:00100000:0.0:1787367842.713194:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808470912 00000100:00100000:0.0:1787367842.713218:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808471424 00000100:00100000:0.0:1787367842.713221:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808471424 00000100:00100000:0.0:1787367842.713235:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808471040 00000100:00100000:0.0:1787367842.713237:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808471040 00000100:00100000:0.0:1787367842.713249:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808471552 00000100:00100000:0.0:1787367842.713251:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808471552 00000100:00100000:0.0:1787367842.713277:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787367842.713288:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808470400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713340:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808470400:12345-0@lo:400:kworker.0 Request processed in 53us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.713347:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787367842.713407:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787367842.713415:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808470912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713441:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808470912:12345-0@lo:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.713447:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787367842.713458:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787367842.713473:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808471424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713498:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808471424:12345-0@lo:400:kworker.0 Request processed in 35us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.713504:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787367842.713520:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787367842.713534:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808471040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713561:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808471040:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.713567:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787367842.713579:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787367842.713585:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808471552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713612:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808471552:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.713618:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1787367842.713634:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367842.713638:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367842.713665:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367842.713673:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808471936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367842.713707:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367842.713733:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808470528 00000100:00100000:0.0:1787367842.713736:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808470528 00000100:00100000:0.0:1787367842.713756:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808471936 00000100:00100000:0.0:1787367842.713758:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808471936 00000100:00100000:0.0:1787367842.713768:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787367842.713774:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808470528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713804:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808470528:12345-0@lo:400:kworker.0 Request processed in 29us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.713810:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787367842.713821:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787367842.713826:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808471936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787367842.713841:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787367842.713872:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808471936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367842.713884:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787367842.713920:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808471936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367842.713947:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808470528:0@lo:400:kworker.0 00010000:00080000:0.0:1787367842.713958:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f6680 x1874190808471040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367842.713968:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808471040:0@lo:400:kworker.0 00010000:00080000:0.0:1787367842.713977:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f5880 x1874190808471552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367842.713985:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808471552:0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.713995:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808470400:0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.714004:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808470912:0@lo:400:kworker.0 00000100:00100000:0.0:1787367842.714012:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808471424:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.715948:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808470656:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716015:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367842.716062:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808471168:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716086:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367842.716107:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808471680:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716127:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367842.716151:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787367842.716159:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808470272:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367842.716206:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808470784:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716246:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367842.716265:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808471296:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716287:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367842.716319:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808471808:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367842.716398:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808470784 00000100:00100000:3.0:1787367842.716406:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808470784 00000100:00100000:3.0:1787367842.716443:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787367842.716453:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808470784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716517:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808470784:12345-0@lo:400:kworker.0 Request processed in 66us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367842.716538:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787367842.716572:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808471168 00000100:00100000:3.0:1787367842.716577:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808471168 00000100:00100000:3.0:1787367842.716619:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808471680 00000100:00100000:3.0:1787367842.716622:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808471680 00000100:00100000:3.0:1787367842.716808:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808471296 00000100:00100000:3.0:1787367842.716812:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808471296 00000100:00100000:3.0:1787367842.716832:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808471808 00000100:00100000:3.0:1787367842.716834:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808471808 00000100:00100000:3.0:1787367842.716846:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787367842.716853:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808471168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716886:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808471168:12345-0@lo:400:kworker.0 Request processed in 33us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367842.716892:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787367842.716903:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787367842.716909:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808471680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716947:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808471680:12345-0@lo:400:kworker.0 Request processed in 39us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367842.716954:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787367842.716965:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787367842.716972:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808471296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.716998:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808471296:12345-0@lo:400:kworker.0 Request processed in 27us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367842.717004:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787367842.717016:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787367842.717023:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808471808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367842.717045:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808470272 00000100:00100000:1.0:1787367842.717051:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808470272 00000100:00100000:3.0:1787367842.717055:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808471808:12345-0@lo:400:kworker.0 Request processed in 32us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367842.717062:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787367842.717083:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367842.717088:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367842.717092:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787367842.717104:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808470272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.717106:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808470656 00000100:00100000:3.0:1787367842.717112:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808470656 00000100:00100000:3.0:1787367842.717136:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787367842.717144:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808470656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367842.717150:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808470272:12345-0@lo:400:kworker.0 Request processed in 49us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367842.717157:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787367842.717184:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808470656:12345-0@lo:400:kworker.0 Request processed in 38us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367842.717191:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787367842.717806:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808470272:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.717821:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808470784:0@lo:400:kworker.0 00010000:00080000:3.0:1787367842.717835:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f7100 x1874190808471296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367842.717854:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808471296:0@lo:400:kworker.0 00010000:00080000:3.0:1787367842.717867:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f4a80 x1874190808471808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367842.717875:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808471808:0@lo:400:kworker.0 00000100:00100000:3.0:1787367842.717885:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808470656:0@lo:400:kworker.0 00010000:00080000:3.0:1787367842.717894:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f5500 x1874190808471168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367842.717902:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808471168:0@lo:400:kworker.0 00010000:00080000:3.0:1787367842.717911:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f5c00 x1874190808471680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367842.717920:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808471680:0@lo:400:kworker.0 00010000:00010000:0.0:1787367843.161669:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367843.224586:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367843.224587:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367843.224611:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808472064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367843.224619:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808472192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367843.224779:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367843.224791:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808472320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367843.229165:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367843.229209:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808472064 00000100:00100000:0.0:1787367843.229220:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808472064 00000100:00100000:0.0:1787367843.229284:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787367843.229294:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808472064:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367843.229552:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787367843.229886:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367843.229957:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808472064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 664us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367843.229983:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787367843.230002:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808472192 00000100:00100000:0.0:1787367843.230007:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808472192 00000100:00100000:0.0:1787367843.230025:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787367843.230031:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808472192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367843.230043:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367843.230082:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808472192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367843.230088:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1787367843.230175:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483794e00 x1874190808472064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367843.230196:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808472064:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787367843.230272:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6370a80 x1874190808472192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367843.230288:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808472192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367843.230580:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367843.230623:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808472320 00000100:00100000:0.0:1787367843.230628:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808472320 00000100:00100000:0.0:1787367843.230664:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787367843.230671:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808472320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367843.230682:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367843.230717:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808472320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367843.230723:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787367843.231700:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c18a80 x1874190808472320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367843.231721:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808472320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367843.738078:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808472448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367843.738155:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367843.738257:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808472448 00000100:00100000:2.0:1787367843.738264:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808472448 00000100:00100000:2.0:1787367843.738316:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787367843.738326:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808472448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367843.738375:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367843.738423:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808472448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367843.738430:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787367843.738474:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483794e00 x1874190808472448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367843.738492:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808472448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367844.187878:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367844.762092:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808472576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367844.762156:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367844.762276:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808472576 00000100:00100000:3.0:1787367844.762283:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808472576 00000100:00100000:3.0:1787367844.762341:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787367844.762350:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808472576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367844.762401:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367844.769938:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808472576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7578us (7770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367844.769955:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787367844.773186:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808472576:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787367845.208540:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367846.233565:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787367847.105992:0:12205:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1787367847.226835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367847.226966:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788474880 00000100:00100000:2.0:1787367847.226976:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788474880 00000100:00100000:2.0:1787367847.227052:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 303 00000100:00100000:2.0:1787367847.227064:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788474880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367847.227134:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788474880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.227140:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 303 00000100:00100000:0.0:1787367847.227477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367847.227514:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788475136 00000100:00100000:0.0:1787367847.227519:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788475136 00000100:00100000:0.0:1787367847.227571:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:0.0:1787367847.227589:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788475136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367847.227619:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788475136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367847.227635:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00080000:0.0:1787367847.227652:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367847.230847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367847.230883:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367847.230887:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788475392 00000100:00100000:1.0:1787367847.230901:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788475392 00000100:00100000:0.0:1787367847.230907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367847.230933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367847.230956:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788475008 00000100:00100000:1.0:1787367847.230959:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788475008 00000100:00100000:1.0:1787367847.230969:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788475264 00000100:00100000:1.0:1787367847.230970:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788475264 00000100:00100000:2.0:1787367847.230983:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788475648 00000100:00100000:1.0:1787367847.230986:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:2.0:1787367847.230990:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788475648 00000100:00100000:1.0:1787367847.230995:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+6:2405:x1874190788475392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367847.231037:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1787367847.231047:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2405:x1874190788475648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367847.231124:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+6:2405:x1874190788475392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 129us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367847.231133:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:1.0:1787367847.231149:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:1.0:1787367847.231156:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788475008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367847.231870:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2405:x1874190788475648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 821us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.231879:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:0.0:1787367847.232163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367847.232197:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:0.0:1787367847.232208:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:2405:x1874190788475264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367847.232249:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:2405:x1874190788475264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367847.232256:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00080000:0.0:1787367847.232275:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367847.232281:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367847.232283:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367847.232401:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788475520 00000100:00100000:3.0:1787367847.232407:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788475520 00000100:00100000:3.0:1787367847.232459:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1787367847.232467:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:376539eb-750a-402c-b2b9-1c135ada549f+6:2405:x1874190788475520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367847.232511:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:376539eb-750a-402c-b2b9-1c135ada549f+6:2405:x1874190788475520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367847.232517:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00080000:0.0:1787367847.233841:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367847.234060:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788475008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 2898us (3147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367847.234073:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 141 00010000:00010000:1.0:1787367847.257032:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787367847.834027:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 376539eb-750a-402c-b2b9-1c135ada549f 00000100:00100000:3.0:1787367847.837835:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808472704:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.837905:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367847.837956:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808473216:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.837984:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367847.838006:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808473728:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.838030:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367847.838049:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808474240:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.838068:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367847.838093:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787367847.838560:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808472960:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.838590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367847.838629:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808473472:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.838654:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367847.838672:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808473984:0@lo:400:kworker.0 00000100:00100000:1.0:1787367847.838681:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808472704 00000100:00100000:1.0:1787367847.838689:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808472704 00000100:00100000:2.0:1787367847.838705:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367847.838729:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787367847.838738:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808472704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367847.838785:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808472704:12345-0@lo:400:kworker.0 Request processed in 48us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367847.838792:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787367847.838892:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787367847.838901:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808473088:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.838925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367847.838943:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808473600:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.838962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367847.838979:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808474112:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.839011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367847.839111:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808473216 00000100:00100000:2.0:1787367847.839116:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808473216 00000100:00100000:2.0:1787367847.839198:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808472960 00000100:00100000:2.0:1787367847.839202:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808472960 00000001:00100000:1.0:1787367847.839209:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 376539eb-750a-402c-b2b9-1c135ada549f 00000100:00100000:2.0:1787367847.839215:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787367847.839220:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808473216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.839256:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808473216:12345-0@lo:400:kworker.0 Request processed in 35us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.839263:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787367847.839332:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808472832:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.839336:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787367847.839342:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808472960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.839385:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367847.839395:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808472960:12345-0@lo:400:kworker.0 Request processed in 54us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367847.839403:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808473344:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.839441:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367847.839454:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808473856:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.839472:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787367847.839474:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367847.839484:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808474368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367847.839491:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808473472 00000100:00100000:2.0:1787367847.839494:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808473472 00000100:00100000:2.0:1787367847.839580:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808473984 00000100:00100000:2.0:1787367847.839584:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808473984 00000100:00100000:2.0:1787367847.839597:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808473088 00000100:00100000:2.0:1787367847.839600:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808473088 00000100:00100000:2.0:1787367847.839610:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808472832 00000100:00100000:2.0:1787367847.839613:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808472832 00000100:00100000:2.0:1787367847.839623:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808473344 00000100:00100000:2.0:1787367847.839625:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808473344 00000100:00100000:2.0:1787367847.839637:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808473856 00000100:00100000:2.0:1787367847.839640:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808473856 00000100:00100000:2.0:1787367847.839652:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787367847.839658:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808473472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367847.839677:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808472960:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.839694:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808473472:12345-0@lo:400:kworker.0 Request processed in 37us (1040us total) trans 0 rc 0/0 00010000:00080000:1.0:1787367847.839698:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc513100 x1874190808473472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367847.839700:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787367847.839709:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808473472:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.839712:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787367847.839718:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.839884:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808473984:12345-0@lo:400:kworker.0 Request processed in 166us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.839891:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787367847.839905:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787367847.839911:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808473088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.839937:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808473088:12345-0@lo:400:kworker.0 Request processed in 27us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.839942:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787367847.839953:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787367847.839958:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808472832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.839984:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808472832:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.839990:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787367847.840000:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787367847.840006:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808473344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.840101:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808473344:12345-0@lo:400:kworker.0 Request processed in 95us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.840108:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787367847.840120:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787367847.840184:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808473856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367847.840187:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808473088:0@lo:400:kworker.0 00010000:00080000:1.0:1787367847.840198:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd68bb80 x1874190808473984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367847.840208:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808473984:0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.840215:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808473856:12345-0@lo:400:kworker.0 Request processed in 33us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.840221:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1787367847.840246:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367847.840250:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367847.840334:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367847.840389:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808472704:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.840400:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808473216:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.840437:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808472832:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.840448:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808473344:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.840456:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808473856:0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.840477:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808474368 00000100:00100000:3.0:1787367847.840481:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808474368 00000100:00100000:3.0:1787367847.840577:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787367847.840584:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808474368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367847.840607:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367847.840642:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808474368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367847.840648:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787367847.840667:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808473728 00000100:00100000:3.0:1787367847.840671:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808473728 00000100:00100000:3.0:1787367847.840695:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808474240 00000100:00100000:3.0:1787367847.840698:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808474240 00000100:00100000:3.0:1787367847.840710:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808473600 00000100:00100000:3.0:1787367847.840712:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808473600 00000100:00100000:3.0:1787367847.840733:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808474112 00000100:00100000:3.0:1787367847.840736:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808474112 00000100:00100000:3.0:1787367847.840749:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787367847.840754:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808473728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.840784:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808473728:12345-0@lo:400:kworker.0 Request processed in 30us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367847.840791:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787367847.840797:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787367847.840801:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787367847.840805:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808474240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367847.840806:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808473600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.840891:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808474240:12345-0@lo:400:kworker.0 Request processed in 88us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.840898:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787367847.840911:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787367847.840917:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808474112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367847.840949:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808474112:12345-0@lo:400:kworker.0 Request processed in 32us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367847.840955:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1787367847.840988:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc692a00 x1874190808474112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367847.840999:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808474112:0@lo:400:kworker.0 00000100:00080000:1.0:1787367847.841039:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367847.841042:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367847.841479:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808473600:12345-0@lo:400:kworker.0 Request processed in 672us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367847.841496:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787367847.842025:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808474368:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787367847.842039:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd688700 x1874190808473728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367847.842049:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808473728:0@lo:400:kworker.0 00010000:00080000:3.0:1787367847.842062:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc691880 x1874190808474240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367847.842070:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808474240:0@lo:400:kworker.0 00000001:00100000:2.0:1787367847.842097:0:6517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 376539eb-750a-402c-b2b9-1c135ada549f 00010000:00080000:1.0:1787367847.842239:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd689500 x1874190808473600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367847.842319:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808473600:0@lo:400:kworker.0 00000001:00100000:3.0:1787367847.847172:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 376539eb-750a-402c-b2b9-1c135ada549f 00010000:00010000:1.0:1787367848.280508:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367848.346089:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367848.346111:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808474496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367848.346172:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367848.346234:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808474496 00000100:00100000:0.0:1787367848.346240:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808474496 00000100:00100000:0.0:1787367848.346283:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787367848.346292:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808474496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367848.346319:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367848.346381:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808474496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367848.346398:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787367848.346449:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6371180 x1874190808474496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367848.346466:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808474496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367848.349089:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367848.349111:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808474624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367848.349171:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367848.349219:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808474624 00000100:00100000:1.0:1787367848.349227:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808474624 00000100:00100000:1.0:1787367848.349988:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787367848.349999:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808474624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367848.350019:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367848.350072:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808474624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367848.350079:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1787367848.350123:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c1b800 x1874190808474624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367848.350140:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808474624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367848.350708:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367848.350722:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808474752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367848.350763:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367848.350794:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808474752 00000100:00100000:0.0:1787367848.350799:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808474752 00000100:00100000:0.0:1787367848.350821:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787367848.350828:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808474752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367848.350846:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367848.350879:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808474752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367848.350885:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1787367848.350910:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6371180 x1874190808474752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367848.350924:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808474752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367848.858997:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367848.859020:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808474880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367848.859091:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367848.859251:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808474880 00000100:00100000:2.0:1787367848.859260:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808474880 00000100:00100000:2.0:1787367848.859311:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787367848.859321:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808474880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367848.859343:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367848.859428:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808474880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367848.859449:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1787367848.859535:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4e300 x1874190808474880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367848.859553:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808474880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367849.305074:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367849.880593:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808475008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367849.880672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367849.880931:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808475008 00000100:00100000:3.0:1787367849.880938:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808475008 00000100:00100000:3.0:1787367849.880993:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787367849.881003:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808475008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367849.881038:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367849.883249:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808475008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2240us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367849.883263:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787367849.884038:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808475008:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787367850.330189:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367851.358346:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367852.339780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367852.339822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367852.339859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367852.339896:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367852.339915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367852.339933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367852.339972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367852.340020:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788476032 00000100:00100000:0.0:1787367852.340029:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788476032 00000100:00100000:0.0:1787367852.340075:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788476288 00000100:00100000:0.0:1787367852.340078:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788476288 00000100:00100000:0.0:1787367852.340091:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788475904 00000100:00100000:0.0:1787367852.340094:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788475904 00000100:00100000:0.0:1787367852.340105:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788476160 00000100:00100000:0.0:1787367852.340107:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788476160 00000100:00100000:0.0:1787367852.340139:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 149 00000100:00100000:0.0:1787367852.340150:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788476032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367852.340220:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788476032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.340228:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 149 00000100:00100000:0.0:1787367852.340244:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:0.0:1787367852.340251:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788476288:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367852.340276:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788476288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.340282:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:0.0:1787367852.340293:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:0.0:1787367852.340298:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788475904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367852.340317:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788475904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.340323:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:0.0:1787367852.340332:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00100000:0.0:1787367852.340337:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788476160:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367852.340386:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788476160:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.340417:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00100000:0.0:1787367852.340437:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788476544 00000100:00100000:0.0:1787367852.340441:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788476544 00000100:00100000:0.0:1787367852.340466:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788476416 00000100:00100000:0.0:1787367852.340469:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788476416 00000100:00100000:0.0:1787367852.340489:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1787367852.340496:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788476544:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367852.340523:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788476544:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.340529:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1787367852.340553:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:0.0:1787367852.340561:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788476416:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367852.340584:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788476416:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.340589:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00080000:1.0:1787367852.340794:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367852.340799:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367852.340801:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367852.340803:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367852.346702:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788475776 00000100:00100000:3.0:1787367852.346715:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788475776 00000100:00100000:3.0:1787367852.346829:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 305 00000100:00100000:3.0:1787367852.346839:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788475776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367852.346910:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788475776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (7138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367852.346917:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 305 00010000:00010000:2.0:1787367852.378008:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367852.954173:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808475520:0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.954244:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367852.954285:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808475136:0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.954302:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808476032:0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.954325:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367852.954337:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367852.954379:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808475648:0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.954595:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808476544:0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.954602:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367852.954628:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808476160:0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.954802:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808475264:0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.954832:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367852.954940:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808475776:0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.954946:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367852.954976:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367852.954980:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808476672:0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.955005:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808476288:0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955009:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367852.955042:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367852.955053:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808475392:0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.955065:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808476800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367852.955092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367852.955111:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808476032 00000100:00100000:1.0:1787367852.955111:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808475520 00000100:00100000:1.0:1787367852.955118:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808475520 00000100:00100000:3.0:1787367852.955119:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808476032 00000100:00100000:0.0:1787367852.955119:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808475904:0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955147:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367852.955158:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808475264 00000100:00100000:3.0:1787367852.955161:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808476160 00000100:00100000:0.0:1787367852.955162:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808476416:0@lo:400:kworker.0 00000100:00100000:3.0:1787367852.955163:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808476160 00000100:00100000:1.0:1787367852.955163:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808475264 00000100:00100000:3.0:1787367852.955182:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808476672 00000100:00100000:1.0:1787367852.955182:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808475776 00000100:00100000:3.0:1787367852.955186:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808476672 00000100:00100000:1.0:1787367852.955186:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808475776 00000100:00100000:0.0:1787367852.955190:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367852.955204:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808476288 00000100:00100000:1.0:1787367852.955207:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808476288 00000100:00100000:3.0:1787367852.955209:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787367852.955217:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808476032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955222:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808475136 00000100:00100000:1.0:1787367852.955223:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808475904 00000100:00100000:0.0:1787367852.955229:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808475136 00000100:00100000:1.0:1787367852.955230:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808475904 00000100:00100000:1.0:1787367852.955247:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808476416 00000100:00100000:1.0:1787367852.955249:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808476416 00000100:00100000:3.0:1787367852.955270:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808476032:12345-0@lo:400:kworker.0 Request processed in 54us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367852.955271:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787367852.955276:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787367852.955281:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787367852.955281:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808475520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955289:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808475136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367852.955301:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787367852.955308:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808476160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.955331:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808475520:12345-0@lo:400:kworker.0 Request processed in 51us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367852.955339:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787367852.955374:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787367852.955381:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808475264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955385:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808475136:12345-0@lo:400:kworker.0 Request processed in 98us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367852.955400:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808476160:12345-0@lo:400:kworker.0 Request processed in 82us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367852.955406:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787367852.955423:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808475264:12345-0@lo:400:kworker.0 Request processed in 44us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367852.955426:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787367852.955429:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787367852.955432:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808476672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.955439:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787367852.955451:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808475776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367852.955461:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808476672:12345-0@lo:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367852.955467:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787367852.955474:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808475776:12345-0@lo:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367852.955480:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787367852.955490:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787367852.955496:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808476288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955510:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787367852.955529:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808476288:12345-0@lo:400:kworker.0 Request processed in 33us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367852.955537:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787367852.955549:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808475648 00000100:00100000:0.0:1787367852.955553:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808475648 00000100:00100000:1.0:1787367852.955556:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787367852.955566:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808475904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955586:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808475392 00000100:00100000:0.0:1787367852.955589:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808475392 00000100:00100000:1.0:1787367852.955605:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808475904:12345-0@lo:400:kworker.0 Request processed in 40us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.955606:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787367852.955617:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808475648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.955618:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787367852.955625:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787367852.955636:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808475392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955657:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808475648:12345-0@lo:400:kworker.0 Request processed in 42us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.955664:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787367852.955683:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808475392:12345-0@lo:400:kworker.0 Request processed in 48us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367852.955690:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787367852.955707:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808475136:0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955721:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808475648:0@lo:400:kworker.0 00010000:00080000:0.0:1787367852.955731:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4ce00 x1874190808476160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367852.955753:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808476160:0@lo:400:kworker.0 00010000:00080000:0.0:1787367852.955763:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4c700 x1874190808476672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367852.955770:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808476672:0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955828:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787367852.955835:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808476416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.955865:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808476416:12345-0@lo:400:kworker.0 Request processed in 31us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.955870:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787367852.955896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367852.955929:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808475520:0@lo:400:kworker.0 00010000:00080000:0.0:1787367852.955939:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4c000 x1874190808476032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787367852.955946:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367852.955949:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808476032:0@lo:400:kworker.0 00000100:00080000:1.0:1787367852.955952:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367852.955956:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367852.955960:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367852.955985:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808475392:0@lo:400:kworker.0 00000100:00100000:3.0:1787367852.956004:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808476544 00000100:00100000:3.0:1787367852.956009:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808476544 00000100:00100000:3.0:1787367852.956035:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787367852.956040:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808476544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.956063:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787367852.956071:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4d180 x1874190808475904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367852.956082:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808475904:0@lo:400:kworker.0 00000100:00100000:3.0:1787367852.956089:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808476544:12345-0@lo:400:kworker.0 Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367852.956096:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1787367852.956096:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4d500 x1874190808476416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367852.956102:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808475264:0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.956108:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808476416:0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.956118:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808475776:0@lo:400:kworker.0 00000100:00100000:0.0:1787367852.956130:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808476288:0@lo:400:kworker.0 00000100:00080000:1.0:1787367852.956155:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367852.956160:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808476800 00000100:00100000:0.0:1787367852.956164:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808476800 00000100:00100000:0.0:1787367852.956190:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787367852.956196:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb663450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808476800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787367852.956226:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787367852.956271:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb663450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808476800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367852.956277:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1787367852.956586:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4f100 x1874190808476544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367852.956596:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808476544:0@lo:400:kworker.0 00000100:00100000:1.0:1787367852.956703:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808476800:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787367853.400716:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367853.464520:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808476928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367853.464551:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808477056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367853.464589:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367853.464622:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367853.464663:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367853.464673:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808477184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367853.464685:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808476928 00000100:00100000:1.0:1787367853.464692:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808476928 00000100:00100000:1.0:1787367853.464725:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808477056 00000100:00100000:1.0:1787367853.464728:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808477056 00000100:00100000:1.0:1787367853.464743:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787367853.464751:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808476928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367853.464777:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367853.464830:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808476928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367853.464837:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787367853.464852:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787367853.464858:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808477056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367853.464871:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367853.464894:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808477056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367853.464899:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787367853.464929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787367853.464974:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f4380 x1874190808477056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787367853.464975:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c18e00 x1874190808476928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367853.465013:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808477056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367853.465013:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808476928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367853.465049:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808477184 00000100:00100000:3.0:1787367853.465053:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808477184 00000100:00100000:3.0:1787367853.465075:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787367853.465081:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55adcdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808477184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367853.465091:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367853.465132:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55adcdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808477184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367853.465138:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1787367853.465219:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f5180 x1874190808477184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367853.465231:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808477184:0@lo:13:osp-pre-1-0.0 00000020:00000004:3.0:1787367853.541671:0:12521:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787367853.541954:0:12521:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787367853.977636:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367853.977665:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808477312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367853.977730:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367853.977801:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808477312 00000100:00100000:2.0:1787367853.977808:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808477312 00000100:00100000:2.0:1787367853.977862:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787367853.977873:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808477312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367853.977904:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367853.977954:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808477312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367853.977963:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1787367853.978002:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c548278ce00 x1874190808477312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367853.978020:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808477312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367854.428474:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367855.003537:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808477440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787367855.003652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367855.004020:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808477440 00000100:00100000:1.0:1787367855.004028:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808477440 00000100:00100000:1.0:1787367855.004085:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787367855.004095:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808477440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787367855.004214:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787367855.004269:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808477440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367855.004287:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787367855.004348:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808477440:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1787367855.359075:0:12619:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787367855.359331:0:12619:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787367855.448772:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367856.472849:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787367857.263279:0:12716:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787367857.263848:0:12716:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787367857.460669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367857.460711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367857.460746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367857.460751:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788476800 00000100:00100000:3.0:1787367857.460762:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788476800 00000100:00100000:1.0:1787367857.460776:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788477312 00000100:00100000:1.0:1787367857.460782:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788477312 00000100:00100000:3.0:1787367857.460816:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788477056 00000100:00100000:3.0:1787367857.460821:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788477056 00000100:00100000:3.0:1787367857.460848:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:3.0:1787367857.460857:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788476800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367857.460893:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1787367857.460904:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367857.460937:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788476800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367857.460942:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367857.460951:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:1.0:1787367857.460956:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:3.0:1787367857.460977:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00080000:1.0:1787367857.460980:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367857.460987:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367857.460988:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367857.461018:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367857.461025:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:0.0:1787367857.465095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367857.466053:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788476672 00000100:00100000:2.0:1787367857.466064:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788476672 00000100:00100000:2.0:1787367857.466122:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 307 00000100:00100000:2.0:1787367857.466132:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788476672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367857.466224:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788476672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 93us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367857.466232:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 307 00000100:00100000:3.0:1787367857.466447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367857.466573:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367857.466611:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367857.466632:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788477440 00000100:00100000:3.0:1787367857.466635:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788477440 00000100:00100000:3.0:1787367857.466679:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:3.0:1787367857.466688:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477440:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367857.466722:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367857.466729:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:3.0:1787367857.466845:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788476928 00000100:00100000:3.0:1787367857.466849:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788476928 00000100:00100000:3.0:1787367857.466873:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788477184 00000100:00100000:3.0:1787367857.466875:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788477184 00000100:00100000:3.0:1787367857.466891:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:3.0:1787367857.466898:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788476928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367857.466926:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788476928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367857.466933:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:3.0:1787367857.466944:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:3.0:1787367857.466950:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367857.466970:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367857.466976:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00080000:1.0:1787367857.467965:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367857.467973:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787367857.496564:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367858.077956:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367858.077979:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808477568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367858.078046:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367858.078105:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808477568 00000100:00100000:0.0:1787367858.078113:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808477568 00000100:00100000:0.0:1787367858.078157:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787367858.078166:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808477568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787367858.078208:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787367858.078272:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808477568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367858.078279:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787367858.078319:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808477568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367858.089757:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808477824:0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.089829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367858.089883:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808478336:0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.089907:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367858.089924:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808478848:0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.089944:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367858.089968:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787367858.089975:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808477952:0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.089996:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367858.090017:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808478464:0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.090041:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367858.090057:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808478976:0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.090077:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367858.090107:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808477824 00000100:00100000:2.0:1787367858.090114:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808477824 00000100:00100000:2.0:1787367858.090150:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808478336 00000100:00100000:2.0:1787367858.090153:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808478336 00000100:00100000:2.0:1787367858.090172:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808478848 00000100:00100000:2.0:1787367858.090174:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808478848 00000100:00100000:1.0:1787367858.090303:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808478464 00000100:00100000:1.0:1787367858.090308:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808478464 00000100:00100000:1.0:1787367858.090346:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808478976 00000100:00100000:1.0:1787367858.090349:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808478976 00000100:00100000:1.0:1787367858.090397:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787367858.090407:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808478464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.090472:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808478464:12345-0@lo:400:kworker.0 Request processed in 67us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367858.090480:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787367858.090496:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787367858.090515:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808478976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.090557:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808478976:12345-0@lo:400:kworker.0 Request processed in 55us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367858.090564:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1787367858.090581:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367858.090585:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367858.090587:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787367858.090613:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f5f80 x1874190808478464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367858.090625:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808478464:0@lo:400:kworker.0 00010000:00080000:1.0:1787367858.090634:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f0000 x1874190808478976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367858.090641:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808478976:0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.090841:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808477696:0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.090871:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367858.090903:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808478208:0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.090923:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367858.090932:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808478720:0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.090948:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367858.090959:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787367858.090965:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808478080:0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.090985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367858.091001:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808478592:0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.091021:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367858.091034:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808479104:0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.091063:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367858.091087:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808478080 00000100:00100000:1.0:1787367858.091091:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808478080 00000100:00100000:1.0:1787367858.091115:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787367858.091121:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808478080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.091154:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808478080:12345-0@lo:400:kworker.0 Request processed in 33us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367858.091160:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787367858.091173:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808478592 00000100:00100000:1.0:1787367858.091189:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808478592 00000100:00100000:1.0:1787367858.091211:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808479104 00000100:00100000:1.0:1787367858.091214:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808479104 00000100:00100000:1.0:1787367858.091231:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787367858.091236:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808478592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.091266:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808478592:12345-0@lo:400:kworker.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367858.091272:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787367858.091281:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787367858.091287:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808479104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367858.091308:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808479104:12345-0@lo:400:kworker.0 Request processed in 22us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367858.091314:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787367858.091327:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367858.091329:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367858.091346:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808478080:0@lo:400:kworker.0 00010000:00080000:1.0:1787367858.091387:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f4380 x1874190808478592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367858.091409:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808478592:0@lo:400:kworker.0 00010000:00080000:1.0:1787367858.091421:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f0a80 x1874190808479104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367858.091429:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808479104:0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.093808:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808477952 00000100:00100000:2.0:1787367858.093816:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808477952 00000100:00100000:2.0:1787367858.093830:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808478208 00000100:00100000:2.0:1787367858.093839:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808478208 00000100:00100000:2.0:1787367858.093854:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808478720 00000100:00100000:2.0:1787367858.093856:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808478720 00000100:00100000:2.0:1787367858.093872:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787367858.093882:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808477824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.093963:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808477824:12345-0@lo:400:kworker.0 Request processed in 82us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367858.093970:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787367858.093986:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787367858.093994:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808478336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.094022:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808478336:12345-0@lo:400:kworker.0 Request processed in 29us (4114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367858.094028:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787367858.094038:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787367858.094045:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808478848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.094069:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808478848:12345-0@lo:400:kworker.0 Request processed in 25us (4124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367858.094075:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787367858.094086:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787367858.094092:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808477952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.094116:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808477952:12345-0@lo:400:kworker.0 Request processed in 24us (4119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367858.094121:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787367858.094131:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787367858.094137:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808478208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.094169:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808478208:12345-0@lo:400:kworker.0 Request processed in 33us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367858.103346:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787367858.103403:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808478720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367858.103719:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808478720:12345-0@lo:400:kworker.0 Request processed in 111us (12553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367858.103739:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787367858.103895:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808477952:0@lo:400:kworker.0 00000100:00100000:3.0:1787367858.103909:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808477824:0@lo:400:kworker.0 00010000:00080000:3.0:1787367858.103923:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f6680 x1874190808478336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367858.103934:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808478336:0@lo:400:kworker.0 00010000:00080000:3.0:1787367858.103945:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f2a00 x1874190808478848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367858.103954:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808478848:0@lo:400:kworker.0 00000100:00080000:3.0:1787367858.103983:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367858.103988:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367858.104014:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808478208:0@lo:400:kworker.0 00000100:00100000:3.0:1787367858.104024:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808478720:0@lo:400:kworker.0 00000100:00100000:3.0:1787367858.104061:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808477696 00000100:00100000:3.0:1787367858.104067:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808477696 00000100:00100000:3.0:1787367858.104108:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787367858.104114:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808477696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367858.104149:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808477696:12345-0@lo:400:kworker.0 Request processed in 36us (13277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367858.104155:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787367858.104199:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808477696:0@lo:400:kworker.0 00000100:00100000:2.0:1787367858.104915:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00010000:1.0:1787367858.522873:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367858.590316:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367858.590337:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808479232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367858.590427:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367858.590488:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808479232 00000100:00100000:0.0:1787367858.590495:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808479232 00000100:00100000:0.0:1787367858.590539:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787367858.590549:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808479232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367858.590575:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367858.590616:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808479232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367858.590623:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1787367858.590660:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f0e00 x1874190808479232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367858.590678:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808479232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367858.591133:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808479360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367858.591160:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367858.591272:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808479360 00000100:00100000:1.0:1787367858.591276:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808479360 00000100:00100000:1.0:1787367858.591304:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787367858.591311:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808479360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367858.591322:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367858.591379:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808479360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367858.591385:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787367858.591448:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c18e00 x1874190808479360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367858.591462:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808479360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367858.596954:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808479488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367858.597092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367858.597148:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808479488 00000100:00100000:1.0:1787367858.597156:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808479488 00000100:00100000:1.0:1787367858.597205:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787367858.597215:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808479488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367858.597241:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367858.597302:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808479488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367858.597309:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1787367858.597408:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c18000 x1874190808479488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367858.597492:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808479488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367859.098474:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808479616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367859.098540:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367859.098600:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808479616 00000100:00100000:1.0:1787367859.098619:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808479616 00000100:00100000:1.0:1787367859.098671:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787367859.098680:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808479616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367859.098713:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367859.098768:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808479616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367859.098775:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1787367859.099427:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c548278e300 x1874190808479616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367859.099449:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808479616:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367859.548432:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787367859.551186:0:12813:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787367859.551468:0:12813:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787367860.121852:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808479744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367860.121919:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367860.122026:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808479744 00000100:00100000:3.0:1787367860.122041:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808479744 00000100:00100000:3.0:1787367860.122085:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787367860.122094:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808479744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367860.122124:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367860.122185:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808479744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367860.122192:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787367860.122283:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808479744:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787367860.568499:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787367861.458861:0:12910:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787367861.459108:0:12910:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787367861.592655:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367862.580799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367862.580842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367862.580869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367862.580891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367862.580915:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367862.581063:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788477568 00000100:00100000:0.0:1787367862.581073:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788477568 00000100:00100000:1.0:1787367862.581187:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788477824 00000100:00100000:1.0:1787367862.581192:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788477824 00000100:00100000:0.0:1787367862.585320:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 309 00000100:00100000:0.0:1787367862.585476:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788477568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367862.585558:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788477568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 90us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367862.585579:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 309 00000100:00100000:3.0:1787367862.588074:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788478080 00000100:00100000:3.0:1787367862.588086:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788478080 00000100:00100000:0.0:1787367862.588180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367862.588255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367862.588274:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788478208 00000100:00100000:0.0:1787367862.588278:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788478208 00000100:00100000:1.0:1787367862.589416:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788477696 00000100:00100000:1.0:1787367862.589424:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788477696 00000100:00100000:2.0:1787367862.590225:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788477952 00000100:00100000:2.0:1787367862.590233:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788477952 00000100:00100000:3.0:1787367862.591174:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:3.0:1787367862.591185:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788477824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367862.591267:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788477824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 83us (10424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367862.591275:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:3.0:1787367862.591292:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:3.0:1787367862.591298:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788478080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367862.591747:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:2.0:1787367862.591755:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367862.591790:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788477952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (10874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367862.591797:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:1.0:1787367862.592186:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00100000:1.0:1787367862.592195:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788477696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367862.592224:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788477696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (11333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367862.592231:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00080000:2.0:1787367862.592687:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367862.592693:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367862.592696:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367862.593434:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788478080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 2131us (12559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367862.593446:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:0.0:1787367862.594607:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788478336 00000100:00100000:0.0:1787367862.594615:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788478336 00000100:00100000:0.0:1787367862.594647:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1787367862.594656:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2401:x1874190788478208:12345-192.168.203.4@tcp:9:kworker.0 00000100:00100000:2.0:1787367862.595644:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:2.0:1787367862.595660:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2401:x1874190788478336:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:2.0:1787367862.595701:0:8453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0307e9 00000100:00080000:2.0:1787367862.595711:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c548277d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787367862.595754:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787367862.595900:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:376539eb-750a-402c-b2b9-1c135ada549f+2:2401:x1874190788478336:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 244us (7643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367862.595908:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000020:00000080:0.0:1787367862.596489:0:8451:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0307e2 00000100:00080000:0.0:1787367862.596498:0:8451:0:(import.c:65:import_set_state_nolock()) ffff9c548335c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787367862.596537:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787367862.596627:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:376539eb-750a-402c-b2b9-1c135ada549f+2:2401:x1874190788478208:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 1971us (8449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367862.596635:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00080000:0.0:1787367862.596656:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787367862.596680:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367862.596817:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367862.619861:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367863.192736:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808479872:0@lo:400:kworker.0 00000100:00100000:0.0:1787367863.192805:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.195716:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808480128:0@lo:400:kworker.0 00000100:00100000:1.0:1787367863.195802:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808480256:0@lo:400:kworker.0 00000100:00100000:0.0:1787367863.195908:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808480384:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.195981:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.196005:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808480640:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196025:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.196040:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808481152:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196055:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.196094:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808480000:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196113:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.196126:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808480512:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.196150:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808481024:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196165:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.196171:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808481536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367863.196184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.196210:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808480128 00000100:00100000:3.0:1787367863.196217:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808480128 00000100:00100000:3.0:1787367863.196262:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808481536 00000100:00100000:3.0:1787367863.196265:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808481536 00000100:00100000:3.0:1787367863.196280:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787367863.196287:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808480128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196347:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808480128:12345-0@lo:400:kworker.0 Request processed in 60us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367863.196368:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787367863.196392:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787367863.196398:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808481536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367863.196419:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367863.196456:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808481536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367863.196461:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787367863.196485:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808480640 00000100:00100000:3.0:1787367863.196488:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808480640 00000100:00100000:3.0:1787367863.196510:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808481152 00000100:00100000:3.0:1787367863.196512:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808481152 00000100:00100000:3.0:1787367863.196520:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808480000 00000100:00100000:3.0:1787367863.196522:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808480000 00000100:00100000:3.0:1787367863.196529:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808480512 00000100:00100000:3.0:1787367863.196531:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808480512 00000100:00100000:3.0:1787367863.196539:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808481024 00000100:00100000:3.0:1787367863.196540:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808481024 00000100:00100000:3.0:1787367863.196550:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787367863.196555:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808480640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196588:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808480640:12345-0@lo:400:kworker.0 Request processed in 33us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367863.196594:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787367863.196603:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787367863.196607:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808481152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196630:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808481152:12345-0@lo:400:kworker.0 Request processed in 22us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367863.196635:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787367863.196646:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787367863.196652:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808480000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196676:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808480000:12345-0@lo:400:kworker.0 Request processed in 24us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367863.196681:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787367863.196700:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787367863.196707:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808480512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196735:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808480512:12345-0@lo:400:kworker.0 Request processed in 29us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367863.196741:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787367863.196752:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787367863.196757:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808481024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196777:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808481024:12345-0@lo:400:kworker.0 Request processed in 20us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367863.196782:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787367863.196818:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808480000:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196826:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808480512:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196833:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808481024:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.196844:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808481536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367863.196872:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808480128:0@lo:400:kworker.0 00010000:00080000:3.0:1787367863.196881:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc1500 x1874190808480640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367863.196891:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808480640:0@lo:400:kworker.0 00010000:00080000:3.0:1787367863.196898:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc2d80 x1874190808481152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367863.196905:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808481152:0@lo:400:kworker.0 00000100:00100000:1.0:1787367863.202860:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367863.202913:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808480768:0@lo:400:kworker.0 00000100:00100000:1.0:1787367863.202947:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367863.202972:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808481280:0@lo:400:kworker.0 00000100:00100000:1.0:1787367863.203011:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367863.203059:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808480768 00000100:00100000:1.0:1787367863.203066:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808480768 00000100:00100000:1.0:1787367863.203781:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808481280 00000100:00100000:1.0:1787367863.203787:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808481280 00000100:00100000:1.0:1787367863.203817:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787367863.203827:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808480768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367863.203882:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808480768:12345-0@lo:400:kworker.0 Request processed in 57us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367863.203889:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787367863.203904:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787367863.203910:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808481280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367863.203937:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808481280:12345-0@lo:400:kworker.0 Request processed in 28us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367863.203942:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1787367863.203981:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc0a80 x1874190808480768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367863.203995:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808480768:0@lo:400:kworker.0 00010000:00080000:1.0:1787367863.204005:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482620000 x1874190808481280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367863.204013:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808481280:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.205388:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808480256 00000100:00100000:3.0:1787367863.205412:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808480256 00000100:00100000:3.0:1787367863.205459:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787367863.205478:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808480256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.205544:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808480256:12345-0@lo:400:kworker.0 Request processed in 77us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367863.205551:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787367863.207183:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808480256:0@lo:400:kworker.0 00000100:00100000:0.0:1787367863.207563:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808479872 00000100:00100000:0.0:1787367863.207570:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808479872 00000100:00100000:0.0:1787367863.207620:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787367863.207629:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808479872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367863.207684:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808479872:12345-0@lo:400:kworker.0 Request processed in 57us (14879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367863.207691:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:0.0:1787367863.207725:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367863.207731:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367863.207734:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367863.207736:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367863.207761:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367863.207795:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808480896:0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.208145:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808480384 00000100:00100000:3.0:1787367863.208150:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808480384 00000100:00100000:3.0:1787367863.208188:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787367863.208196:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808480384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367863.208234:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808480384:12345-0@lo:400:kworker.0 Request processed in 39us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367863.208333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367863.208443:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808481408:0@lo:400:kworker.0 00000100:00100000:0.0:1787367863.208481:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.208519:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787367863.220725:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808480896 00000100:00100000:1.0:1787367863.220740:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808480896 00000100:00100000:1.0:1787367863.220805:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808481408 00000100:00100000:1.0:1787367863.220808:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808481408 00000100:00100000:1.0:1787367863.220842:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787367863.220864:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808480896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367863.220944:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808480896:12345-0@lo:400:kworker.0 Request processed in 82us (13122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367863.220951:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787367863.220966:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787367863.220971:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808481408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367863.220994:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808481408:12345-0@lo:400:kworker.0 Request processed in 23us (12513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367863.220999:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1787367863.221209:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482623800 x1874190808481408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367863.221223:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808481408:0@lo:400:kworker.0 00000100:00100000:0.0:1787367863.221250:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808479872:0@lo:400:kworker.0 00000100:00100000:0.0:1787367863.221261:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808480384:0@lo:400:kworker.0 00010000:00080000:0.0:1787367863.221269:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc0000 x1874190808480896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367863.221277:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808480896:0@lo:400:kworker.0 00000100:00080000:3.0:1787367863.222410:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367863.222417:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787367863.641711:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367863.704927:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808481664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367863.704999:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367863.705070:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367863.705076:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808481792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367863.705102:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367863.708763:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808481664 00000100:00100000:2.0:1787367863.708776:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808481664 00000100:00100000:2.0:1787367863.708808:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808481792 00000100:00100000:2.0:1787367863.708811:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808481792 00000100:00100000:2.0:1787367863.708825:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787367863.708833:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808481664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787367863.708860:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367863.708925:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808481664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (3926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367863.708932:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787367863.708945:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787367863.708951:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808481792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367863.708959:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367863.708979:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808481792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (3877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367863.708984:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1787367863.709176:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c548278e300 x1874190808481792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367863.709194:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808481792:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787367863.709205:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482623800 x1874190808481664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367863.709230:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808481664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367863.717385:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808481920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367863.717456:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367863.718902:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808481920 00000100:00100000:1.0:1787367863.718912:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808481920 00000100:00100000:1.0:1787367863.718969:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787367863.718978:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808481920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367863.719008:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367863.719117:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808481920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367863.719126:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1787367863.719174:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f5180 x1874190808481920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367863.719193:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808481920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367864.216735:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367864.225519:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808482048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367864.225596:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367864.225741:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808482048 00000100:00100000:2.0:1787367864.225749:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808482048 00000100:00100000:2.0:1787367864.225793:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787367864.225802:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808482048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367864.225839:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367864.225896:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808482048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367864.225903:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1787367864.226069:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c548278c380 x1874190808482048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367864.226088:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808482048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367864.665847:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787367865.027805:0:13055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787367865.240838:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808482176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787367865.240903:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367865.241098:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808482176 00000100:00100000:0.0:1787367865.241106:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808482176 00000100:00100000:0.0:1787367865.241243:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787367865.241253:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808482176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787367865.241283:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787367865.241340:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808482176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367865.241346:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787367865.241434:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808482176:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787367865.691505:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367866.715513:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367867.710175:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367867.710633:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367867.710665:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367867.710725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367867.710750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367867.710775:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788478720 00000100:00100000:2.0:1787367867.710784:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788478720 00000100:00100000:2.0:1787367867.710839:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788478976 00000100:00100000:2.0:1787367867.710841:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788478976 00000100:00100000:2.0:1787367867.710852:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788478592 00000100:00100000:2.0:1787367867.710854:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788478592 00000100:00100000:2.0:1787367867.710864:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788478848 00000100:00100000:2.0:1787367867.710866:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788478848 00000100:00100000:2.0:1787367867.710909:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:2.0:1787367867.710919:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788478720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367867.710993:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788478720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 75us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367867.711000:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:2.0:1787367867.711018:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:2.0:1787367867.711025:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788478976:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367867.711048:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788478976:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367867.711069:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:2.0:1787367867.711082:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:2.0:1787367867.711088:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788478592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367867.711112:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788478592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367867.711118:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:2.0:1787367867.711128:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:2.0:1787367867.711134:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788478848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367867.711155:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788478848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367867.711161:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00080000:2.0:1787367867.711190:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367867.711199:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367867.716814:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788478464 00000100:00100000:3.0:1787367867.716828:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788478464 00000100:00100000:3.0:1787367867.716892:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 311 00000100:00100000:3.0:1787367867.716902:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788478464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367867.716971:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788478464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 70us (7850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367867.716978:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 311 00010000:00010000:2.0:1787367867.738798:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367868.313016:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808482688:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.313082:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367868.313134:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808483200:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.313159:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367868.313179:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808483712:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.313200:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367868.313225:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787367868.313230:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808482304:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.313256:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367868.313276:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808482816:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.313312:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367868.313343:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808483328:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.313392:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367868.313410:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808483840:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.313429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367868.313788:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808482688 00000100:00100000:2.0:1787367868.313796:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808482688 00000100:00100000:2.0:1787367868.313846:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787367868.313855:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808482688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.313906:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808482688:12345-0@lo:400:kworker.0 Request processed in 51us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367868.313913:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787367868.313963:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808483200 00000100:00100000:2.0:1787367868.313967:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808483200 00000100:00100000:2.0:1787367868.314001:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808483712 00000100:00100000:2.0:1787367868.314004:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808483712 00000100:00100000:2.0:1787367868.314029:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808483328 00000100:00100000:2.0:1787367868.314032:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808483328 00000100:00100000:2.0:1787367868.314045:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787367868.314051:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808483200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.314083:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808483200:12345-0@lo:400:kworker.0 Request processed in 33us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367868.314089:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787367868.314099:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787367868.314105:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808483712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.314130:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808483712:12345-0@lo:400:kworker.0 Request processed in 26us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367868.314136:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787367868.314146:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787367868.314152:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808483328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.314176:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808483328:12345-0@lo:400:kworker.0 Request processed in 25us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367868.314181:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787367868.314202:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808482432:0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.314228:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367868.314248:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808482944:0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.314267:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367868.314283:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808483456:0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.314313:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367868.314327:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808483968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367868.314347:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367868.314410:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787367868.314416:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808482560:0@lo:400:kworker.0 00000100:00100000:0.0:1787367868.314538:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808482432 00000100:00100000:0.0:1787367868.314547:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808482432 00000100:00100000:0.0:1787367868.314567:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808482944 00000100:00100000:0.0:1787367868.314570:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808482944 00000100:00100000:0.0:1787367868.314581:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808483456 00000100:00100000:0.0:1787367868.314583:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808483456 00000100:00100000:0.0:1787367868.314596:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787367868.314603:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808482432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367868.321119:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808482432:12345-0@lo:400:kworker.0 Request processed in 6507us (6880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367868.321134:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787367868.321167:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787367868.321179:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808482944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367868.321225:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808482944:12345-0@lo:400:kworker.0 Request processed in 51us (6957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367868.321237:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787367868.321249:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787367868.321255:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808483456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367868.321282:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808483456:12345-0@lo:400:kworker.0 Request processed in 28us (6969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367868.321299:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787367868.321488:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808482688:0@lo:400:kworker.0 00010000:00080000:3.0:1787367868.321502:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f0000 x1874190808483200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367868.321511:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808483200:0@lo:400:kworker.0 00010000:00080000:3.0:1787367868.321522:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0ad80 x1874190808483712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367868.321530:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808483712:0@lo:400:kworker.0 00010000:00080000:3.0:1787367868.321561:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f2680 x1874190808483328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367868.321568:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808483328:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.321588:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808482304 00000100:00100000:3.0:1787367868.321593:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808482304 00000100:00100000:3.0:1787367868.321645:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787367868.321651:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808482304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.321688:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808482304:12345-0@lo:400:kworker.0 Request processed in 37us (8431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367868.321694:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787367868.321722:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808482816 00000100:00100000:3.0:1787367868.321726:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808482816 00000100:00100000:3.0:1787367868.321747:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808483968 00000100:00100000:3.0:1787367868.321756:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808483968 00000100:00100000:3.0:1787367868.321773:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787367868.321779:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808482816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.321811:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808482816:12345-0@lo:400:kworker.0 Request processed in 32us (8499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367868.321818:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787367868.321828:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787367868.321833:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808483968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367868.321852:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367868.321883:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808483968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (7535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367868.321889:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787367868.321908:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808483840 00000100:00100000:3.0:1787367868.321912:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808483840 00000100:00100000:3.0:1787367868.321942:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787367868.321949:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808483840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.321989:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808483840:12345-0@lo:400:kworker.0 Request processed in 40us (8558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367868.321995:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787367868.322039:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808482304:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.322050:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808482816:0@lo:400:kworker.0 00010000:00080000:3.0:1787367868.322061:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c09180 x1874190808483840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367868.322069:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808483840:0@lo:400:kworker.0 00000100:00080000:3.0:1787367868.323338:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367868.323380:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367868.323382:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367868.326725:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367868.326845:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808483072:0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.326903:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367868.326931:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808483584:0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.326953:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367868.327011:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808482432:0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.327025:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808482944:0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.327035:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808483456:0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.327056:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808483968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367868.327096:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808483072 00000100:00100000:2.0:1787367868.327102:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808483072 00000100:00100000:2.0:1787367868.327149:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808483584 00000100:00100000:2.0:1787367868.327152:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808483584 00000100:00100000:2.0:1787367868.327171:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787367868.327179:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808483072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.327226:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808483072:12345-0@lo:400:kworker.0 Request processed in 46us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367868.327233:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787367868.327248:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787367868.327254:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808483584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367868.327282:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808483584:12345-0@lo:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367868.327311:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:2.0:1787367868.327329:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787367868.327348:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc2a00 x1874190808483072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367868.327395:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808483072:0@lo:400:kworker.0 00010000:00080000:2.0:1787367868.327417:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c0bb80 x1874190808483584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367868.327425:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808483584:0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.331175:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808482560 00000100:00100000:3.0:1787367868.331186:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808482560 00000100:00100000:3.0:1787367868.331244:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787367868.331255:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808482560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367868.331387:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808482560:12345-0@lo:400:kworker.0 Request processed in 134us (4667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367868.331394:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787367868.331499:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808482560:0@lo:400:kworker.0 00000020:00000080:2.0:1787367868.696407:0:13202:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff27bcd000 20000000:00000080:2.0:1787367868.696424:0:13202:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c55afa41400 uarg=0000000000000000 20000000:01000000:2.0:1787367868.696463:0:13202:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787367868.696469:0:13202:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787367868.696474:0:13202:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787367868.697054:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787367868.697255:0:13202:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787367868.705265:0:13202:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787367868.705315:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705339:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5df expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705348:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030787 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705699:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030795 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705717:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0307a3 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705724:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0307b1 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705732:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e61e expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705740:0:13202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705787:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e61e expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705804:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e61e expref: 12 pid: 6532 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367868.705819:0:13202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484096:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367868.705942:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0307b1 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.705951:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0307b1 expref: 23 pid: 6530 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367868.706033:0:13202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484224:0@lo:104: 00000100:00100000:2.0:1787367868.706070:0:13202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367868.706100:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0307a3 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.706114:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0307a3 expref: 23 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367868.706123:0:13202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484352:0@lo:104: 00000100:00100000:2.0:1787367868.706146:0:13202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367868.706187:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030795 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.706195:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030795 expref: 23 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367868.706202:0:13202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484480:0@lo:104: 00000100:00100000:2.0:1787367868.706225:0:13202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367868.706244:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030787 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.706251:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030787 expref: 23 pid: 6532 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367868.706259:0:13202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484608:0@lo:104: 00000100:00100000:2.0:1787367868.706279:0:13202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367868.706320:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5df expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.706329:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5df expref: 12 pid: 6533 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367868.706338:0:13202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484736:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367868.706446:0:13202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367868.706515:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808484224 00000100:00100000:1.0:1787367868.706522:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808484224 00000100:00100000:1.0:1787367868.706559:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808484352 00000100:00100000:1.0:1787367868.706562:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808484352 00000100:00100000:1.0:1787367868.706570:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808484480 00000100:00100000:1.0:1787367868.706572:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808484480 00000100:00100000:1.0:1787367868.706579:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808484608 00000100:00100000:1.0:1787367868.706582:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808484608 00000100:00100000:1.0:1787367868.706594:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787367868.706602:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:13202:x1874190808484224:12345-0@lo:104: 00010000:00010000:1.0:1787367868.706614:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.706673:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367868.706679:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:13202:x1874190808484224:12345-0@lo:104: Request processed in 78us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.706685:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787367868.706702:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787367868.706708:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:13202:x1874190808484352:12345-0@lo:104: 00010000:00010000:1.0:1787367868.706716:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.706749:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787367868.706755:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:13202:x1874190808484352:12345-0@lo:104: Request processed in 47us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.706760:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787367868.706772:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787367868.706777:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:13202:x1874190808484480:12345-0@lo:104: 00010000:00010000:1.0:1787367868.706792:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.706825:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787367868.706830:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:13202:x1874190808484480:12345-0@lo:104: Request processed in 54us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.706837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787367868.706849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787367868.706855:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:13202:x1874190808484608:12345-0@lo:104: 00010000:00010000:1.0:1787367868.706862:0:6522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.706886:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787367868.706890:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:13202:x1874190808484608:12345-0@lo:104: Request processed in 37us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.706895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787367868.706910:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787367868.706915:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.706922:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175c00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787367868.706925:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.706933:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367868.706939:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367868.706952:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787367868.707051:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707058:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367868.707078:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707084:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2175c00/0x66f5679bff0307b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0307b8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707098:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787367868.707101:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707106:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787367868.707108:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707114:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367868.707120:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367868.707125:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787367868.707137:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707143:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367868.707164:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707171:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2175600/0x66f5679bff0307a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0307aa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707180:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787367868.707184:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707189:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0a00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787367868.707192:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707198:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367868.707203:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367868.707208:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787367868.707220:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707226:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367868.707231:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707238:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a0a00/0x66f5679bff030795 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03079c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707247:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367868.707257:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707262:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787367868.707265:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707272:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367868.707278:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367868.707293:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787367868.707308:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707313:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367868.707319:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707327:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030787 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03078e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707341:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367868.707343:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367868.707344:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367868.707350:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367868.707382:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367868.707395:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808484864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367868.707428:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367868.707458:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367868.707464:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808485248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367868.707485:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367868.707511:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808484992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367868.707531:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367868.707549:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367868.707554:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808485120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367868.707573:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367868.707601:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808484864 00000100:00100000:1.0:1787367868.707605:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808484864 00010000:00010000:1.0:1787367868.707625:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0307b1 expref: 24 pid: 6530 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367868.707641:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808485248 00000100:00100000:1.0:1787367868.707644:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808485248 00010000:00010000:1.0:1787367868.707654:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030787 expref: 25 pid: 6532 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367868.707664:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808484992 00000100:00100000:1.0:1787367868.707667:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808484992 00010000:00010000:1.0:1787367868.707677:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0307a3 expref: 26 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367868.707687:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808485120 00000100:00100000:1.0:1787367868.707690:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808485120 00010000:00010000:1.0:1787367868.707699:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030795 expref: 27 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367868.707710:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787367868.707717:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+27:3652:x1874190808484864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367868.707736:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367868.707742:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0307b1 expref: 27 pid: 6530 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707752:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0307b1 expref: 27 pid: 6530 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707769:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367868.707800:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+27:3652:x1874190808484864:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.707806:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787367868.707821:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787367868.707826:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+26:3652:x1874190808485248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367868.707833:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367868.707837:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030787 expref: 26 pid: 6532 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707845:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030787 expref: 26 pid: 6532 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707854:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367868.707873:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+26:3652:x1874190808485248:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.707879:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787367868.707891:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787367868.707897:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3653:x1874190808484992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367868.707904:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367868.707908:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0307a3 expref: 25 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707922:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0307a3 expref: 25 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.707931:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367868.708099:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0307b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0307b1 expref: 25 pid: 6530 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367868.708111:0:13202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484224:0@lo:104: 00010000:00010000:2.0:1787367868.708121:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2175a00/0x66f5679bff0307aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0307a3 expref: 24 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367868.708129:0:13202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484352:0@lo:104: 00000100:00100000:2.0:1787367868.708136:0:13202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484480:0@lo:104: 00010000:00010000:2.0:1787367868.708143:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55814a1600/0x66f5679bff03078e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030787 expref: 23 pid: 6532 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367868.708152:0:13202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484608:0@lo:104: 00000100:00100000:1.0:1787367868.708318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3653:x1874190808484992:12345-0@lo:103:ldlm_bl.0 Request processed in 420us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.708325:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787367868.708339:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787367868.708345:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3653:x1874190808485120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367868.708512:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367868.708518:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030795 expref: 21 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.708527:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030795 expref: 21 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.708537:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2174c00/0x66f5679bff03079c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030795 expref: 21 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.708547:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367868.708572:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:3653:x1874190808485120:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.708578:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787367868.708604:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808485120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367868.708613:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808484992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367868.708638:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808485248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367868.708655:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808484864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787367868.709871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367868.710203:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788479104 00000100:00100000:1.0:1787367868.710212:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788479104 00010000:00010000:1.0:1787367868.710243:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e61e expref: 13 pid: 6532 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367868.710279:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1787367868.710298:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788479104:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367868.710310:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367868.710315:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e61e expref: 13 pid: 6532 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.710327:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e61e expref: 13 pid: 6532 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.710377:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367868.710421:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788479104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 135us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.710440:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00010000:00010000:0.0:1787367868.711136:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672400/0x66f5679bff0307cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e61e expref: 12 pid: 6532 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367868.711152:0:13202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484096:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367868.716215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367868.720733:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788479232 00000100:00100000:1.0:1787367868.720749:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788479232 00010000:00010000:1.0:1787367868.720796:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5df expref: 12 pid: 6533 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367868.720837:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1787367868.720847:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:926ebb72-6750-4035-807e-0762300bea95+12:2403:x1874190788479232:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367868.720867:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367868.720885:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5df expref: 12 pid: 6533 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.720898:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5df expref: 12 pid: 6533 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.720920:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.720927:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.720943:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.720949:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.720969:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.720975:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.720982:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83a00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787367868.720986:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.720993:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.721002:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367868.721018:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367868.721073:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:926ebb72-6750-4035-807e-0762300bea95+12:2403:x1874190788479232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 227us (4868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.721081:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00010000:00010000:0.0:1787367868.726165:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673000/0x66f5679bff030780 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5df expref: 11 pid: 6533 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367868.726189:0:13202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1874190808484736:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367868.726233:0:13202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367868.726265:0:13202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367868.726273:0:13202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367868.726279:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55afa83a00/0x66f5679bff0307f0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367868.761040:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367868.826717:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367868.826738:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808485376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367868.826805:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367868.826871:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808485376 00000100:00100000:1.0:1787367868.826879:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808485376 00000100:00100000:1.0:1787367868.826932:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787367868.826941:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808485376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367868.826981:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367868.827023:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808485376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.827031:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1787367868.827069:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd689c00 x1874190808485376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367868.827086:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808485376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367868.831319:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808485504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367868.831415:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367868.831487:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808485504 00000100:00100000:1.0:1787367868.831494:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808485504 00000100:00100000:1.0:1787367868.831542:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787367868.831551:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808485504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367868.831596:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367868.831650:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808485504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367868.831658:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1787367868.831768:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd689c00 x1874190808485504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367868.831786:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808485504:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1787367868.832708:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 376539eb-750a-402c-b2b9-1c135ada549f 00000020:00000080:1.0:1787367868.832714:0:9534:0:(genops.c:885:class_export_put()) final put ffff9c5482778800/376539eb-750a-402c-b2b9-1c135ada549f 00000020:00000080:1.0:1787367868.832738:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5482778800/376539eb-750a-402c-b2b9-1c135ada549f for lustre-OST0001 00000020:00000080:1.0:1787367868.832776:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548277d000 for lustre-OST0001 00000100:00100000:0.0:1787367868.841303:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367868.841331:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808485632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367868.841423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367868.841754:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808485632 00000100:00100000:2.0:1787367868.841762:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808485632 00000100:00100000:2.0:1787367868.841809:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787367868.841819:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808485632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367868.841839:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367868.841885:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808485632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367868.841893:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1787367868.841928:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa75f80 x1874190808485632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367868.841959:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808485632:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787367868.845259:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 376539eb-750a-402c-b2b9-1c135ada549f 00000020:00000080:3.0:1787367868.845268:0:8447:0:(genops.c:885:class_export_put()) final put ffff9c5598409800/376539eb-750a-402c-b2b9-1c135ada549f 00000020:00000080:0.0:1787367868.845379:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5598409800/376539eb-750a-402c-b2b9-1c135ada549f for lustre-OST0000 00000020:00000080:0.0:1787367868.845440:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548335c000 for lustre-OST0000 00000100:00100000:2.0:1787367869.336645:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367869.336673:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808485760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367869.336742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367869.336825:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808485760 00000100:00100000:2.0:1787367869.336833:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808485760 00000100:00100000:2.0:1787367869.336883:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787367869.336892:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808485760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367869.336914:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367869.336958:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808485760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367869.336965:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1787367869.337004:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa75f80 x1874190808485760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367869.337023:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808485760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787367869.784588:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367870.069529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367870.070137:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788479360 00000100:00100000:0.0:1787367870.070147:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788479360 00000100:00100000:0.0:1787367870.070195:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 313 00000100:00100000:0.0:1787367870.070205:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+11:6186:x1874190788479360:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367870.070222:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367870.070242:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e64f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367870.070269:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e64f expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367870.070290:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e64f expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367870.070299:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613aa00, rc 0) 00000100:00100000:0.0:1787367870.070391:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788479360:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 187us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367870.070398:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 313 00000100:00100000:0.0:1787367870.083171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367870.083267:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788479488 00000100:00100000:3.0:1787367870.083286:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788479488 00000100:00100000:3.0:1787367870.083344:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 314 00000100:00100000:3.0:1787367870.083384:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788479488:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367870.083529:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788479488:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 175us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367870.083536:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 314 00000100:00100000:3.0:1787367870.085985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367870.086054:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788479616 00000100:00100000:0.0:1787367870.086062:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788479616 00000100:00100000:0.0:1787367870.086106:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 315 00000100:00100000:0.0:1787367870.086115:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788479616:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367870.086221:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788479616:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367870.086234:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 315 00000100:00100000:3.0:1787367870.090849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367870.090933:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788479744 00000100:00100000:2.0:1787367870.090942:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788479744 00000100:00100000:2.0:1787367870.091001:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 316 00000100:00100000:2.0:1787367870.091011:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788479744:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367870.091029:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367870.091047:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e656 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.091077:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e656 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.091103:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e656 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.091113:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa83200, rc 0) 00000100:00100000:2.0:1787367870.091176:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788479744:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 166us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367870.091184:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 316 00000100:00100000:0.0:1787367870.108088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367870.108566:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788479872 00000100:00100000:3.0:1787367870.108575:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788479872 00000100:00100000:3.0:1787367870.108626:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 317 00000100:00100000:3.0:1787367870.108636:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788479872:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367870.108784:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788479872:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 149us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367870.108792:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 317 00000100:00100000:1.0:1787367870.113393:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367870.113474:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788480000 00000100:00100000:3.0:1787367870.113484:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788480000 00000100:00100000:3.0:1787367870.113531:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 318 00000100:00100000:3.0:1787367870.113539:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788480000:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367870.113689:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788480000:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 149us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367870.113696:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 318 00000100:00100000:2.0:1787367870.362613:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808485888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787367870.362686:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367870.363652:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808485888 00000100:00100000:3.0:1787367870.363664:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808485888 00000100:00100000:3.0:1787367870.363724:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787367870.363735:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808485888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367870.363770:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367870.363831:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808485888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367870.363839:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787367870.363938:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808485888:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1787367870.494722:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367870.494730:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bc4cb000 from 7 10000000:01000000:3.0:1787367870.494735:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367870.494777:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367870.494789:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367870.494800:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367870.494825:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367870.494906:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367870.496393:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367870.497703:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808486016 00000100:00100000:0.0:1787367870.497716:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808486016 00000100:00100000:0.0:1787367870.497851:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787367870.497862:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808486016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367870.497880:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367870.497899:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030805 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367870.497926:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030805 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367870.497938:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030805 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367870.497947:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a200, rc 0) 00000100:00100000:0.0:1787367870.498029:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808486016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (3122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367870.498037:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787367870.498123:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367870.498141:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.498151:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367870.498219:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.498252:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367870.502618:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367870.504602:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808486144 00000100:00100000:3.0:1787367870.504615:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808486144 00000100:00100000:3.0:1787367870.504676:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787367870.504685:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808486144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367870.504943:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808486144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (6688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367870.504951:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787367870.506586:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.506645:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.506703:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367870.506754:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367870.507526:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808486272 00000100:00100000:0.0:1787367870.507534:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808486272 00000100:00100000:0.0:1787367870.507592:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787367870.507602:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808486272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367870.507726:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808486272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367870.507734:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787367870.507888:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787367870.511054:0:13259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787367870.511398:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787367870.511489:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787367870.511501:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.511513:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367870.511523:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787367870.511526:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bd606800 from 7 10000000:01000000:1.0:1787367870.511528:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787367870.511566:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.511574:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.511584:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367870.511609:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.511674:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367870.511713:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367870.512005:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808486400 00000100:00100000:0.0:1787367870.512013:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808486400 00000100:00100000:0.0:1787367870.512067:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787367870.512077:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808486400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367870.512091:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367870.512104:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030813 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367870.512127:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030813 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367870.512137:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030813 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367870.512145:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b000, rc 0) 00000100:00100000:0.0:1787367870.512186:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808486400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367870.512192:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787367870.512346:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367870.512386:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.512395:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367870.512573:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.512600:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367870.512619:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367870.512687:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808486528 00000100:00100000:2.0:1787367870.512691:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808486528 00000100:00100000:2.0:1787367870.512726:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787367870.512733:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808486528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367870.512835:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808486528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367870.512842:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787367870.512974:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.513000:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.513040:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367870.513309:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367870.514382:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808486656 00000100:00100000:2.0:1787367870.514391:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808486656 00000100:00100000:2.0:1787367870.514545:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787367870.514556:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808486656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367870.514681:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808486656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367870.514689:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787367870.514849:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787367870.516867:0:13260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787367870.517060:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787367870.517081:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367870.517092:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.517105:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367870.517116:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787367870.517118:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bc6be800 from 7 10000000:01000000:2.0:1787367870.517120:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787367870.517156:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.517164:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.517175:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367870.517198:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367870.517256:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367870.517305:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367870.517603:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808486784 00000100:00100000:1.0:1787367870.517612:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808486784 00000100:00100000:1.0:1787367870.517660:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787367870.517670:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808486784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367870.517683:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367870.517695:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff030821 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.517716:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff030821 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.517727:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030821 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.517735:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673000, rc 0) 00000100:00100000:1.0:1787367870.517776:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808486784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367870.517797:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787367870.517841:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367870.517855:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.517864:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367870.517917:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.517944:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367870.517959:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c936c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367870.519541:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808486912 00000100:00100000:1.0:1787367870.519551:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808486912 00000100:00100000:1.0:1787367870.519598:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787367870.519607:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808486912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.519743:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808486912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367870.519751:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787367870.519797:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808486912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.519835:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808487040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.519883:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367870.519903:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808487040 00000100:00100000:1.0:1787367870.519906:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808487040 00000100:00100000:1.0:1787367870.519933:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787367870.519939:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808487040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.520015:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808487040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367870.520021:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787367870.520060:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c936c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367870.520072:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808487040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787367870.521980:0:13261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787367870.522343:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787367870.522397:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367870.522409:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.522428:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367870.522455:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787367870.522457:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55834d5000 from 7 10000000:01000000:2.0:1787367870.522460:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787367870.522492:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.522500:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.522511:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367870.522533:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808487168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367870.522588:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367870.522625:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367870.525649:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808487168 00000100:00100000:1.0:1787367870.525663:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808487168 00000100:00100000:1.0:1787367870.525734:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787367870.525744:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808487168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367870.525759:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367870.525777:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03082f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.525803:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03082f expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.525815:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03082f expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367870.525823:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672400, rc 0) 00000100:00100000:1.0:1787367870.525893:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808487168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367870.525900:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787367870.527552:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808487168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367870.527578:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.527590:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367870.527672:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808487296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367870.527721:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367870.527761:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367870.527845:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808487296 00000100:00100000:1.0:1787367870.527851:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808487296 00000100:00100000:1.0:1787367870.527885:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787367870.527894:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808487296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.528013:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808487296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367870.528021:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787367870.529609:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808487296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367870.529664:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808487424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367870.529733:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367870.529771:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367870.529828:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808487424 00000100:00100000:1.0:1787367870.529834:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808487424 00000100:00100000:1.0:1787367870.529879:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787367870.529888:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808487424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367870.529990:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808487424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367870.529998:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787367870.532413:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808487424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787367870.533767:0:13262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787367870.534023:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787367870.534048:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367870.534059:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367870.534070:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367870.809558:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367871.833470:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367872.824004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367872.824050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367872.824081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367872.824100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367872.824125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367872.824154:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788480256 00000100:00100000:0.0:1787367872.824164:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788480256 00000100:00100000:0.0:1787367872.824211:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788480512 00000100:00100000:0.0:1787367872.824213:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788480512 00000100:00100000:0.0:1787367872.824235:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788480384 00000100:00100000:0.0:1787367872.824237:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788480384 00000100:00100000:0.0:1787367872.824247:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788480640 00000100:00100000:0.0:1787367872.824249:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788480640 00000100:00100000:0.0:1787367872.824276:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:0.0:1787367872.824285:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788480256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367872.824349:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788480256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 65us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367872.824375:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:0.0:1787367872.824391:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:0.0:1787367872.824397:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788480512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367872.824432:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788480512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367872.824438:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:0.0:1787367872.824449:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:0.0:1787367872.824455:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788480384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367872.824478:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788480384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367872.824484:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:0.0:1787367872.824495:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:0.0:1787367872.824501:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788480640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367872.824522:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788480640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367872.824528:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:0.0:1787367872.824547:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788480128 00000100:00100000:0.0:1787367872.824557:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788480128 00000100:00100000:0.0:1787367872.824600:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 331 00000100:00100000:0.0:1787367872.824607:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788480128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367872.824632:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788480128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367872.824638:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 331 00000100:00080000:0.0:1787367872.824667:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367872.824671:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787367872.858915:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787367872.865323:0:13401:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787367873.434650:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808487808:0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.434676:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808487680:0@lo:400:kworker.0 00000100:00100000:2.0:1787367873.434814:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808487552:0@lo:400:kworker.0 00000100:00100000:0.0:1787367873.435128:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808487936:0@lo:400:kworker.0 00000100:00100000:3.0:1787367873.440202:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367873.440287:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808488320:0@lo:400:kworker.0 00000100:00100000:3.0:1787367873.440329:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367873.440349:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808488832:0@lo:400:kworker.0 00000100:00100000:3.0:1787367873.440388:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367873.440440:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808488320 00000100:00100000:1.0:1787367873.440450:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808488320 00000100:00100000:3.0:1787367873.440453:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808487808 00000100:00100000:3.0:1787367873.440459:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808487808 00000100:00100000:1.0:1787367873.440507:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808488832 00000100:00100000:1.0:1787367873.440512:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808488832 00000100:00100000:3.0:1787367873.440526:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787367873.440537:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808487808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.440542:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787367873.440553:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808488320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.440688:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808488320:12345-0@lo:400:kworker.0 Request processed in 137us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367873.440696:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787367873.440721:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787367873.440728:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808488832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.440758:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808488832:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367873.440765:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1787367873.440794:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787367873.440828:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f2680 x1874190808488320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367873.440840:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808488320:0@lo:400:kworker.0 00010000:00080000:1.0:1787367873.440866:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc2300 x1874190808488832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367873.440875:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808488832:0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.440919:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367873.440942:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808488192:0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.440966:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367873.440999:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808488704:0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.441300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367873.441338:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808489216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367873.441389:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367873.441428:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808487680 00000100:00100000:1.0:1787367873.441432:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808487680 00000100:00100000:1.0:1787367873.441456:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808488192 00000100:00100000:1.0:1787367873.441458:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808488192 00000100:00100000:1.0:1787367873.441475:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808488704 00000100:00100000:1.0:1787367873.441477:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808488704 00000100:00100000:1.0:1787367873.441491:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787367873.441496:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808487680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.441536:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808487680:12345-0@lo:400:kworker.0 Request processed in 40us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367873.441542:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787367873.441553:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787367873.441566:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808488192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.441610:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808488192:12345-0@lo:400:kworker.0 Request processed in 45us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367873.441616:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787367873.441627:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787367873.441633:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808488704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.441659:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808488704:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367873.441664:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1787367873.441682:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367873.441706:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808487680:0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.441716:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808488192:0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.441725:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808488704:0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.441760:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808489216 00000100:00100000:1.0:1787367873.441763:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808489216 00000100:00100000:1.0:1787367873.441782:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787367873.441788:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808489216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787367873.441812:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787367873.441946:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808489216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367873.441953:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787367873.441982:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808489216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367873.443030:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808487808:12345-0@lo:400:kworker.0 Request processed in 2491us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367873.443041:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787367873.443245:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808487808:0@lo:400:kworker.0 00000100:00100000:2.0:1787367873.448740:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367873.448801:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808488064:0@lo:400:kworker.0 00000100:00100000:2.0:1787367873.448843:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367873.448872:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808488576:0@lo:400:kworker.0 00000100:00100000:2.0:1787367873.448896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367873.448916:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808489088:0@lo:400:kworker.0 00000100:00100000:2.0:1787367873.448936:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367873.448978:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808488576 00000100:00100000:2.0:1787367873.448986:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808488576 00000100:00100000:2.0:1787367873.449032:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808489088 00000100:00100000:2.0:1787367873.449036:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808489088 00000100:00100000:2.0:1787367873.449056:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787367873.449065:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808488576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367873.449113:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808488576:12345-0@lo:400:kworker.0 Request processed in 49us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367873.449133:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787367873.449149:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787367873.449155:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808489088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367873.449182:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808489088:12345-0@lo:400:kworker.0 Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367873.449188:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787367873.449207:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367873.449211:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787367873.449233:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc2d80 x1874190808488576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367873.449261:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808488576:0@lo:400:kworker.0 00010000:00080000:2.0:1787367873.449273:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc0380 x1874190808489088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367873.449281:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808489088:0@lo:400:kworker.0 00000100:00100000:3.0:1787367873.449535:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808488064 00000100:00100000:3.0:1787367873.449540:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808488064 00000100:00100000:3.0:1787367873.449576:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787367873.449601:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808488064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367873.449640:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808488064:12345-0@lo:400:kworker.0 Request processed in 42us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367873.449647:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787367873.449987:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808487552 00000100:00100000:1.0:1787367873.449998:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808487552 00000100:00100000:1.0:1787367873.450035:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787367873.450042:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808487552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.450077:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808487552:12345-0@lo:400:kworker.0 Request processed in 36us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367873.450083:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787367873.450268:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808487552:0@lo:400:kworker.0 00000100:00100000:2.0:1787367873.450282:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808488064:0@lo:400:kworker.0 00000100:00100000:0.0:1787367873.451167:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367873.451200:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808488448:0@lo:400:kworker.0 00000100:00100000:0.0:1787367873.451232:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367873.451271:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808488960:0@lo:400:kworker.0 00000100:00100000:0.0:1787367873.451297:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367873.451553:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808488448 00000100:00100000:3.0:1787367873.451559:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808488448 00000100:00100000:3.0:1787367873.451611:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808488960 00000100:00100000:3.0:1787367873.451614:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808488960 00000100:00100000:3.0:1787367873.451636:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787367873.451644:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808488448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367873.451700:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808488448:12345-0@lo:400:kworker.0 Request processed in 57us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367873.451708:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787367873.451721:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787367873.451727:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b62f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808488960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367873.451752:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b62f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808488960:12345-0@lo:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367873.451758:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1787367873.452543:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367873.452549:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367873.452779:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808487936 00000100:00100000:1.0:1787367873.452784:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808487936 00000100:00100000:1.0:1787367873.452868:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787367873.452876:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808487936:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787367873.452918:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f0000 x1874190808488448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367873.452930:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808487936:12345-0@lo:400:kworker.0 Request processed in 56us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367873.452932:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808488448:0@lo:400:kworker.0 00000100:00100000:1.0:1787367873.452936:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:0.0:1787367873.452943:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc0a80 x1874190808488960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367873.452950:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808488960:0@lo:400:kworker.0 00000100:00100000:0.0:1787367873.452978:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808487936:0@lo:400:kworker.0 00010000:00010000:3.0:1787367873.880845:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367873.945343:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367873.945385:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808489600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367873.945467:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367873.945583:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808489600 00000100:00100000:2.0:1787367873.945592:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808489600 00000100:00100000:2.0:1787367873.945653:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787367873.945673:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808489344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367873.945849:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808489600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787367873.945879:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367873.945906:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367873.945936:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367873.945942:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808489600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 278us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367873.945947:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808489472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367873.945962:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787367873.945978:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808489344 00000100:00100000:2.0:1787367873.945981:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808489344 00000100:00100000:0.0:1787367873.945992:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367873.946012:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808489472 00000100:00100000:2.0:1787367873.946016:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808489472 00000100:00100000:2.0:1787367873.946032:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787367873.946040:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808489344:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787367873.946055:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa75180 x1874190808489600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1787367873.946056:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367873.946078:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808489600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367873.946098:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808489344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367873.946106:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1787367873.946116:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd689500 x1874190808489344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367873.946123:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787367873.946135:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808489472:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367873.946138:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808489344:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787367873.946148:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367873.946178:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808489472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367873.946185:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1787367873.946897:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd688700 x1874190808489472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367873.946915:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808489472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367874.462544:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808489728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367874.462615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367874.462677:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808489728 00000100:00100000:0.0:1787367874.462685:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808489728 00000100:00100000:0.0:1787367874.462732:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787367874.462741:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808489728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367874.462761:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367874.462815:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808489728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367874.462823:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1787367874.462836:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc690000 x1874190808489728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367874.462855:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808489728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367874.914529:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367875.482525:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367875.482548:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808489856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787367875.482626:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367875.482684:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808489856 00000100:00100000:3.0:1787367875.482691:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808489856 00000100:00100000:3.0:1787367875.482733:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787367875.482741:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808489856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367875.482773:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367875.482880:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808489856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367875.482887:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787367875.483221:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808489856:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787367875.929232:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367876.955973:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367877.947956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367877.948007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367877.948047:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367877.948099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367877.948122:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367877.948263:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788481024 00000100:00100000:2.0:1787367877.948273:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788481024 00000100:00100000:2.0:1787367877.948332:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788481280 00000100:00100000:2.0:1787367877.948336:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788481280 00000100:00100000:2.0:1787367877.948347:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788480896 00000100:00100000:2.0:1787367877.948349:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788480896 00000100:00100000:2.0:1787367877.948408:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788481152 00000100:00100000:2.0:1787367877.948411:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788481152 00000100:00100000:2.0:1787367877.948427:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:2.0:1787367877.948437:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788481024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367877.948516:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788481024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367877.948524:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:2.0:1787367877.948541:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 200 00000100:00100000:2.0:1787367877.948548:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788481280:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367877.948573:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788481280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367877.948579:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 200 00000100:00100000:2.0:1787367877.948590:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:2.0:1787367877.948597:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788480896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367877.948634:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788480896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367877.948641:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:2.0:1787367877.948653:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:2.0:1787367877.948658:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788481152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367877.948680:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788481152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367877.948686:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00080000:0.0:1787367877.949057:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367877.949062:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787367877.949278:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788480768 00000100:00100000:1.0:1787367877.949284:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788480768 00000100:00100000:1.0:1787367877.949330:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 333 00000100:00100000:1.0:1787367877.949338:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788480768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367877.949420:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788480768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367877.949427:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 333 00010000:00010000:2.0:1787367877.979148:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367878.552740:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808489984:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.552807:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.552851:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808490496:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.552878:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.552897:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808491008:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.552919:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.552936:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808491520:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.552956:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.552976:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787367878.552981:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808490368:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553001:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.553015:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808490880:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553032:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.553046:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808491392:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553062:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.553086:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808490112:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553106:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.553121:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808490624:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553141:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.553156:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808491136:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553189:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.553239:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787367878.553244:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808490240:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553266:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.553282:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808490752:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553302:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.553311:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808491264:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367878.553618:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808489984 00000100:00100000:0.0:1787367878.553624:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808489984 00000100:00100000:0.0:1787367878.553801:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787367878.553812:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808489984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553862:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808489984:12345-0@lo:400:kworker.0 Request processed in 53us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.553869:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787367878.553899:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808490496 00000100:00100000:0.0:1787367878.553903:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808490496 00000100:00100000:0.0:1787367878.553926:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808490240 00000100:00100000:0.0:1787367878.553928:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808490240 00000100:00100000:0.0:1787367878.553941:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787367878.553947:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808490496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.553979:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808490496:12345-0@lo:400:kworker.0 Request processed in 32us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.553985:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787367878.553999:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787367878.554004:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808490240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.554033:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808490240:12345-0@lo:400:kworker.0 Request processed in 29us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.554048:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787367878.554107:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808491008 00000100:00100000:0.0:1787367878.554111:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808491008 00000100:00100000:0.0:1787367878.554139:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808491520 00000100:00100000:0.0:1787367878.554142:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808491520 00000100:00100000:0.0:1787367878.554152:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808490880 00000100:00100000:0.0:1787367878.554154:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808490880 00000100:00100000:0.0:1787367878.554762:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808491392 00000100:00100000:0.0:1787367878.554767:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808491392 00000100:00100000:0.0:1787367878.554782:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787367878.554789:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808491008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.554830:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808491008:12345-0@lo:400:kworker.0 Request processed in 42us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.554836:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787367878.554847:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787367878.554853:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808491520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.554879:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808491520:12345-0@lo:400:kworker.0 Request processed in 27us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.554884:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787367878.554895:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787367878.554900:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808490880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.554927:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808490880:12345-0@lo:400:kworker.0 Request processed in 27us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.554932:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787367878.554941:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787367878.554947:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808491392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.554983:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808491392:12345-0@lo:400:kworker.0 Request processed in 37us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.554990:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787367878.555014:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808490368 00000100:00100000:0.0:1787367878.555018:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808490368 00000100:00100000:0.0:1787367878.555036:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808490112 00000100:00100000:0.0:1787367878.555038:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808490112 00000100:00100000:0.0:1787367878.555048:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808490624 00000100:00100000:0.0:1787367878.555050:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808490624 00000100:00100000:0.0:1787367878.555061:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808491136 00000100:00100000:0.0:1787367878.555064:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808491136 00000100:00100000:0.0:1787367878.555075:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808490752 00000100:00100000:0.0:1787367878.555077:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808490752 00000100:00100000:0.0:1787367878.555087:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808491264 00000100:00100000:0.0:1787367878.555090:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808491264 00000100:00100000:0.0:1787367878.555104:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787367878.555110:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808490368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.555139:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808490368:12345-0@lo:400:kworker.0 Request processed in 29us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.555145:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787367878.555155:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787367878.558937:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808490112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.559030:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808490112:12345-0@lo:400:kworker.0 Request processed in 3869us (5922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.559040:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787367878.559071:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787367878.559078:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808490624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.559106:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808490624:12345-0@lo:400:kworker.0 Request processed in 29us (5964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.559120:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787367878.559133:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787367878.559140:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808491136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.559182:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808491136:12345-0@lo:400:kworker.0 Request processed in 43us (5993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.559188:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787367878.560492:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367878.560510:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808491648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367878.560559:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367878.560614:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808491648 00000100:00100000:3.0:1787367878.560621:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808491648 00000100:00100000:3.0:1787367878.560656:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787367878.560664:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808491648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367878.560692:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367878.560730:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808491648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367878.560737:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787367878.560777:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808491648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367878.560898:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787367878.560907:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808490752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.560946:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808490752:12345-0@lo:400:kworker.0 Request processed in 41us (7643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.560953:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787367878.560978:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787367878.560984:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808491264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.561013:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808491264:12345-0@lo:400:kworker.0 Request processed in 29us (7683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367878.561019:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1787367878.561065:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367878.561070:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367878.561073:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367878.561076:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367878.561107:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808490240:0@lo:400:kworker.0 00010000:00080000:0.0:1787367878.561120:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afada680 x1874190808490752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367878.561131:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808490752:0@lo:400:kworker.0 00010000:00080000:0.0:1787367878.562290:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62d880 x1874190808491264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367878.562311:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808491264:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.562334:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808490112:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.562346:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808490624:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.562512:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808491136:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.562561:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808490368:0@lo:400:kworker.0 00010000:00080000:0.0:1787367878.562573:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62f480 x1874190808490880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367878.562582:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808490880:0@lo:400:kworker.0 00010000:00080000:0.0:1787367878.562593:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62dc00 x1874190808491392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367878.562601:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808491392:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.562641:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808489984:0@lo:400:kworker.0 00000100:00100000:0.0:1787367878.562935:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808490496:0@lo:400:kworker.0 00010000:00080000:0.0:1787367878.562966:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62c700 x1874190808491008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367878.562975:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808491008:0@lo:400:kworker.0 00010000:00080000:0.0:1787367878.562987:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62f100 x1874190808491520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367878.563041:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808491520:0@lo:400:kworker.0 00000001:02000400:1.0:1787367878.988284:0:13550:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:04:37 (1787367877) === 00010000:00010000:1.0:1787367879.012548:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367879.065550:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367879.065571:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808491776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367879.065638:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367879.065698:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808491776 00000100:00100000:1.0:1787367879.065705:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808491776 00000100:00100000:1.0:1787367879.065751:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787367879.065761:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808491776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367879.065789:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367879.065833:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808491776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367879.065840:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1787367879.065878:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd688700 x1874190808491776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367879.065896:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808491776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367879.066007:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367879.066016:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808491904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367879.066044:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367879.066067:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808491904 00000100:00100000:3.0:1787367879.066071:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808491904 00000100:00100000:3.0:1787367879.066093:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787367879.066099:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808491904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787367879.066109:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367879.066136:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808491904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367879.066152:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1787367879.066181:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd626680 x1874190808491904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367879.066193:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808491904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367879.066256:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808492032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787367879.066281:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367879.066304:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808492032 00000100:00100000:3.0:1787367879.066308:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808492032 00000100:00100000:3.0:1787367879.066327:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787367879.066332:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808492032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787367879.066347:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367879.066408:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808492032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367879.066414:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1787367879.066438:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd626680 x1874190808492032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367879.066449:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808492032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367879.240616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367879.240667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367879.240731:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788481408 00000100:00100000:2.0:1787367879.240739:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788481408 00000100:00100000:2.0:1787367879.240810:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1787367879.240821:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788481408:12345-192.168.203.4@tcp:41:mkdir.0 00000004:00000024:2.0:1787367879.240856:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787367879.240950:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788481408:12345-192.168.203.4@tcp:41:mkdir.0 Request processed in 131us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367879.240958:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00080000:0.0:1787367879.241206:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367879.241606:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788481536 00000100:00100000:3.0:1787367879.241614:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788481536 00000100:00100000:3.0:1787367879.241666:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1787367879.241675:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:6033427c-dc64-421a-b37f-d4458dbaa527+6:10519:x1874190788481536:12345-192.168.203.4@tcp:700:mkdir.0 00000100:00100000:3.0:1787367879.241726:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:6033427c-dc64-421a-b37f-d4458dbaa527+6:10519:x1874190788481536:12345-192.168.203.4@tcp:700:mkdir.0 Request processed in 52us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367879.241733:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:0.0:1787367879.245589:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.245716:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788481792 00000100:00100000:1.0:1787367879.245724:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788481792 00000100:00100000:1.0:1787367879.245772:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1787367879.245781:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:10519:x1874190788481792:12345-192.168.203.4@tcp:36:mkdir.0 00010000:00010000:1.0:1787367879.245830:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367879.245871:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0306df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5ca expref: 6 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.245902:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787367879.245912:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367879.245987:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.245999:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246008:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246032:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246039:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246045:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246805:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246816:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246824:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367879.246836:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009709f294 reply state 00000000ca27af9f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246856:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246862:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c548221ba00) 00010000:00010000:1.0:1787367879.246865:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787367879.246868:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787367879.246872:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787367879.246879:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246885:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246892:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246897:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367879.246901:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246908:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246916:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c548221b900) 00010000:00010000:1.0:1787367879.246918:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367879.246921:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246926:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff03083d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367879.246947:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009709f294 reply state 00000000ca27af9f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246954:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.246960:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c548221bb00) 00010000:00010000:1.0:1787367879.246962:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787367879.246963:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787367879.247033:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:10519:x1874190788481792:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 1252us (1458us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787367879.247041:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:2.0:1787367879.256869:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367879.257156:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788481920 00000100:00100000:0.0:1787367879.257166:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788481920 00000100:00100000:0.0:1787367879.257288:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1787367879.257299:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:10520:x1874190788481920:12345-192.168.203.4@tcp:101:chmod.0 00010000:00010000:0.0:1787367879.257325:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367879.257401:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e65d expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.257467:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030859 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.257480:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.257491:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367879.257534:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787367879.257537:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367879.257572:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.257610:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e65d expref: 9 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.257647:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e65d expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.257656:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787367879.257659:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367879.257662:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a800, rc 0) 00000100:00100000:0.0:1787367879.257712:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:10520:x1874190788481920:12345-192.168.203.4@tcp:101:chmod.0 Request processed in 415us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367879.257719:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:2.0:1787367879.259902:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.260093:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788482176 00000100:00100000:1.0:1787367879.260102:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788482176 00000100:00100000:1.0:1787367879.260157:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1787367879.260167:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:10520:x1874190788482176:12345-192.168.203.4@tcp:36:chmod.0 00010000:00010000:1.0:1787367879.260228:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367879.260257:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030859 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e65d expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.260288:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787367879.260300:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367879.260325:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.260338:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.260348:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367879.260854:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b58e1e99 reply state 0000000029f11c81 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.260868:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.260875:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c548221b900) 00010000:00010000:1.0:1787367879.260877:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787367879.260880:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787367879.260887:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787367879.261008:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+9:10520:x1874190788482176:12345-192.168.203.4@tcp:36:chmod.0 Request processed in 841us (1114us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787367879.261016:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1787367879.306869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.306966:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788482304 00000100:00100000:1.0:1787367879.306975:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788482304 00000100:00100000:1.0:1787367879.307022:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1787367879.307029:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+9:10521:x1874190788482304:12345-192.168.203.4@tcp:101:chown.0 00010000:00010000:1.0:1787367879.307048:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367879.307074:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030867 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e664 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.307126:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03086e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.307136:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03086e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.307145:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03086e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367879.307201:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787367879.307205:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367879.307252:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03086e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.307278:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030867 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e664 expref: 11 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.307299:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03086e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e664 expref: 10 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.307308:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c548221b900) 00010000:00010000:1.0:1787367879.307311:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367879.307314:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0a00, rc 0) 00000100:00100000:1.0:1787367879.307656:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+10:10521:x1874190788482304:12345-192.168.203.4@tcp:101:chown.0 Request processed in 625us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367879.307665:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1787367879.318612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367879.319508:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788482432 00000100:00100000:2.0:1787367879.319520:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788482432 00000100:00100000:2.0:1787367879.319595:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:2.0:1787367879.319606:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+10:10521:x1874190788482432:12345-192.168.203.4@tcp:101:chown.0 00010000:00010000:2.0:1787367879.319624:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367879.319869:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff030875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e66b expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.319930:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.319944:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.319956:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.319967:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.319974:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.319981:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320071:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff03088a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320080:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff03088a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320087:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff03088a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367879.320126:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787367879.320129:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367879.320148:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff03088a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320160:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320166:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320173:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320178:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367879.320182:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320190:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320201:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c548221b900) 00010000:00010000:2.0:1787367879.320219:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367879.320226:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320234:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff03087c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320248:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320255:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320261:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.320267:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367879.321489:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.321508:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.321522:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c548221bb00) 00010000:00010000:2.0:1787367879.321526:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367879.321531:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.321537:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030883 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.321596:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff030875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e66b expref: 12 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.321630:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff03088a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e66b expref: 11 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.321638:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c548221ba00) 00010000:00010000:2.0:1787367879.321641:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367879.321643:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82e00, rc 0) 00000100:00100000:2.0:1787367879.322506:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+11:10521:x1874190788482432:12345-192.168.203.4@tcp:101:chown.0 Request processed in 2898us (3901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367879.322519:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:2.0:1787367879.331876:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.332884:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788482560 00000100:00100000:1.0:1787367879.332895:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788482560 00000100:00100000:1.0:1787367879.332962:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1787367879.332973:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6033427c-dc64-421a-b37f-d4458dbaa527+11:10521:x1874190788482560:12345-192.168.203.4@tcp:900:chown.0 00000100:00100000:1.0:1787367879.333066:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6033427c-dc64-421a-b37f-d4458dbaa527+11:10521:x1874190788482560:12345-192.168.203.4@tcp:900:chown.0 Request processed in 95us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367879.333083:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1787367879.338331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.339026:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788482816 00000100:00100000:1.0:1787367879.339036:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788482816 00000100:00100000:1.0:1787367879.339596:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:1.0:1787367879.339622:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+11:10521:x1874190788482816:12345-192.168.203.4@tcp:36:chown.0 00010000:00010000:1.0:1787367879.339685:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367879.339713:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff03088a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e66b expref: 11 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.339732:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c548221ba00) 00010000:00010000:1.0:1787367879.339737:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367879.339761:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.339775:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.339785:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367879.344876:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1787367879.344989:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cf8a5cc reply state 00000000d2aff498 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.345011:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.345020:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c548221ba00) 00010000:00010000:1.0:1787367879.345023:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787367879.345027:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787367879.345039:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1787367879.345148:0:6540:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787367879.345173:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+9:10521:x1874190788482816:12345-192.168.203.4@tcp:36:chown.0 Request processed in 5550us (6848us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787367879.345181:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00010000:00010000:0.0:1787367879.345930:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.345940:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.345946:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.345952:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367879.345957:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.345965:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.345978:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c548221ba00) 00010000:00010000:0.0:1787367879.345981:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787367879.345991:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.345998:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030891 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346585:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346595:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346601:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346607:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367879.346610:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346617:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346627:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c548221bb00) 00010000:00010000:2.0:1787367879.346630:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367879.346640:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346647:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030844 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346665:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346671:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346677:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346682:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367879.346684:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346690:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346697:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c548221ba00) 00010000:00010000:2.0:1787367879.346699:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367879.346702:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346708:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff03084b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346721:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346727:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346741:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346746:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367879.346749:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346754:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346761:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c548221b900) 00010000:00010000:2.0:1787367879.346763:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367879.346766:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.346771:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030860 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367879.372087:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367879.372192:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788482944 00000100:00100000:0.0:1787367879.372201:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788482944 00000100:00100000:0.0:1787367879.372271:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1787367879.372281:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:10522:x1874190788482944:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:0.0:1787367879.372304:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367879.372325:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e672 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787367879.376168:0:6539:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3672us 00010000:00010000:0.0:1787367879.399289:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399312:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399323:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399337:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399344:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399351:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399500:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0308ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399508:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0308ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399515:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0308ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367879.399541:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787367879.399544:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367879.399577:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0308ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399588:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399594:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399601:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399606:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ae00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367879.399610:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399617:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399627:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c548221b900) 00010000:00010000:0.0:1787367879.399634:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367879.399640:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399646:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ae00/0x66f5679bff03089f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399668:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399674:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399680:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399685:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367879.399688:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399694:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399700:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c54824f0900) 00010000:00010000:0.0:1787367879.399702:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367879.399705:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399710:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0308a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399740:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e672 expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399764:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0308ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e672 expref: 7 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.399772:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c54824f0f00) 00010000:00010000:0.0:1787367879.399774:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787367879.399776:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b600, rc 0) 00000100:00100000:0.0:1787367879.399831:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:10522:x1874190788482944:12345-192.168.203.4@tcp:101:touch.500 Request processed in 27551us (27752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367879.399839:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:3.0:1787367879.407656:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367879.407739:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788483200 00000100:00100000:2.0:1787367879.407749:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788483200 00000100:00100000:2.0:1787367879.407805:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1787367879.407815:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:10522:x1874190788483200:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:2.0:1787367879.407839:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367879.407858:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff0308b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e679 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.407973:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408001:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408011:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408068:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408076:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408082:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787367879.408528:0:9404:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787367879.408679:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff0308c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408690:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff0308c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408699:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff0308c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408732:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408739:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408747:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408759:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367879.408763:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408771:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408783:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c54824f0f00) 00010000:00010000:2.0:1787367879.408785:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367879.408789:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408794:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff0308bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367879.408806:0:9404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095f7f948 reply state 000000003abbe13b transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408815:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408822:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9c55bc700e00) 00010000:00010000:2.0:1787367879.408824:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787367879.408827:0:9404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787367879.408857:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff0308b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e679 expref: 10 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408871:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff0308c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e679 expref: 9 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.408890:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:2.0:1787367879.408892:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367879.408895:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82a00, rc 0) 00000100:00100000:2.0:1787367879.408965:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+10:10522:x1874190788483200:12345-192.168.203.4@tcp:101:touch.500 Request processed in 1150us (1317us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787367879.408973:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1787367879.412967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367879.413850:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788483456 00000100:00100000:2.0:1787367879.413861:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788483456 00000100:00100000:2.0:1787367879.414095:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1787367879.414105:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+10:10522:x1874190788483456:12345-192.168.203.4@tcp:36:touch.500 00010000:00010000:2.0:1787367879.414163:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367879.414185:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff0308c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e679 expref: 10 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.414201:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:2.0:1787367879.414219:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367879.414421:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.414434:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.414443:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367879.414541:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a895f4d4 reply state 00000000410eb831 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.414565:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.414571:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367879.414574:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787367879.415302:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367879.424674:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+11:10522:x1874190788483456:12345-192.168.203.4@tcp:36:touch.500 Request processed in 10559us (11703us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787367879.424689:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:3.0:1787367879.448232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367879.449507:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788483584 00000100:00100000:2.0:1787367879.449519:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788483584 00000100:00100000:3.0:1787367879.449758:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:3.0:1787367879.449768:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+11:10522:x1874190788483584:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:3.0:1787367879.449790:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367879.449811:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0308de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e680 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.449933:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0308de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e680 expref: 12 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.449952:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0308de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e680 expref: 12 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.449972:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:3.0:1787367879.449975:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367879.449978:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175400, rc 0) 00000100:00100000:3.0:1787367879.450079:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+12:10522:x1874190788483584:12345-192.168.203.4@tcp:101:touch.500 Request processed in 312us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367879.450087:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:0.0:1787367879.453850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367879.454006:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788483712 00000100:00100000:3.0:1787367879.454015:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788483712 00000100:00100000:3.0:1787367879.454101:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:3.0:1787367879.454110:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874190788483712:12345-192.168.203.4@tcp:8:touch.500 00010000:00080000:3.0:1787367879.454147:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:3.0:1787367879.454182:0:8453:0:(genops.c:1385:class_connect()) connect: client 6033427c-dc64-421a-b37f-d4458dbaa527, cookie 0x66f5679bff0308e5 00002000:00100000:3.0:1787367879.454196:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6033427c-dc64-421a-b37f-d4458dbaa527/ffff9c55bd5d6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787367879.454207:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787367879.454790:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787367879.454824:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c55bd5d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367879.455328:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2401:x1874190788483712:12345-192.168.203.4@tcp:8:touch.500 Request processed in 1214us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367879.455339:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1787367879.457971:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367879.458071:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788483840 00000100:00100000:2.0:1787367879.458079:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788483840 00000100:00100000:2.0:1787367879.458236:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1787367879.458247:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:0:x1874190788483840:12345-192.168.203.4@tcp:2:touch.500 00000100:00080000:0.0:1787367879.458791:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787367879.479576:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1787367879.479590:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000100:00100000:2.0:1787367879.479812:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:0:x1874190788483840:12345-192.168.203.4@tcp:2:touch.500 Request processed in 21562us (21844us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787367879.479823:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1787367879.484403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.490098:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788484096 00000100:00100000:1.0:1787367879.490114:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788484096 00000100:00100000:1.0:1787367879.490193:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:1.0:1787367879.490204:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+12:10522:x1874190788484096:12345-192.168.203.4@tcp:35:touch.500 00000100:00100000:1.0:1787367879.490539:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+13:10522:x1874190788484096:12345-192.168.203.4@tcp:35:touch.500 Request processed in 335us (6142us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787367879.490548:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:0.0:1787367879.507475:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.507630:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788484224 00000100:00100000:1.0:1787367879.507641:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788484224 00000100:00100000:1.0:1787367879.507709:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:1.0:1787367879.507721:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+13:10523:x1874190788484224:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1787367879.507748:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367879.507770:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0308ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e687 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.507832:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff0308f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.507846:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff0308f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.507858:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff0308f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367879.507897:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787367879.507901:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367879.507947:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff0308f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.507988:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0308ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e687 expref: 15 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.508008:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff0308f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e687 expref: 14 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.508016:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c54824f0f00) 00010000:00010000:1.0:1787367879.508019:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367879.508023:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031c00, rc 0) 00000100:00100000:1.0:1787367879.508086:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+14:10523:x1874190788484224:12345-192.168.203.4@tcp:101:rm.0 Request processed in 368us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367879.508093:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1787367879.521574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.521795:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788484480 00000100:00100000:1.0:1787367879.521804:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788484480 00000100:00100000:1.0:1787367879.521867:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1787367879.521877:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+14:10523:x1874190788484480:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1787367879.521897:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367879.521916:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff0308fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e68e expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367879.522285:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787367879.522490:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff0308fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e68e expref: 16 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.522506:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c548221b900) 00010000:00010000:1.0:1787367879.522508:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367879.522528:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff0308fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e68e expref: 16 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.522541:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580030c00, rc 0) 00000100:00100000:2.0:1787367879.527602:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+15:10523:x1874190788484480:12345-192.168.203.4@tcp:101:rm.0 Request processed in 5714us (6024us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1787367879.527617:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1787367879.531139:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.540186:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788484608 00000100:00100000:1.0:1787367879.540203:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788484608 00000100:00100000:2.0:1787367879.540375:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1787367879.540387:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+15:10523:x1874190788484608:12345-192.168.203.4@tcp:37:rm.0 00000100:00100000:2.0:1787367879.546178:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+15:10523:x1874190788484608:12345-192.168.203.4@tcp:37:rm.0 Request processed in 5783us (15039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367879.546192:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1787367879.550930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367879.551009:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788484864 00000100:00100000:3.0:1787367879.551018:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788484864 00000100:00100000:3.0:1787367879.551083:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1787367879.551093:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+15:10523:x1874190788484864:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:3.0:1787367879.551327:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+16:10523:x1874190788484864:12345-192.168.203.4@tcp:35:rm.0 Request processed in 235us (405us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787367879.551334:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1787367879.554952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367879.555688:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788485120 00000100:00100000:0.0:1787367879.555698:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788485120 00000100:00100000:0.0:1787367879.555754:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1787367879.555763:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+16:10523:x1874190788485120:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1787367879.555784:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367879.555800:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff030908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e695 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.555888:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03090f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.555916:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03090f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.555926:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03090f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367879.555938:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787367879.556061:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff030908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e695 expref: 19 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.556078:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03090f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e695 expref: 18 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.556087:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c54824f0f00) 00010000:00010000:0.0:1787367879.556091:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787367879.556094:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a000, rc 0) 00000100:00100000:0.0:1787367879.556157:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+18:10523:x1874190788485120:12345-192.168.203.4@tcp:101:rm.0 Request processed in 394us (1213us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787367879.556228:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1787367879.558991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367879.559077:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788485248 00000100:00100000:3.0:1787367879.559086:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788485248 00000100:00100000:3.0:1787367879.559140:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:3.0:1787367879.559149:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+18:10523:x1874190788485248:12345-192.168.203.4@tcp:41:rm.0 00000004:00000024:3.0:1787367879.559228:0:9404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787367879.559303:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+18:10523:x1874190788485248:12345-192.168.203.4@tcp:41:rm.0 Request processed in 154us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367879.559311:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1787367879.563901:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367879.564068:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788485376 00000100:00100000:1.0:1787367879.564077:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788485376 00000100:00100000:1.0:1787367879.564141:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:1.0:1787367879.564152:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:10523:x1874190788485376:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1787367879.564173:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367879.564193:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff03091d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e69c expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.564264:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.564280:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.564291:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.564302:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.564310:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.564316:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565114:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030932 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565128:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565136:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367879.565182:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787367879.565187:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367879.565203:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565223:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565231:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565237:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565245:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565250:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580031400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367879.565254:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565261:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565278:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c54824f0f00) 00010000:00010000:2.0:1787367879.565288:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367879.565293:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565300:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff030924 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565315:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565321:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565328:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565333:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580031a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367879.565335:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565341:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565347:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9c55bc700e00) 00010000:00010000:2.0:1787367879.565349:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367879.565352:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565402:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff03092b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565592:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff03091d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e69c expref: 20 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565626:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e69c expref: 19 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367879.565633:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367879.565636:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367879.565638:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673c00, rc 0) 00000100:00100000:2.0:1787367879.565702:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+19:10523:x1874190788485376:12345-192.168.203.4@tcp:101:rm.0 Request processed in 1552us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367879.565711:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:0.0:1787367879.574126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367879.574225:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788485632 00000100:00100000:3.0:1787367879.574237:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788485632 00000100:00100000:3.0:1787367879.574296:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:3.0:1787367879.574306:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+19:10523:x1874190788485632:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:3.0:1787367879.574407:0:9404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787367879.574442:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030932 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e69c expref: 19 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574686:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0308de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e680 expref: 18 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574698:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:3.0:1787367879.574709:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff0308f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e687 expref: 17 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574717:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c54824f0f00) 00010000:00010000:3.0:1787367879.574721:0:9404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367879.574741:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574756:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574765:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574790:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574798:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574805:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574937:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574945:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.574952:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787367879.575158:0:9404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787367879.575168:0:9404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336862811614ns, next at 337862809238ns, rc = 0 00010000:00010000:3.0:1787367879.575226:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575236:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575244:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575251:0:9404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575268:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575274:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575300:0:9404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367879.575319:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575326:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575332:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575338:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367879.575342:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575349:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575386:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:3.0:1787367879.575388:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787367879.575392:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575398:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175800/0x66f5679bff030947 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575412:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.575501:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367879.575509:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.575517:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175a00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787367879.575521:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.575528:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.575539:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367879.575542:0:8468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787367879.575545:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.575551:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff03094e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575564:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367879.575565:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367879.575568:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367879.575571:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367879.575583:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575589:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367879.575592:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575598:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575607:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c54824f0f00) 00010000:00010000:3.0:1787367879.575610:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367879.575613:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575619:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174000/0x66f5679bff030939 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367879.575630:0:9404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc779681 reply state 000000000ac21b5f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575641:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367879.575646:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9c55bc700e00) 00010000:00010000:3.0:1787367879.575649:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787367879.575651:0:9404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367879.575778:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+18:10523:x1874190788485632:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1472us (1660us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787367879.575792:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:3.0:1787367879.577886:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367879.577908:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808492160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367879.577968:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367879.578074:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808492160 00000100:00100000:0.0:1787367879.578081:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808492160 00000100:00100000:0.0:1787367879.578127:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787367879.578135:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808492160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367879.578154:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367879.578222:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808492160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367879.578241:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1787367879.578263:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd62f100 x1874190808492160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367879.578285:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808492160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367879.578994:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367879.579053:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788485888 00000100:00100000:3.0:1787367879.579059:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788485888 00000100:00100000:3.0:1787367879.579099:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1787367879.579108:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+18:10523:x1874190788485888:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:3.0:1787367879.579316:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:10523:x1874190788485888:12345-192.168.203.4@tcp:35:rm.0 Request processed in 208us (324us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787367879.579323:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1787367879.581605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367879.581749:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788486144 00000100:00100000:0.0:1787367879.581759:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788486144 00000100:00100000:0.0:1787367879.581814:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1787367879.581823:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:10523:x1874190788486144:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:0.0:1787367879.581872:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787367879.581897:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03090f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e695 expref: 19 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.581917:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0308ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e672 expref: 18 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.581928:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c54824f0f00) 00010000:00010000:0.0:1787367879.581942:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03086e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e664 expref: 17 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.581951:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c548221b900) 00010000:00010000:0.0:1787367879.581957:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367879.581978:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.581989:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.581998:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582028:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582036:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582043:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582118:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582126:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582133:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367879.582903:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787367879.582920:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582928:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582935:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582941:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367879.582945:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582967:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582978:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c54824f0500) 00010000:00010000:0.0:1787367879.582981:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787367879.582986:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.582991:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030963 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.583012:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.583019:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.583025:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.583029:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367879.583032:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.583038:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.583044:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f0900) 00010000:00010000:0.0:1787367879.583046:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367879.583049:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.583068:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030955 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367879.583080:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebdd8199 reply state 000000005530f53a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.583091:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367879.583098:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c54824f0e00) 00010000:00010000:0.0:1787367879.583100:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367879.583102:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367879.583191:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+18:10523:x1874190788486144:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1367us (1593us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787367879.583199:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00010000:00010000:2.0:1787367880.025461:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367880.601980:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367880.602000:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808492288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787367880.602065:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367880.602135:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808492288 00000100:00100000:3.0:1787367880.602142:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808492288 00000100:00100000:3.0:1787367880.602184:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787367880.602192:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808492288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367880.602236:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367880.602280:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808492288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367880.602286:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787367880.602330:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808492288:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787367881.049507:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367882.076276:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367883.067643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367883.067698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367883.067861:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788486272 00000100:00100000:2.0:1787367883.067871:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788486272 00000100:00100000:2.0:1787367883.067930:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 335 00000100:00100000:2.0:1787367883.067940:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788486272:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367883.068004:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2402:x1874190788486272:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 65us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367883.068012:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 335 00000100:00100000:3.0:1787367883.068123:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788486528 00000100:00100000:3.0:1787367883.068141:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788486528 00000100:00100000:3.0:1787367883.068208:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:3.0:1787367883.068216:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788486528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367883.068246:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788486528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367883.068253:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00080000:2.0:1787367883.068319:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367883.068400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367883.068420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367883.068439:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367883.068461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367883.068478:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788486784 00000100:00100000:0.0:1787367883.068482:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788486784 00000100:00100000:0.0:1787367883.068509:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788486400 00000100:00100000:0.0:1787367883.068512:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788486400 00000100:00100000:0.0:1787367883.068525:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788486912 00000100:00100000:0.0:1787367883.068528:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788486912 00000100:00100000:0.0:1787367883.068541:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:0.0:1787367883.068548:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788486784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367883.068584:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788486784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367883.068591:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:0.0:1787367883.068605:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:0.0:1787367883.068611:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+18:2402:x1874190788486400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367883.068639:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+18:2402:x1874190788486400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367883.068645:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:0.0:1787367883.068657:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:0.0:1787367883.068664:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788486912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367883.068685:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2402:x1874190788486912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367883.068690:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:0.0:1787367883.068707:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788486656 00000100:00100000:0.0:1787367883.068711:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788486656 00000100:00080000:2.0:1787367883.068949:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367883.068952:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787367883.068954:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367883.069438:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:0.0:1787367883.069447:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788486656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367883.069482:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788486656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367883.069489:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00010000:00010000:2.0:1787367883.096617:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367883.673238:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808492416:0@lo:400:kworker.0 00000100:00100000:0.0:1787367883.673317:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367883.673390:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808492928:0@lo:400:kworker.0 00000100:00100000:0.0:1787367883.673437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367883.673473:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808493440:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.673483:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808492544:0@lo:400:kworker.0 00000100:00100000:0.0:1787367883.673499:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367883.673520:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808493952:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.673540:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367883.673550:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367883.673573:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808493056:0@lo:400:kworker.0 00000100:00100000:0.0:1787367883.673590:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808492416 00000100:00100000:0.0:1787367883.673598:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808492416 00000100:00100000:3.0:1787367883.673602:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367883.673622:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808493568:0@lo:400:kworker.0 00000100:00100000:0.0:1787367883.673654:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787367883.673664:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808492416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367883.673713:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808492416:12345-0@lo:400:kworker.0 Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367883.673720:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787367883.673749:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808492928 00000100:00100000:0.0:1787367883.673753:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808492928 00000100:00100000:0.0:1787367883.673774:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787367883.673780:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808492928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.673855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367883.673929:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808493440 00000100:00100000:2.0:1787367883.673934:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808493440 00000100:00100000:2.0:1787367883.673969:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808493952 00000100:00100000:2.0:1787367883.673979:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808493952 00000100:00100000:2.0:1787367883.674003:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787367883.674011:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808493440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367883.674260:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787367883.674269:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808493952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.675485:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808494080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367883.675540:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367883.675580:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808492672:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.675605:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367883.675617:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808493184:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.675641:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367883.675659:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808493696:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.675679:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367883.675693:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787367883.675699:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808492800:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.675718:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367883.675729:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808493312:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.675764:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367883.675776:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808493824:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.675793:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367883.675819:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808492544 00000100:00100000:3.0:1787367883.675825:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808492544 00000100:00100000:3.0:1787367883.675856:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808493056 00000100:00100000:3.0:1787367883.675859:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808493056 00000100:00100000:3.0:1787367883.675872:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808493568 00000100:00100000:3.0:1787367883.675874:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808493568 00000100:00100000:3.0:1787367883.675886:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808493184 00000100:00100000:3.0:1787367883.675889:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808493184 00000100:00100000:3.0:1787367883.675899:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808493696 00000100:00100000:3.0:1787367883.675901:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808493696 00000100:00100000:3.0:1787367883.675912:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808492800 00000100:00100000:3.0:1787367883.675914:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808492800 00000100:00100000:3.0:1787367883.675928:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787367883.675935:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808492544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.675980:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808492544:12345-0@lo:400:kworker.0 Request processed in 45us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367883.675987:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787367883.676002:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787367883.676009:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808493056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676037:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808493056:12345-0@lo:400:kworker.0 Request processed in 29us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367883.676043:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787367883.676055:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787367883.676061:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808493568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676087:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808493568:12345-0@lo:400:kworker.0 Request processed in 27us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367883.676099:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787367883.676111:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787367883.676117:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808493184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676150:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808493184:12345-0@lo:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367883.676156:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787367883.676168:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787367883.676174:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808493696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676272:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808493696:12345-0@lo:400:kworker.0 Request processed in 98us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367883.676278:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787367883.676291:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787367883.676298:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808492800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676323:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808492800:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367883.676480:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787367883.676552:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808494080 00000100:00100000:3.0:1787367883.676557:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808494080 00000100:00100000:3.0:1787367883.676574:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808492672 00000100:00100000:3.0:1787367883.676576:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808492672 00000100:00100000:3.0:1787367883.676588:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787367883.676594:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874190808494080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367883.676620:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367883.676654:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874190808494080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367883.676671:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787367883.676684:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787367883.676690:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808492672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676720:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808492672:12345-0@lo:400:kworker.0 Request processed in 30us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367883.676726:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787367883.676775:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808492800:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676788:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808492672:0@lo:400:kworker.0 00010000:00080000:3.0:1787367883.676800:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c1a680 x1874190808493184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367883.676810:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808493184:0@lo:400:kworker.0 00010000:00080000:3.0:1787367883.676819:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c18e00 x1874190808493696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367883.676827:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808493696:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676867:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808494080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367883.676878:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808492544:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676887:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808493056:0@lo:400:kworker.0 00000100:00100000:3.0:1787367883.676896:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808493568:0@lo:400:kworker.0 00000100:00100000:2.0:1787367883.677039:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808493440:12345-0@lo:400:kworker.0 Request processed in 3026us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367883.677048:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787367883.677062:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808493312 00000100:00100000:2.0:1787367883.677066:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808493312 00000100:00100000:2.0:1787367883.677084:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808493824 00000100:00100000:2.0:1787367883.677087:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808493824 00000100:00100000:2.0:1787367883.677102:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787367883.677107:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808493312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367883.677150:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808493312:12345-0@lo:400:kworker.0 Request processed in 42us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367883.677156:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787367883.677167:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787367883.677173:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808493824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367883.677210:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808493824:12345-0@lo:400:kworker.0 Request processed in 37us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367883.677216:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787367883.677461:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787367883.677466:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367883.677468:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367883.677470:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787367883.677798:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c1b800 x1874190808493312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367883.677809:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808493312:0@lo:400:kworker.0 00010000:00080000:3.0:1787367883.677831:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482621500 x1874190808493824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367883.677839:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808493824:0@lo:400:kworker.0 00000100:00100000:1.0:1787367883.681880:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808493952:12345-0@lo:400:kworker.0 Request processed in 7602us (8320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367883.681895:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787367883.683344:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808492928:12345-0@lo:400:kworker.0 Request processed in 9558us (9901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367883.683369:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1787367883.683432:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c1b100 x1874190808493440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367883.683447:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808493440:0@lo:400:kworker.0 00010000:00080000:0.0:1787367883.683459:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482621180 x1874190808493952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367883.683467:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808493952:0@lo:400:kworker.0 00000100:00100000:0.0:1787367883.683493:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808492416:0@lo:400:kworker.0 00000100:00100000:0.0:1787367883.683503:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808492928:0@lo:400:kworker.0 00000001:02000400:1.0:1787367883.910764:0:13698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787367884.121543:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787367884.187640:0:10007:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341475281690ns, next at 342475279028ns, rc = 0 00000100:00100000:3.0:1787367884.187776:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808494208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367884.187843:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367884.187956:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808494208 00000100:00100000:3.0:1787367884.187964:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808494208 00000100:00100000:3.0:1787367884.188007:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787367884.188016:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808494208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367884.188043:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367884.188082:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808494208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367884.188090:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1787367884.188130:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd688700 x1874190808494208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367884.188148:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808494208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367884.188162:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367884.188168:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808494336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367884.188202:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367884.188224:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808494336 00000100:00100000:3.0:1787367884.188228:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808494336 00000100:00100000:3.0:1787367884.188248:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787367884.188254:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808494336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787367884.188264:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367884.188293:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808494336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367884.188313:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1787367884.188501:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5482621180 x1874190808494336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367884.188517:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808494336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367884.189266:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808494464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787367884.189303:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367884.189448:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808494464 00000100:00100000:0.0:1787367884.189455:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808494464 00000100:00100000:0.0:1787367884.189504:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787367884.189514:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808494464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367884.189534:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367884.189585:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808494464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367884.189592:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1787367884.189662:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd688700 x1874190808494464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367884.189677:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808494464:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1787367884.704211:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787367884.704259:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1787367884.704269:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787367884.704408:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808494592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787367884.704468:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367884.704787:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367884.704798:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808494720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367884.704843:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367884.705100:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808494720 00000100:00100000:0.0:1787367884.705108:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808494720 00000100:00100000:0.0:1787367884.705159:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787367884.705168:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808494720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367884.705201:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367884.705421:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808494720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367884.705429:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:2.0:1787367884.706079:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706092:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706100:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706106:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367884.706111:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706119:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706134:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9c55bc700e00) 00010000:00010000:2.0:1787367884.706137:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367884.706142:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706148:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff0308c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706165:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706173:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706191:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706215:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367884.706228:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706234:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706244:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367884.706246:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367884.706249:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706255:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0308d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706274:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706281:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706287:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706292:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367884.706295:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706301:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706319:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9c55bc700e00) 00010000:00010000:2.0:1787367884.706322:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367884.706325:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706330:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030940 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706345:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706351:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706504:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706509:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ba00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367884.706513:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706520:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706530:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c54824f0e00) 00010000:00010000:2.0:1787367884.706532:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367884.706535:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706540:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ba00/0x66f5679bff03095c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367884.706582:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808494592 00000100:00100000:2.0:1787367884.706589:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808494592 00000100:00100000:2.0:1787367884.706634:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787367884.706643:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808494592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787367884.706667:0:8925:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1787367884.706697:0:8925:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8911c7, atime: 0x6a8911c7, ctime: 0x6a8911c7, blocks: 0x0 00010000:00010000:2.0:1787367884.706703:0:8925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706716:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1787367884.706720:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367884.706726:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706742:0:8925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706750:0:8925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706757:0:8925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.706776:0:8925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787367884.707161:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808494592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 518us (2692us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787367884.707189:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787367884.707212:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:0.0:1787367884.708493:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c5483c19c00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787367884.708507:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808494592:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787367884.708618:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.708632:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787367884.708638:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.708647:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.708665:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.708673:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000157825ef/0x66f5679bff03096a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367884.708697:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367884.708699:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367884.708701:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1787367884.715125:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afad9500 x1874190808494720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367884.715155:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808494720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367885.145067:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787367885.166228:0:13746:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdc3230c0 20000000:00000080:1.0:1787367885.166247:0:13746:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c55bd756c00 uarg=0000000000000000 20000000:01000000:1.0:1787367885.166300:0:13746:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787367885.166306:0:13746:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787367885.166312:0:13746:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787367885.168291:0:13747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787367885.168412:0:13746:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787367885.179919:0:13746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787367885.179973:0:13746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787367885.179991:0:13746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787367885.180009:0:13746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787367885.180030:0:13746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180049:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e64f expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180058:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e656 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180066:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030805 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180086:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030813 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180093:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff030821 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180099:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03082f expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180107:0:13746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180146:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03082f expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180160:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03082f expref: 23 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367885.180199:0:13746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808494848:0@lo:104: 00000100:00100000:0.0:1787367885.180284:0:13746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787367885.180350:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030821 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180393:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030821 expref: 23 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367885.180402:0:13746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808494976:0@lo:104: 00010000:00010000:0.0:1787367885.180435:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030813 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180443:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030813 expref: 23 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367885.180451:0:13746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808495104:0@lo:104: 00010000:00010000:0.0:1787367885.180477:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff030805 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180484:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff030805 expref: 23 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367885.180491:0:13746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808495232:0@lo:104: 00010000:00010000:0.0:1787367885.180514:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e656 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180524:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e656 expref: 12 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367885.180546:0:13746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cbb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808495360:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367885.180599:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e64f expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367885.180607:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e64f expref: 12 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367885.180615:0:13746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808495488:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367885.180636:0:13746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585538240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367885.180712:0:6521:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787367885.180733:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367885.180759:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367885.180768:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367885.180776:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808494848 00000100:00100000:3.0:1787367885.180783:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808494848 00000100:00100000:3.0:1787367885.180820:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808494976 00000100:00100000:3.0:1787367885.180824:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808494976 00000100:00100000:3.0:1787367885.180835:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808495104 00000100:00100000:3.0:1787367885.180838:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808495104 00000100:00100000:3.0:1787367885.180846:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808495232 00000100:00100000:3.0:1787367885.180848:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808495232 00000100:00100000:3.0:1787367885.180877:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787367885.180885:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54837ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:13746:x1874190808494848:12345-0@lo:104: 00010000:00010000:3.0:1787367885.180897:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.180962:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367885.180968:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54837ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+6:13746:x1874190808494848:12345-0@lo:104: Request processed in 84us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367885.181011:0:13746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808494848:0@lo:104: 00000100:00100000:3.0:1787367885.181036:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787367885.181076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787367885.181082:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:13746:x1874190808494976:12345-0@lo:104: 00010000:00010000:3.0:1787367885.181090:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181135:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787367885.181140:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+5:13746:x1874190808494976:12345-0@lo:104: Request processed in 59us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367885.181145:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787367885.181156:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787367885.181161:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:13746:x1874190808495104:12345-0@lo:104: 00010000:00010000:3.0:1787367885.181168:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181213:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787367885.181219:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+4:13746:x1874190808495104:12345-0@lo:104: Request processed in 58us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367885.181227:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787367885.181227:0:13746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808494976:0@lo:104: 00000100:00100000:3.0:1787367885.181243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787367885.181255:0:13746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808495104:0@lo:104: 00000100:00100000:3.0:1787367885.181260:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:13746:x1874190808495232:12345-0@lo:104: 00010000:00010000:3.0:1787367885.181270:0:6521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181311:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787367885.181316:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+3:13746:x1874190808495232:12345-0@lo:104: Request processed in 61us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367885.181322:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787367885.181342:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787367885.181348:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181379:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83e00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367885.181383:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367885.181391:0:13746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808495232:0@lo:104: 00010000:00010000:3.0:1787367885.181392:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367885.181402:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367885.181408:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367885.181447:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181454:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367885.181479:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181495:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa83e00/0x66f5679bff03082f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030836 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181508:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787367885.181511:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181517:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83c00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367885.181520:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181526:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367885.181532:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367885.181537:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367885.181560:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181566:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367885.181581:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181587:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa83c00/0x66f5679bff030821 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff030828 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181595:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367885.181603:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181608:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367885.181611:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181617:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367885.181623:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367885.181628:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367885.181643:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181649:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367885.181656:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181662:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff030813 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03081a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181671:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367885.181673:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181679:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367885.181681:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181696:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367885.181702:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367885.181707:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367885.181730:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181736:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367885.181743:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181748:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff030805 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03080c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.181761:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367885.181764:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367885.181767:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367885.181775:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367885.181781:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367885.181791:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808496000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367885.181822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367885.181823:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808495616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367885.181850:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367885.181858:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808495744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787367885.181870:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808496000 00000100:00100000:3.0:1787367885.181881:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367885.181882:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808496000 00000100:00100000:1.0:1787367885.181884:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808495616 00000100:00100000:1.0:1787367885.181889:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808495616 00000100:00100000:3.0:1787367885.181899:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367885.181906:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808495872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367885.181909:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03082f expref: 25 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367885.181912:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030805 expref: 25 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367885.181940:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808495744 00000100:00100000:2.0:1787367885.181943:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808495744 00000100:00100000:3.0:1787367885.181945:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367885.181960:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030821 expref: 26 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367885.181975:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808495872 00000100:00100000:2.0:1787367885.181980:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787367885.181981:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808495872 00000100:00100000:2.0:1787367885.181990:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+27:3653:x1874190808496000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367885.182002:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030813 expref: 27 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367885.182002:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367885.182010:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030805 expref: 27 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367885.182023:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030805 expref: 27 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367885.182024:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787367885.182034:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+27:3651:x1874190808495744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367885.182043:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367885.182047:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030821 expref: 27 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367885.182055:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613a200/0x66f5679bff03080c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030805 expref: 27 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.182058:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030821 expref: 27 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.182078:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673000/0x66f5679bff030828 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030821 expref: 26 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367885.182080:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367885.182091:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367885.182124:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3653:x1874190808496000:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367885.182129:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3651:x1874190808495744:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367885.182136:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787367885.182144:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787367885.182152:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787367885.182161:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:3651:x1874190808495872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367885.182168:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367885.182186:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff030813 expref: 23 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.182195:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff030813 expref: 23 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.182211:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613b000/0x66f5679bff03081a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff030813 expref: 23 pid: 6532 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.182219:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367885.182239:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3651:x1874190808495872:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367885.182245:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787367885.182269:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808496000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367885.182290:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808495872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367885.182296:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808495744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367885.182587:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787367885.182593:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3654:x1874190808495616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367885.182601:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367885.182605:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03082f expref: 21 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.182614:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03082f expref: 21 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.182636:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672400/0x66f5679bff030836 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03082f expref: 21 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.182646:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367885.182688:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:3654:x1874190808495616:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367885.182694:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787367885.183043:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808495616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367885.183880:0:13746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808495488:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367885.187847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367885.188036:0:13746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cbb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1874190808495360:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367885.188089:0:13746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367885.188160:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788487040 00000100:00100000:3.0:1787367885.188167:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788487040 00010000:00010000:3.0:1787367885.188220:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e64f expref: 13 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367885.188256:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1787367885.188265:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788487040:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367885.188280:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367885.188285:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e64f expref: 13 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.188295:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e64f expref: 13 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.188332:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0307f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e64f expref: 13 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367885.188843:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367885.188905:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:926ebb72-6750-4035-807e-0762300bea95+12:2403:x1874190788487040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 638us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367885.188913:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:2.0:1787367885.189135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367885.189492:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788487168 00000100:00100000:1.0:1787367885.189499:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788487168 00010000:00010000:1.0:1787367885.189523:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e656 expref: 12 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367885.189555:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:1.0:1787367885.189563:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:926ebb72-6750-4035-807e-0762300bea95+12:2402:x1874190788487168:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367885.189575:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367885.189580:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e656 expref: 12 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189591:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e656 expref: 12 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189607:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55afa83200/0x66f5679bff0307fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e656 expref: 12 pid: 6532 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189620:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189636:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189662:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189669:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189676:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189683:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189690:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787367885.189694:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189703:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189724:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367885.189735:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367885.189779:0:13746:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367885.189779:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:926ebb72-6750-4035-807e-0762300bea95+11:2402:x1874190788487168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 213us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367885.189795:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00010000:00010000:2.0:1787367885.189797:0:13746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367885.189805:0:13746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613b200/0x66f5679bff030971 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367885.721103:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367885.721132:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808496128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787367885.721207:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367885.721271:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808496128 00000100:00100000:3.0:1787367885.721277:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808496128 00000100:00100000:3.0:1787367885.721317:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787367885.721326:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808496128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367885.721379:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367885.721424:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808496128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367885.721432:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787367885.721488:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808496128:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1787367886.063056:0:13795:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc33147b90 20000000:00000080:0.0:1787367886.063707:0:13795:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c5483641c00 uarg=0000000000000000 20000000:01000000:0.0:1787367886.063747:0:13795:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787367886.063753:0:13795:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787367886.063757:0:13795:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1787367886.064699:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1787367886.064866:0:13795:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1787367886.064935:0:13795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1787367886.064957:0:13795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1787367886.064969:0:13795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1787367886.064978:0:13795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787367886.064997:0:13795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065010:0:13795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065020:0:13795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065042:0:13795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065048:0:13795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065056:0:13795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065194:0:13795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787367886.065200:0:13795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065209:0:13795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065333:0:13795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065342:0:13795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367886.065348:0:13795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613a800/0x66f5679bff030978 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367886.177740:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367886.835866:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367886.836025:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788487296 00000100:00100000:2.0:1787367886.836035:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788487296 00000100:00100000:2.0:1787367886.836091:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 337 00000100:00100000:2.0:1787367886.836102:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+11:6186:x1874190788487296:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367886.836131:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367886.836167:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672400/0x66f5679bff03097f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6a3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367886.836196:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672400/0x66f5679bff03097f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6a3 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367886.836207:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672400/0x66f5679bff03097f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6a3 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367886.836215:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672400, rc 0) 00000100:00100000:2.0:1787367886.836477:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788487296:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 376us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367886.836484:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 337 00000100:00100000:0.0:1787367886.848701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367886.849235:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788487424 00000100:00100000:2.0:1787367886.849245:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788487424 00000100:00100000:2.0:1787367886.849391:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 338 00000100:00100000:2.0:1787367886.849415:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788487424:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367886.849566:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788487424:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 153us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367886.849574:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 338 00000100:00100000:3.0:1787367886.857728:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367886.857825:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788487552 00000100:00100000:0.0:1787367886.857833:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788487552 00000100:00100000:0.0:1787367886.857901:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 339 00000100:00100000:0.0:1787367886.857926:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788487552:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367886.858064:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788487552:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 140us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367886.858072:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 339 00000100:00100000:0.0:1787367886.878614:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367886.879241:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788487680 00000100:00100000:2.0:1787367886.879252:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788487680 00000100:00100000:2.0:1787367886.879321:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 340 00000100:00100000:2.0:1787367886.879330:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+12:10807:x1874190788487680:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787367886.879498:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+12:10807:x1874190788487680:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 168us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367886.879507:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 340 00000100:00100000:3.0:1787367886.882407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367886.883180:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788487808 00000100:00100000:2.0:1787367886.883191:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788487808 00000100:00100000:2.0:1787367886.883249:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 341 00000100:00100000:2.0:1787367886.883259:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+12:10807:x1874190788487808:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787367886.883438:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+12:10807:x1874190788487808:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 179us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367886.883446:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 341 00000100:00100000:0.0:1787367886.890301:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367886.890588:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788487936 00000100:00100000:3.0:1787367886.890598:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788487936 00000100:00100000:3.0:1787367886.890669:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 342 00000100:00100000:3.0:1787367886.890695:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+12:6186:x1874190788487936:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367886.890712:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367886.890727:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55c2175800/0x66f5679bff030986 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6aa expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367886.890755:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55c2175800/0x66f5679bff030986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6aa expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367886.890765:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55c2175800/0x66f5679bff030986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6aa expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367886.890775:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175800, rc 0) 00000100:00100000:3.0:1787367886.890833:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788487936:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 141us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367886.890840:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 342 00000100:00100000:3.0:1787367886.894526:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367886.894695:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788488064 00000100:00100000:2.0:1787367886.894705:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788488064 00000100:00100000:2.0:1787367886.894758:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 343 00000100:00100000:2.0:1787367886.894768:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788488064:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367886.894912:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788488064:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 145us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367886.894936:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 343 00000100:00100000:0.0:1787367886.899803:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367886.900184:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788488192 00000100:00100000:2.0:1787367886.900195:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788488192 00000100:00100000:2.0:1787367886.900249:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 344 00000100:00100000:2.0:1787367886.900260:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788488192:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367886.900490:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:6186:x1874190788488192:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 229us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367886.900500:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 344 00000100:00100000:1.0:1787367886.914888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367886.914988:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788488320 00000100:00100000:3.0:1787367886.914998:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788488320 00000100:00100000:3.0:1787367886.915052:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 345 00000100:00100000:3.0:1787367886.915070:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:10809:x1874190788488320:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787367886.915222:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:10809:x1874190788488320:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 153us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367886.915230:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 345 00000100:00100000:3.0:1787367886.941002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367886.941175:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788488448 00000100:00100000:0.0:1787367886.941184:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788488448 00000100:00100000:0.0:1787367886.941247:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 346 00000100:00100000:0.0:1787367886.941258:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:10809:x1874190788488448:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787367886.941427:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:10809:x1874190788488448:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 170us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367886.941435:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 346 10000000:01000000:2.0:1787367887.065285:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787367887.065291:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bc4cb000 from 7 10000000:01000000:2.0:1787367887.065296:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787367887.065342:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367887.065370:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367887.065381:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367887.065406:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808496256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.065472:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367887.065562:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367887.065896:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808496256 00000100:00100000:0.0:1787367887.065904:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808496256 00000100:00100000:0.0:1787367887.065961:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787367887.065970:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:6535:x1874190808496256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367887.065984:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367887.065998:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613ba00/0x66f5679bff030994 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03098d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367887.066023:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613ba00/0x66f5679bff030994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03098d expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367887.066034:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613ba00/0x66f5679bff030994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03098d expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367887.066061:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613ba00, rc 0) 00000100:00100000:0.0:1787367887.066113:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808496256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367887.066121:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787367887.066259:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808496256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367887.066273:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367887.066292:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367887.066352:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808496384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.066399:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367887.066427:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367887.066640:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808496384 00000100:00100000:0.0:1787367887.066645:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808496384 00000100:00100000:0.0:1787367887.066677:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787367887.066685:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808496384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367887.066792:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808496384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367887.066799:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787367887.066873:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808496384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367887.066903:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808496512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367887.066947:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367887.066969:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367887.067017:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808496512 00000100:00100000:1.0:1787367887.067021:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808496512 00000100:00100000:1.0:1787367887.067052:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787367887.067059:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808496512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367887.067139:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808496512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367887.067146:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787367887.067230:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808496512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367887.067726:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13808:1874190808496640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367887.067764:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367887.067794:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677300 going to sleep for 11 seconds 00000100:00100000:1.0:1787367887.067844:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808496640 00000100:00100000:1.0:1787367887.067848:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808496640 00000100:00100000:1.0:1787367887.067883:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787367887.067890:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:13808:x1874190808496640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367887.067974:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:13808:x1874190808496640:12345-0@lo:502:llog_process_th.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367887.067981:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787367887.068304:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13808:1874190808496640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367887.068327:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367887.068335:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367887.068338:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787367887.068344:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55bc4cb000 00000020:00000080:3.0:1787367887.068347:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787367887.068427:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367887.068431:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367887.068433:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787367887.068435:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367887.068438:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367887.068439:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787367887.068442:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55bc4cb000 00000020:00000080:3.0:1787367887.068445:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787367887.068478:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13808:1874190808496768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367887.068511:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367887.068538:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677300 going to sleep for 11 seconds 00000100:00100000:2.0:1787367887.069042:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808496768 00000100:00100000:2.0:1787367887.069048:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808496768 00000100:00100000:2.0:1787367887.069087:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787367887.069095:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:13808:x1874190808496768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367887.069203:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:13808:x1874190808496768:12345-0@lo:502:llog_process_th.0 Request processed in 108us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367887.069210:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787367887.069295:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13808:1874190808496768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367887.069315:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367887.069320:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367887.069321:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787367887.069332:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787367887.074324:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787367887.074389:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367887.074402:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367887.074414:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367887.074425:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787367887.074427:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bd606800 from 7 10000000:01000000:2.0:1787367887.074430:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787367887.074463:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367887.074471:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367887.074492:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367887.074515:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808496896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.074596:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367887.074639:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367887.074799:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808496896 00000100:00100000:1.0:1787367887.074806:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808496896 00000100:00100000:1.0:1787367887.074855:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787367887.074865:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:6535:x1874190808496896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367887.074877:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367887.074889:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5580031400/0x66f5679bff0309a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03099b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367887.074911:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5580031400/0x66f5679bff0309a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03099b expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367887.074921:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5580031400/0x66f5679bff0309a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03099b expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367887.074941:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031400, rc 0) 00000100:00100000:1.0:1787367887.074981:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808496896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367887.074988:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787367887.077237:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808496896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367887.077262:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367887.077274:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367887.077349:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.077428:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367887.077458:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367887.077476:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808497024 00000100:00100000:2.0:1787367887.077482:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808497024 00000100:00100000:2.0:1787367887.077519:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787367887.077528:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808497024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.077659:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808497024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367887.077667:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787367887.077699:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.077733:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.077784:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367887.077797:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367887.077808:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808497152 00000100:00100000:2.0:1787367887.077811:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808497152 00000100:00100000:2.0:1787367887.077827:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787367887.077832:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808497152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.078020:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808497152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367887.078027:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787367887.078062:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.079517:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13810:1874190808497280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367887.079596:0:13810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367887.079635:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54836066c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367887.079737:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808497280 00000100:00100000:3.0:1787367887.079743:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808497280 00000100:00100000:3.0:1787367887.079788:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787367887.079798:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:13810:x1874190808497280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367887.079916:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:13810:x1874190808497280:12345-0@lo:502:llog_process_th.0 Request processed in 119us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367887.079924:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787367887.080959:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13810:1874190808497280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367887.081005:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367887.081015:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367887.081017:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787367887.081023:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55bd606800 00000020:00000080:2.0:1787367887.081026:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787367887.081087:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367887.081090:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367887.081092:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787367887.081094:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367887.081097:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367887.081098:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787367887.081102:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55bd606800 00000020:00000080:2.0:1787367887.081104:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787367887.083646:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13810:1874190808497408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367887.083743:0:13810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367887.083792:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54836066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367887.084180:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808497408 00000100:00100000:1.0:1787367887.084188:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808497408 00000100:00100000:1.0:1787367887.084236:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787367887.084245:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:13810:x1874190808497408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367887.084394:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:13810:x1874190808497408:12345-0@lo:502:llog_process_th.0 Request processed in 150us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367887.084402:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787367887.086208:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13810:1874190808497408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367887.086249:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367887.086257:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367887.086259:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787367887.086263:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787367887.086775:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787367887.086796:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367887.086807:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367887.086819:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367887.086830:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367887.086833:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bc6be800 from 7 10000000:01000000:3.0:1787367887.086835:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367887.086866:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367887.086874:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367887.086883:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367887.086904:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367887.086954:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367887.087004:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367887.087231:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808497536 00000100:00100000:1.0:1787367887.087237:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808497536 00000100:00100000:1.0:1787367887.087282:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787367887.087292:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:6535:x1874190808497536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367887.087303:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367887.087324:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5580031a00/0x66f5679bff0309b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0309a9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367887.087348:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5580031a00/0x66f5679bff0309b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0309a9 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367887.087398:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5580031a00/0x66f5679bff0309b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0309a9 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367887.087408:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031a00, rc 0) 00000100:00100000:1.0:1787367887.087459:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808497536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367887.087466:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787367887.087507:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367887.087520:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367887.087529:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367887.087604:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367887.087630:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367887.087645:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559123ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367887.087659:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808497664 00000100:00100000:1.0:1787367887.087662:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808497664 00000100:00100000:1.0:1787367887.087683:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787367887.087690:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808497664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367887.087785:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808497664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367887.087792:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787367887.087820:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367887.087844:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367887.087882:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367887.087895:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559123ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367887.087906:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808497792 00000100:00100000:1.0:1787367887.087909:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808497792 00000100:00100000:1.0:1787367887.087934:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787367887.087940:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808497792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367887.088027:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808497792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367887.088033:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787367887.088072:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808497792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367887.098213:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13811:1874190808497920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367887.098305:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367887.098408:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606780 going to sleep for 11 seconds 00000100:00100000:3.0:1787367887.098509:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808497920 00000100:00100000:3.0:1787367887.098515:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808497920 00000100:00100000:3.0:1787367887.098605:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787367887.098614:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:13811:x1874190808497920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367887.098731:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:13811:x1874190808497920:12345-0@lo:502:llog_process_th.0 Request processed in 117us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367887.098738:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787367887.098821:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13811:1874190808497920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367887.098849:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367887.098858:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367887.098860:0:13811:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787367887.098867:0:13811:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55bc6be800 00000020:00000080:2.0:1787367887.098870:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787367887.098922:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367887.098926:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367887.098927:0:13811:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787367887.098931:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367887.098933:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367887.098935:0:13811:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787367887.098938:0:13811:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55bc6be800 00000020:00000080:2.0:1787367887.098940:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787367887.098973:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13811:1874190808498048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367887.099005:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367887.099319:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483606780 going to sleep for 11 seconds 00000100:00100000:0.0:1787367887.099454:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808498048 00000100:00100000:0.0:1787367887.099460:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808498048 00000100:00100000:0.0:1787367887.099488:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787367887.099496:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:13811:x1874190808498048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367887.099574:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:13811:x1874190808498048:12345-0@lo:502:llog_process_th.0 Request processed in 79us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367887.099581:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787367887.101604:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13811:1874190808498048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367887.101644:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367887.101652:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367887.101655:0:13811:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787367887.101659:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787367887.101844:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787367887.101866:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367887.101877:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367887.101888:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367887.101898:0:6535:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367887.101901:0:6535:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55834d5000 from 7 10000000:01000000:3.0:1787367887.101904:0:6535:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367887.101936:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367887.101944:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367887.101953:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367887.101973:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808498176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367887.102028:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367887.106232:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808498176 00000100:00100000:0.0:1787367887.106245:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808498176 00000100:00100000:0.0:1787367887.106303:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787367887.106313:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:6535:x1874190808498176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367887.106329:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367887.106347:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0309be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0309b7 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367887.106408:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0309be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0309b7 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367887.106420:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0309be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0309b7 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367887.106429:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613ae00, rc 0) 00000100:00100000:0.0:1787367887.106485:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808498176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (4458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367887.106492:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787367887.106493:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367887.106513:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808498176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367887.106530:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367887.106538:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367887.106598:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808498304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367887.106628:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367887.106644:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367887.106660:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808498304 00000100:00100000:3.0:1787367887.106663:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808498304 00000100:00100000:3.0:1787367887.106687:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787367887.106693:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808498304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367887.107298:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808498304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 603us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367887.107306:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787367887.107352:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808498304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367887.107412:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808498432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787367887.107416:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787367887.107454:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367887.107481:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367887.107496:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808498432 00000100:00100000:3.0:1787367887.107500:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808498432 00000100:00100000:3.0:1787367887.107518:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1787367887.107524:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808498432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367887.107616:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:6535:x1874190808498432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367887.107623:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787367887.107716:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:6535:1874190808498432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367887.115419:0:13814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13814:1874190808498560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367887.115506:0:13814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367887.115575:0:13814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482677480 going to sleep for 11 seconds 00000100:00100000:2.0:1787367887.115637:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808498560 00000100:00100000:2.0:1787367887.115645:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808498560 00000100:00100000:2.0:1787367887.115692:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787367887.115701:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:13814:x1874190808498560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367887.115834:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:13814:x1874190808498560:12345-0@lo:502:llog_process_th.0 Request processed in 134us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367887.115842:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787367887.116168:0:13814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13814:1874190808498560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787367887.116199:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367887.116208:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367887.116210:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787367887.116218:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55834d5000 00000020:00000080:1.0:1787367887.116221:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787367887.116283:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367887.116287:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367887.116288:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787367887.116290:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367887.116293:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367887.116294:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787367887.116297:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55834d5000 00000020:00000080:1.0:1787367887.116299:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787367887.116344:0:13814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13814:1874190808498688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367887.116408:0:13814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367887.116433:0:13814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582bdfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367887.118723:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808498688 00000100:00100000:2.0:1787367887.118736:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808498688 00000100:00100000:2.0:1787367887.118817:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787367887.118828:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:13814:x1874190808498688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367887.118973:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:13814:x1874190808498688:12345-0@lo:502:llog_process_th.0 Request processed in 147us (2563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367887.118981:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787367887.120144:0:13814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:13814:1874190808498688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787367887.120191:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367887.120199:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367887.120201:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787367887.120206:0:13814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787367887.122721:0:6535:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787367887.122754:0:6535:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367887.122765:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367887.122778:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787367887.143652:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787367887.204956:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787367888.153211:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787367888.154116:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787367888.181703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367888.181745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367888.181777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367888.181817:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367888.181841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367888.181861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367888.181886:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788488576 00000100:00100000:0.0:1787367888.181904:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788488576 00000100:00100000:0.0:1787367888.181953:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 367 00000100:00100000:0.0:1787367888.181963:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788488576:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367888.182034:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788488576:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.182043:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 367 00000100:00100000:0.0:1787367888.182319:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788488704 00000100:00100000:0.0:1787367888.182323:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788488704 00000100:00100000:0.0:1787367888.182387:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788489216 00000100:00100000:0.0:1787367888.182391:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788489216 00000100:00100000:0.0:1787367888.182422:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788488832 00000100:00100000:0.0:1787367888.182425:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788488832 00000100:00100000:0.0:1787367888.182435:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788489088 00000100:00100000:0.0:1787367888.182437:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788489088 00000100:00100000:0.0:1787367888.182449:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:0.0:1787367888.182455:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788488704:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367888.182490:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788488704:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.182496:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:0.0:1787367888.182509:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:0.0:1787367888.182515:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788489216:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367888.182538:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788489216:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.182544:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:0.0:1787367888.182555:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:3.0:1787367888.182561:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:0.0:1787367888.182561:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788488832:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367888.182569:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788489088:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367888.182584:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788488832:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.182590:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:3.0:1787367888.182598:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788489088:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367888.182605:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:2.0:1787367888.183128:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788488960 00000100:00100000:2.0:1787367888.183147:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788488960 00000100:00100000:2.0:1787367888.183213:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:2.0:1787367888.183222:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788488960:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367888.183263:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788488960:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367888.183269:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00080000:2.0:1787367888.183293:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367888.183297:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787367888.183299:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787367888.216763:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367888.794593:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808499072:0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.794678:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367888.794695:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808498944:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.794728:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367888.794735:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808499584:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.794748:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808499456:0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.794756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367888.794777:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367888.794780:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808500096:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.794798:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808499968:0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.794799:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367888.794817:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367888.794829:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787367888.794831:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787367888.794834:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808499200:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.794835:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808498816:0@lo:400:kworker.0 00000100:00100000:3.0:1787367888.794912:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808498944 00000100:00100000:3.0:1787367888.794920:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808498944 00000100:00100000:3.0:1787367888.794958:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808499584 00000100:00100000:3.0:1787367888.794961:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808499584 00000100:00100000:3.0:1787367888.794985:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808499456 00000100:00100000:3.0:1787367888.794988:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808499456 00000100:00100000:3.0:1787367888.795000:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808500096 00000100:00100000:3.0:1787367888.795002:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808500096 00000100:00100000:3.0:1787367888.795013:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808499968 00000100:00100000:3.0:1787367888.795015:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808499968 00000100:00100000:3.0:1787367888.795029:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787367888.795038:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808498944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795096:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367888.795110:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808499712:0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795133:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367888.795162:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808500224:0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795184:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367888.795216:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808499072 00000100:00100000:0.0:1787367888.795221:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808499072 00000100:00100000:0.0:1787367888.795250:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787367888.795257:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808499072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795297:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808499072:12345-0@lo:400:kworker.0 Request processed in 41us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.795305:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787367888.795327:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808499712 00000100:00100000:0.0:1787367888.795330:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808499712 00000100:00100000:0.0:1787367888.795376:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808500224 00000100:00100000:0.0:1787367888.795380:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808500224 00000100:00100000:0.0:1787367888.795404:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787367888.795411:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808499712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795445:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808499712:12345-0@lo:400:kworker.0 Request processed in 34us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.795451:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787367888.795463:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787367888.795469:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808500224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795495:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808500224:12345-0@lo:400:kworker.0 Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.795513:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787367888.795535:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808499200 00000100:00100000:0.0:1787367888.795539:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808499200 00000100:00100000:0.0:1787367888.795557:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787367888.795563:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808499584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795594:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808499584:12345-0@lo:400:kworker.0 Request processed in 32us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.795600:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787367888.795613:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787367888.795618:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808499456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795644:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808499456:12345-0@lo:400:kworker.0 Request processed in 26us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.795650:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787367888.795660:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787367888.795666:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808500096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795691:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808500096:12345-0@lo:400:kworker.0 Request processed in 26us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.795697:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787367888.795709:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787367888.795714:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808499968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795740:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808499968:12345-0@lo:400:kworker.0 Request processed in 26us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.795745:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787367888.795756:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787367888.795762:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808499200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795796:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808499200:12345-0@lo:400:kworker.0 Request processed in 34us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.795803:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787367888.795851:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808499200:0@lo:400:kworker.0 00010000:00080000:0.0:1787367888.795864:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836b8380 x1874190808499712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367888.795875:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808499712:0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795886:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808500224:0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.795896:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808499072:0@lo:400:kworker.0 00010000:00080000:0.0:1787367888.795906:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836ba300 x1874190808499584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367888.795915:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808499584:0@lo:400:kworker.0 00010000:00080000:0.0:1787367888.795924:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836ba680 x1874190808500096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367888.795933:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808500096:0@lo:400:kworker.0 00000100:00080000:0.0:1787367888.795980:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367888.795984:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367888.795987:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367888.795989:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367888.799731:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367888.799860:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808499328:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.799918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367888.799944:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808499840:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.799965:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367888.799981:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808500352:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.800000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367888.800032:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808499456:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.800070:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808499968:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.800094:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808500480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367888.800125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367888.800169:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808499840 00000100:00100000:2.0:1787367888.800174:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808499840 00000100:00100000:2.0:1787367888.800231:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808500352 00000100:00100000:2.0:1787367888.800235:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808500352 00000100:00100000:2.0:1787367888.800259:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787367888.800267:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808499840:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787367888.801303:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367888.801310:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367888.801326:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808499328 00000100:00100000:0.0:1787367888.801332:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808499328 00000100:00100000:2.0:1787367888.801400:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808499840:12345-0@lo:400:kworker.0 Request processed in 1132us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.801402:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808500480 00000100:00100000:2.0:1787367888.801409:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787367888.801415:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808500480 00000100:00100000:2.0:1787367888.801428:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787367888.801430:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787367888.801435:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808500352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367888.801436:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808499328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.801473:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808500352:12345-0@lo:400:kworker.0 Request processed in 38us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.801473:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808499328:12345-0@lo:400:kworker.0 Request processed in 37us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.801479:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787367888.801492:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787367888.801498:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808500480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787367888.801526:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787367888.801561:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808500480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367888.801567:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787367888.802135:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787367888.802203:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808500480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367888.802228:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808499328:0@lo:400:kworker.0 00010000:00080000:2.0:1787367888.802242:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836baa00 x1874190808499840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367888.802253:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808499840:0@lo:400:kworker.0 00000100:00100000:2.0:1787367888.802267:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808500352:0@lo:400:kworker.0 00000100:00100000:1.0:1787367888.803559:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808498816 00000100:00100000:1.0:1787367888.803572:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808498816 00000100:00100000:3.0:1787367888.804551:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808498944:12345-0@lo:400:kworker.0 Request processed in 9497us (9805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367888.804564:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787367888.806772:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808498944:0@lo:400:kworker.0 00000100:00100000:1.0:1787367888.811141:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787367888.811178:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808498816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367888.811304:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808498816:12345-0@lo:400:kworker.0 Request processed in 139us (11578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367888.811312:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787367888.812925:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808498816:0@lo:400:kworker.0 00010000:00010000:3.0:1787367889.240646:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367889.304616:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367889.304641:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808500608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367889.304707:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367889.304839:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808500608 00000100:00100000:3.0:1787367889.304848:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808500608 00000100:00100000:3.0:1787367889.304900:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787367889.304909:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808500608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787367889.304938:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367889.304987:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808500608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367889.304994:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787367889.305037:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808500608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367889.307410:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367889.307434:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808500736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367889.307495:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367889.307609:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367889.307621:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808500864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367889.307626:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808500736 00000100:00100000:2.0:1787367889.307634:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808500736 00000100:00100000:3.0:1787367889.307653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367889.307676:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808500864 00000100:00100000:2.0:1787367889.307680:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808500864 00000100:00100000:2.0:1787367889.307702:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787367889.307723:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808500736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787367889.307755:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367889.307810:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808500736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367889.307817:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787367889.307833:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787367889.307839:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808500864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367889.307848:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367889.307888:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808500864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367889.307895:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1787367889.307914:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c09880 x1874190808500736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367889.307933:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808500736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787367889.308002:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808500864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367889.816731:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367889.816759:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808500992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367889.816828:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367889.816955:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808500992 00000100:00100000:0.0:1787367889.816962:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808500992 00000100:00100000:0.0:1787367889.817016:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787367889.817025:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808500992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367889.817046:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367889.817104:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808500992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367889.817111:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1787367889.817132:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836b8e00 x1874190808500992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367889.817162:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808500992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367890.264576:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367890.841323:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367890.841344:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808501120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787367890.841421:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367890.841443:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808501120 00000100:00100000:3.0:1787367890.841450:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808501120 00000100:00100000:3.0:1787367890.841509:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787367890.841518:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808501120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367890.841550:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367890.841594:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808501120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367890.841602:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787367890.841819:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808501120:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1787367890.843417:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1787367891.290471:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367892.313531:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367893.300685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367893.300748:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367893.300791:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367893.300829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367893.300859:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367893.300892:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367893.300927:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788489472 00000100:00100000:0.0:1787367893.300938:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788489472 00000100:00100000:0.0:1787367893.300994:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788489984 00000100:00100000:0.0:1787367893.300997:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788489984 00000100:00100000:0.0:1787367893.301010:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788489600 00000100:00100000:0.0:1787367893.301012:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788489600 00000100:00100000:0.0:1787367893.301024:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788489856 00000100:00100000:0.0:1787367893.301026:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788489856 00000100:00100000:0.0:1787367893.301047:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:0.0:1787367893.301060:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788489472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367893.301162:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788489472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 101us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367893.301174:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:0.0:1787367893.301195:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:0.0:1787367893.301202:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788489984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367893.301233:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788489984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367893.301242:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:0.0:1787367893.301255:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:0.0:1787367893.301439:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788489600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367893.301546:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788489600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 111us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367893.301556:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:0.0:1787367893.301571:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:0.0:1787367893.301578:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788489856:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367893.301699:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788489856:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 118us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367893.301706:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00080000:0.0:1787367893.301734:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367893.301738:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367893.302598:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788489728 00000100:00100000:1.0:1787367893.302610:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788489728 00000100:00100000:1.0:1787367893.302684:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:1.0:1787367893.302695:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788489728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367893.302749:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788489728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 55us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.302759:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:2.0:1787367893.303749:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788489344 00000100:00100000:2.0:1787367893.303765:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788489344 00000100:00100000:2.0:1787367893.303810:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 369 00000100:00100000:2.0:1787367893.303819:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788489344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367893.303871:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788489344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 54us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367893.303878:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 369 00000100:00080000:0.0:1787367893.305566:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787367893.336615:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367893.913201:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808501376:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.913268:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367893.913332:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808501888:0@lo:400:kworker.0 00000100:00100000:2.0:1787367893.913338:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808501248:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.913378:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367893.913411:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367893.913437:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808501760:0@lo:400:kworker.0 00000100:00100000:2.0:1787367893.913464:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367893.913479:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808502272:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.913523:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808502400:0@lo:400:kworker.0 00000100:00100000:2.0:1787367893.913531:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367893.913556:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367893.913577:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808502784:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.913587:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787367893.913597:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808501504:0@lo:400:kworker.0 00000100:00100000:2.0:1787367893.913621:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367893.913633:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367893.913652:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787367893.913660:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808501632:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.913675:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808502016:0@lo:400:kworker.0 00000100:00100000:2.0:1787367893.913689:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367893.913709:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367893.913714:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808502144:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.913727:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808502528:0@lo:400:kworker.0 00000100:00100000:2.0:1787367893.913746:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367893.913757:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367893.913783:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808502656:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.913784:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808501760 00000100:00100000:1.0:1787367893.913792:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808501760 00000100:00100000:1.0:1787367893.913828:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808501504 00000100:00100000:1.0:1787367893.913831:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808501504 00000100:00100000:1.0:1787367893.913845:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787367893.913853:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808501760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.913897:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808501760:12345-0@lo:400:kworker.0 Request processed in 44us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.913903:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787367893.913919:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367893.913921:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787367893.913929:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808501504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367893.913988:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808501248 00000100:00100000:0.0:1787367893.913993:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808501248 00000100:00100000:0.0:1787367893.914023:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787367893.914031:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808501248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367893.914180:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808501376 00000100:00100000:3.0:1787367893.914185:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808501376 00000100:00100000:3.0:1787367893.914207:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808501888 00000100:00100000:3.0:1787367893.914209:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808501888 00000100:00100000:3.0:1787367893.914231:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808502400 00000100:00100000:3.0:1787367893.914234:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808502400 00000100:00100000:3.0:1787367893.914246:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808501632 00000100:00100000:3.0:1787367893.914248:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808501632 00000100:00100000:3.0:1787367893.914258:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808502016 00000100:00100000:3.0:1787367893.914261:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808502016 00000100:00100000:3.0:1787367893.914271:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808502528 00000100:00100000:3.0:1787367893.914273:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808502528 00000100:00100000:3.0:1787367893.914285:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787367893.914292:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808501376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.914751:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808501504:12345-0@lo:400:kworker.0 Request processed in 822us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.914768:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787367893.914790:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808502272 00000100:00100000:1.0:1787367893.914794:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808502272 00000100:00100000:1.0:1787367893.914814:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808502784 00000100:00100000:1.0:1787367893.914816:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808502784 00000100:00100000:1.0:1787367893.914826:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808502144 00000100:00100000:1.0:1787367893.914829:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808502144 00000100:00100000:1.0:1787367893.914838:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808502656 00000100:00100000:1.0:1787367893.914840:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808502656 00000100:00100000:1.0:1787367893.914851:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787367893.914857:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808502272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.914889:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808502272:12345-0@lo:400:kworker.0 Request processed in 32us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.914895:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787367893.914906:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787367893.914911:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808502784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.914935:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808502784:12345-0@lo:400:kworker.0 Request processed in 25us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.914941:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787367893.914949:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787367893.914954:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808502144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.914976:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808502144:12345-0@lo:400:kworker.0 Request processed in 22us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.914981:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787367893.914990:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787367893.914995:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808502656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.915031:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808502656:12345-0@lo:400:kworker.0 Request processed in 35us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.915038:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787367893.915071:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808501504:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.915129:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787367893.915136:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808501888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.915244:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808501888:12345-0@lo:400:kworker.0 Request processed in 108us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.915251:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787367893.915268:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787367893.915273:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808502400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.915301:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808502400:12345-0@lo:400:kworker.0 Request processed in 28us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.915306:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787367893.915317:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787367893.915322:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808501632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.915348:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808501632:12345-0@lo:400:kworker.0 Request processed in 26us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.915353:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787367893.915383:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787367893.915389:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808502016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.915415:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808502016:12345-0@lo:400:kworker.0 Request processed in 27us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.915421:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787367893.915441:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787367893.915516:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808502528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.915550:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808502528:12345-0@lo:400:kworker.0 Request processed in 103us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.915556:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00080000:1.0:1787367893.915585:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cb9500 x1874190808502016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367893.915596:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808502016:0@lo:400:kworker.0 00010000:00080000:1.0:1787367893.915606:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6372d80 x1874190808502528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367893.915613:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808502528:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.915623:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808501888:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.915633:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808502400:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.916241:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808502912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367893.916278:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787367893.916329:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367893.916335:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367893.916337:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367893.916339:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367893.916384:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808502912 00000100:00100000:1.0:1787367893.916389:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808502912 00000100:00100000:1.0:1787367893.916420:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787367893.916426:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808502912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787367893.916517:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787367893.916567:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808502912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367893.916575:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787367893.916611:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808502912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367893.918211:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808501248:12345-0@lo:400:kworker.0 Request processed in 4175us (4795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367893.918223:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787367893.919936:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808502656:0@lo:400:kworker.0 00000100:00100000:2.0:1787367893.919953:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808501248:0@lo:400:kworker.0 00000100:00100000:2.0:1787367893.919964:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808501760:0@lo:400:kworker.0 00010000:00080000:2.0:1787367893.919999:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cbb100 x1874190808502272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367893.920010:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808502272:0@lo:400:kworker.0 00000100:00100000:2.0:1787367893.920022:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787367893.920027:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c5483c19c00, transno 4294967301 00000100:00100000:2.0:1787367893.920048:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808502784:0@lo:400:kworker.0 00000100:00100000:3.0:1787367893.920073:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808501376:12345-0@lo:400:kworker.0 Request processed in 5777us (6800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367893.920085:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808501632:0@lo:400:kworker.0 00000100:00100000:3.0:1787367893.920086:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00010000:00080000:2.0:1787367893.920103:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cb8e00 x1874190808502144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367893.920126:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808502144:0@lo:400:kworker.0 00000100:00100000:1.0:1787367893.920391:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808501376:0@lo:400:kworker.0 00010000:00010000:3.0:1787367894.361924:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367894.424552:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808503040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367894.424614:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367894.424622:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367894.424628:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808503168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367894.424654:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367894.424686:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808503168 00000100:00100000:0.0:1787367894.424686:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808503040 00000100:00100000:2.0:1787367894.424692:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808503168 00000100:00100000:0.0:1787367894.424692:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808503040 00000100:00100000:0.0:1787367894.424728:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787367894.424737:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808503040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367894.424763:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367894.425036:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808503040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 192us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367894.425044:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787367894.425185:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808503040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367894.425203:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367894.425210:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808503296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787367894.425236:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367894.426220:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808503296 00000100:00100000:2.0:1787367894.426228:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808503296 00000100:00100000:2.0:1787367894.426253:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787367894.426262:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808503168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367894.426279:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367894.426336:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808503168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367894.426343:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787367894.426369:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787367894.426387:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808503296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787367894.426403:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367894.426435:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808503296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367894.426441:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1787367894.426484:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c09880 x1874190808503296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367894.426493:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808503168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367894.426497:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808503296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367894.936659:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808503424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367894.936733:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367894.936931:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808503424 00000100:00100000:2.0:1787367894.936939:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808503424 00000100:00100000:2.0:1787367894.936986:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787367894.936996:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808503424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367894.937017:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367894.937070:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808503424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367894.937077:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1787367894.937160:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6370e00 x1874190808503424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367894.937178:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808503424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367895.386583:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367895.960809:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808503552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787367895.960876:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367895.962088:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808503552 00000100:00100000:2.0:1787367895.962105:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808503552 00000100:00100000:2.0:1787367895.962159:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787367895.962168:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808503552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367895.962201:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367895.962263:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808503552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367895.962272:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787367895.962628:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808503552:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787367896.409147:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367897.436925:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787367898.393019:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787367898.393877:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787367898.423973:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367898.424018:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367898.424110:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788490112 00000100:00100000:1.0:1787367898.424119:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788490112 00000100:00100000:1.0:1787367898.424174:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 371 00000100:00100000:1.0:1787367898.424183:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788490112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367898.424257:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788490112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367898.424265:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 371 00000100:00100000:2.0:1787367898.424411:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788490240 00000100:00100000:2.0:1787367898.424415:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788490240 00000100:00100000:2.0:1787367898.424463:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00100000:2.0:1787367898.424470:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788490240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367898.424516:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788490240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367898.424523:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00080000:1.0:1787367898.424613:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367898.433691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367898.433745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367898.433801:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788490368 00000100:00100000:1.0:1787367898.433809:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788490368 00000100:00100000:1.0:1787367898.433884:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:1.0:1787367898.433894:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788490368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367898.433965:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788490368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367898.433987:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:2.0:1787367898.434059:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788490496 00000100:00100000:2.0:1787367898.434063:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788490496 00000100:00100000:2.0:1787367898.434111:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1787367898.434119:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788490496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367898.434147:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788490496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367898.434152:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00080000:0.0:1787367898.434399:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367898.434405:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367898.436776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367898.436855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367898.436939:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788490624 00000100:00100000:1.0:1787367898.436948:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788490624 00000100:00100000:1.0:1787367898.437006:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788490752 00000100:00100000:1.0:1787367898.437009:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788490752 00000100:00100000:1.0:1787367898.437043:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:1.0:1787367898.437052:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788490624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367898.437119:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:3.0:1787367898.437132:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788490752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367898.437207:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788490752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367898.437216:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:1.0:1787367898.437274:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788490624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 222us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367898.437392:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00080000:0.0:1787367898.437658:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367898.437663:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787367898.457443:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367899.032667:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808504064:0@lo:400:kworker.0 00000100:00100000:0.0:1787367899.032738:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367899.032794:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808504576:0@lo:400:kworker.0 00000100:00100000:0.0:1787367899.032819:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367899.032836:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808505088:0@lo:400:kworker.0 00000100:00100000:0.0:1787367899.032854:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367899.032874:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787367899.032880:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808503936:0@lo:400:kworker.0 00000100:00100000:0.0:1787367899.032903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367899.032929:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808504448:0@lo:400:kworker.0 00000100:00100000:0.0:1787367899.032949:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367899.032961:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808504960:0@lo:400:kworker.0 00000100:00100000:0.0:1787367899.032977:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367899.033299:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808504576 00000100:00100000:1.0:1787367899.033308:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808504576 00000100:00100000:1.0:1787367899.033375:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808505088 00000100:00100000:1.0:1787367899.033379:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808505088 00000100:00100000:1.0:1787367899.033402:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787367899.033410:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808504576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367899.033475:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808504576:12345-0@lo:400:kworker.0 Request processed in 65us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367899.033482:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787367899.033497:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787367899.033503:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808505088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367899.033529:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808505088:12345-0@lo:400:kworker.0 Request processed in 27us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367899.033534:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787367899.033554:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808503936 00000100:00100000:1.0:1787367899.033557:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808503936 00000100:00100000:1.0:1787367899.033591:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787367899.033596:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808503936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367899.033628:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808503936:12345-0@lo:400:kworker.0 Request processed in 32us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367899.033634:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1787367899.033655:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367899.033659:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367899.033689:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808503936:0@lo:400:kworker.0 00010000:00080000:1.0:1787367899.033702:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b33480 x1874190808504576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367899.033712:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808504576:0@lo:400:kworker.0 00000100:00100000:1.0:1787367899.033722:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808505088:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.033862:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808503808:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.033893:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367899.033931:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808504320:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.033952:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367899.033963:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808504832:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.033982:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367899.034000:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787367899.034006:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808503680:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034028:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367899.034044:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808504192:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034065:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367899.034089:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808504704:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034110:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367899.034124:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808505216:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034155:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367899.034181:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808504064 00000100:00100000:2.0:1787367899.034185:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808504064 00000100:00100000:2.0:1787367899.034207:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808504448 00000100:00100000:2.0:1787367899.034209:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808504448 00000100:00100000:2.0:1787367899.034226:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808504960 00000100:00100000:2.0:1787367899.034228:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808504960 00000100:00100000:2.0:1787367899.034238:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808503808 00000100:00100000:2.0:1787367899.034240:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808503808 00000100:00100000:2.0:1787367899.034249:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808504320 00000100:00100000:2.0:1787367899.034251:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808504320 00000100:00100000:2.0:1787367899.034261:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808504832 00000100:00100000:2.0:1787367899.034263:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808504832 00000100:00100000:2.0:1787367899.034273:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787367899.034278:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808504064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034309:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808504064:12345-0@lo:400:kworker.0 Request processed in 30us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367899.034315:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787367899.034326:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787367899.034330:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808504448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034381:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808504448:12345-0@lo:400:kworker.0 Request processed in 23us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367899.034387:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787367899.034397:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787367899.034403:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808504960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034428:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808504960:12345-0@lo:400:kworker.0 Request processed in 25us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367899.034433:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787367899.034574:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787367899.034581:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808503808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034615:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808503808:12345-0@lo:400:kworker.0 Request processed in 35us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367899.034621:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787367899.034631:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787367899.034637:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808504320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034660:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808504320:12345-0@lo:400:kworker.0 Request processed in 24us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367899.034666:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787367899.034676:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787367899.034682:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808504832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034709:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808504832:12345-0@lo:400:kworker.0 Request processed in 28us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367899.034719:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787367899.034757:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808503808:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.034769:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808504320:0@lo:400:kworker.0 00000100:00100000:3.0:1787367899.034773:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808504192 00000100:00100000:3.0:1787367899.034780:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808504192 00000100:00100000:2.0:1787367899.034781:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808504832:0@lo:400:kworker.0 00000100:00100000:3.0:1787367899.034943:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787367899.034954:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808504192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367899.034996:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808503680 00000100:00100000:0.0:1787367899.035007:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808503680 00000100:00100000:3.0:1787367899.035014:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808504192:12345-0@lo:400:kworker.0 Request processed in 63us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367899.035032:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787367899.035036:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787367899.035045:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808503680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367899.035108:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808504704 00000100:00100000:1.0:1787367899.035111:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808504704 00000100:00100000:1.0:1787367899.035138:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808505216 00000100:00100000:1.0:1787367899.035141:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808505216 00000100:00100000:1.0:1787367899.035159:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787367899.035165:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808504704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367899.035201:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808504704:12345-0@lo:400:kworker.0 Request processed in 37us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367899.035206:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787367899.035216:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787367899.035222:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808505216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367899.035248:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808505216:12345-0@lo:400:kworker.0 Request processed in 27us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367899.035254:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787367899.035299:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367899.035303:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367899.035306:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367899.035308:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367899.035332:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00080000:1.0:1787367899.035337:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b30380 x1874190808504448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367899.035348:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808505344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367899.035351:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808504448:0@lo:400:kworker.0 00010000:00080000:1.0:1787367899.035398:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b31f80 x1874190808504960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367899.035409:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367899.035413:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808504960:0@lo:400:kworker.0 00000100:00100000:1.0:1787367899.035430:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808504064:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.035462:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808504192:0@lo:400:kworker.0 00010000:00080000:2.0:1787367899.035473:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b33b80 x1874190808504704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367899.035633:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808505344 00000100:00100000:3.0:1787367899.035639:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808505344 00000100:00100000:0.0:1787367899.035641:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808503680:12345-0@lo:400:kworker.0 Request processed in 597us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367899.035650:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787367899.035670:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787367899.035680:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808505344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367899.035705:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787367899.035752:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808505344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367899.035758:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787367899.035870:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808504704:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.035887:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808505216:0@lo:400:kworker.0 00000100:00100000:2.0:1787367899.035905:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808503680:0@lo:400:kworker.0 00000100:00100000:0.0:1787367899.035941:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808505344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787367899.482083:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367899.544789:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367899.544821:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808505472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367899.544904:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367899.544972:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808505472 00000100:00100000:1.0:1787367899.544979:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808505472 00000100:00100000:1.0:1787367899.545036:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787367899.545047:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808505472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367899.545084:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367899.545133:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808505472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367899.545140:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1787367899.545179:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6370e00 x1874190808505472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367899.545199:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808505472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367899.545276:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808505600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367899.545311:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367899.545334:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808505600 00000100:00100000:1.0:1787367899.545340:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808505600 00000100:00100000:1.0:1787367899.545386:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787367899.545393:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808505600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367899.545409:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367899.545446:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808505600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367899.545452:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787367899.545703:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367899.545715:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808505728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367899.545744:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367899.545792:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808505728 00000100:00100000:0.0:1787367899.545796:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808505728 00000100:00100000:0.0:1787367899.545824:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787367899.545832:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808505728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367899.545839:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808505600:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367899.545843:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367899.545889:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808505728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367899.545896:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787367899.545904:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808505728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367900.058405:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808505856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367900.058482:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367900.058651:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808505856 00000100:00100000:1.0:1787367900.058659:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808505856 00000100:00100000:1.0:1787367900.058728:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787367900.058739:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808505856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367900.058760:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367900.060524:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808505856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1777us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367900.060538:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1787367900.060786:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b32a00 x1874190808505856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367900.060809:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808505856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367900.505621:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367901.085233:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367901.085264:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808505984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787367901.085342:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367901.085528:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808505984 00000100:00100000:2.0:1787367901.085537:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808505984 00000100:00100000:2.0:1787367901.085593:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787367901.085603:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808505984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367901.085636:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367901.085689:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808505984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367901.085696:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787367901.085949:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808505984:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787367901.528600:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367902.554763:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367903.542794:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367903.542947:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788490880 00000100:00100000:1.0:1787367903.542957:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788490880 00000100:00100000:1.0:1787367903.543012:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 373 00000100:00100000:1.0:1787367903.543022:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788490880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367903.543117:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788490880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 96us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367903.543124:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 373 00000100:00100000:2.0:1787367903.555519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367903.555572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367903.555746:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788491008 00000100:00100000:3.0:1787367903.555755:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788491008 00000100:00100000:3.0:1787367903.555836:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788491136 00000100:00100000:3.0:1787367903.555840:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788491136 00000100:00100000:3.0:1787367903.555867:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:3.0:1787367903.555877:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788491008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367903.555960:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788491008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367903.555967:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:3.0:1787367903.555986:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:3.0:1787367903.555992:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788491136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367903.556017:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788491136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367903.556023:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:2.0:1787367903.556999:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367903.557066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367903.557175:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788491392 00000100:00100000:3.0:1787367903.557182:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788491392 00000100:00100000:3.0:1787367903.557237:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:3.0:1787367903.557247:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788491392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367903.557293:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788491392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367903.557299:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:3.0:1787367903.557715:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367903.557780:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788491520 00000100:00100000:2.0:1787367903.557784:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788491520 00000100:00100000:2.0:1787367903.557828:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00100000:2.0:1787367903.557840:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788491520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367903.557877:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788491520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367903.557883:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00080000:1.0:1787367903.558346:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367903.558351:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367903.558421:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788491264 00000100:00100000:1.0:1787367903.558426:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788491264 00000100:00100000:1.0:1787367903.558470:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1787367903.558478:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2401:x1874190788491264:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:1.0:1787367903.558497:0:8453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0308e5 00000100:00080000:1.0:1787367903.558506:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c55bd5d3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787367903.558551:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1787367903.558667:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+2:2401:x1874190788491264:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 189us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367903.558674:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00010000:00010000:1.0:1787367903.558691:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787367903.558740:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787367903.579920:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367904.152572:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367904.152605:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808506112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367904.152676:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367904.152871:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808506112 00000100:00100000:0.0:1787367904.152879:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808506112 00000100:00100000:0.0:1787367904.152930:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787367904.152940:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808506112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787367904.152971:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787367904.153051:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808506112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367904.153059:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787367904.153194:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808506112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367904.154372:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808506368:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154411:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808506624:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154417:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367904.154450:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808506880:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367904.154471:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367904.154484:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808507136:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154490:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808507392:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154508:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367904.154508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367904.154522:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808507648:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154523:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787367904.154527:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808506240:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367904.154549:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367904.154562:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787367904.154564:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808506752:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154566:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808506496:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367904.154591:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808507136 00000100:00100000:1.0:1787367904.154596:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808507136 00000100:00100000:2.0:1787367904.154611:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808507264:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154632:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367904.154647:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808507648 00000100:00100000:1.0:1787367904.154650:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808507648 00000100:00100000:2.0:1787367904.154651:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808506368 00000100:00100000:2.0:1787367904.154653:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808506368 00000100:00100000:2.0:1787367904.154672:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808506880 00000100:00100000:2.0:1787367904.154675:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808506880 00000100:00100000:1.0:1787367904.154675:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787367904.154684:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808507136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154700:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808507392 00000100:00100000:2.0:1787367904.154703:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808507392 00000100:00100000:2.0:1787367904.154712:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808506752 00000100:00100000:2.0:1787367904.154715:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808506752 00000100:00100000:1.0:1787367904.154724:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808507136:12345-0@lo:400:kworker.0 Request processed in 42us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367904.154725:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808507264 00000100:00100000:2.0:1787367904.154727:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808507264 00000100:00100000:2.0:1787367904.154738:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787367904.154739:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787367904.154744:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808506368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154753:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787367904.154757:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808507648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154777:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808506368:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367904.154781:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808507648:12345-0@lo:400:kworker.0 Request processed in 24us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367904.154784:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787367904.154786:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787367904.154796:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787367904.154802:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808506880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154818:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787367904.154825:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808507392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154827:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808506880:12345-0@lo:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367904.154832:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787367904.154843:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787367904.154848:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808506752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154848:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808507392:12345-0@lo:400:kworker.0 Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367904.154853:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787367904.154865:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787367904.154870:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808507264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154876:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808506752:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367904.154881:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787367904.154892:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808507264:12345-0@lo:400:kworker.0 Request processed in 22us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367904.154897:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787367904.154911:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367904.154912:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808506752:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.154922:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808507264:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154927:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808507008:0@lo:400:kworker.0 00010000:00080000:2.0:1787367904.154932:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cb9500 x1874190808507392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367904.154941:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808507392:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154946:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367904.154958:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808506368:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154959:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808507520:0@lo:400:kworker.0 00010000:00080000:2.0:1787367904.154967:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cb9880 x1874190808506880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367904.154975:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808506880:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.154975:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367904.154998:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808506496 00000100:00100000:2.0:1787367904.155001:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808506496 00010000:00080000:1.0:1787367904.155008:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cbad80 x1874190808507136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367904.155021:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787367904.155027:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808506496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.155028:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808507136:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.155059:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808507648:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.155066:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808506496:12345-0@lo:400:kworker.0 Request processed in 39us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367904.155071:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787367904.155075:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808506496:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.155087:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808507008 00000100:00100000:1.0:1787367904.155090:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808507008 00000100:00100000:1.0:1787367904.155109:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808507520 00000100:00100000:1.0:1787367904.155112:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808507520 00000100:00100000:1.0:1787367904.155128:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787367904.155134:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808507008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.155165:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808507008:12345-0@lo:400:kworker.0 Request processed in 32us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367904.155226:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808506624 00000100:00100000:0.0:1787367904.155231:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808506624 00000100:00100000:0.0:1787367904.155257:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787367904.155263:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808506624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367904.155296:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808506624:12345-0@lo:400:kworker.0 Request processed in 34us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367904.155302:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787367904.155319:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808506240 00000100:00100000:0.0:1787367904.155322:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808506240 00000100:00100000:0.0:1787367904.155344:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787367904.155349:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808506240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367904.155403:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808506240:12345-0@lo:400:kworker.0 Request processed in 53us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367904.155409:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:0.0:1787367904.155438:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367904.155441:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367904.155443:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367904.155445:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367904.155464:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808506240:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.155689:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787367904.155700:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808507520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.155734:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808507520:12345-0@lo:400:kworker.0 Request processed in 37us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367904.155740:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:2.0:1787367904.155771:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cbb100 x1874190808507008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367904.155781:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808507008:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.155789:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808507520:0@lo:400:kworker.0 00000100:00100000:2.0:1787367904.155798:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808506624:0@lo:400:kworker.0 00000100:00100000:1.0:1787367904.156334:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00010000:3.0:1787367904.602021:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367904.664775:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808507776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787367904.664860:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367904.665016:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808507776 00000100:00100000:1.0:1787367904.665024:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808507776 00000100:00100000:1.0:1787367904.665087:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787367904.665202:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808507776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367904.665228:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367904.665276:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808507776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (416us total) trans 0 rc 0/0 00010000:00080000:3.0:1787367904.665324:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836eb480 x1874190808507776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367904.665349:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808507776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367904.666192:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808507904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367904.666234:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367904.666904:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808508032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367904.666939:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367904.671239:0:8456:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787367904.671262:0:8456:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1787367904.671727:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787367904.671754:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808507904 00000100:00100000:1.0:1787367904.671762:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808507904 00000100:00100000:1.0:1787367904.671789:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808508032 00000100:00100000:1.0:1787367904.671791:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808508032 00000100:00100000:1.0:1787367904.671805:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787367904.671812:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808507904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787367904.671842:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367904.673034:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808507904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1219us (6796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367904.673056:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787367904.673080:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787367904.673103:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808508032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367904.673118:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367904.673190:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808508032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (6249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367904.673196:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787367904.673543:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808508032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367904.678006:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808507904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367905.178954:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367905.186060:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808508160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367905.186147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367905.186299:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808508160 00000100:00100000:3.0:1787367905.186308:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808508160 00000100:00100000:3.0:1787367905.186377:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787367905.186387:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808508160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367905.186515:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367905.186574:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808508160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367905.186580:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1787367905.186654:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b31c00 x1874190808508160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367905.186672:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808508160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787367905.624507:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367906.200581:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367906.200605:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808508288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367906.200686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367906.200794:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808508288 00000100:00100000:2.0:1787367906.200801:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808508288 00000100:00100000:2.0:1787367906.200854:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787367906.200864:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808508288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367906.200897:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367906.200944:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808508288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367906.200952:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787367906.201073:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808508288:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787367906.649639:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367907.673582:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787367908.633119:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787367908.633842:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787367908.660277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367908.660332:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367908.660402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367908.660422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367908.660450:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367908.660480:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788491776 00000100:00100000:2.0:1787367908.660480:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788492032 00000100:00100000:3.0:1787367908.660492:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788491776 00000100:00100000:2.0:1787367908.660492:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788492032 00000100:00100000:0.0:1787367908.660581:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788491904 00000100:00100000:0.0:1787367908.660598:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788491904 00000100:00100000:1.0:1787367908.660659:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788491648 00000100:00100000:1.0:1787367908.660664:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788491648 00000100:00100000:1.0:1787367908.660700:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 375 00000100:00100000:1.0:1787367908.660710:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788491648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367908.660792:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788491648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 83us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367908.660799:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 375 00000100:00100000:1.0:1787367908.660953:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788492160 00000100:00100000:1.0:1787367908.660957:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788492160 00000100:00100000:2.0:1787367908.660995:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 259 00000100:00100000:2.0:1787367908.661003:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788492032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367908.661049:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788492032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367908.661056:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 259 00000100:00100000:3.0:1787367908.664320:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 260 00000100:00100000:3.0:1787367908.664338:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788491776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367908.664477:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 261 00000100:00100000:0.0:1787367908.664489:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788491904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367908.664552:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788491904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (4128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367908.664560:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 261 00000100:00080000:0.0:1787367908.664703:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367908.664709:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367908.665000:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 262 00000100:00100000:1.0:1787367908.665023:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788492160:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367908.665066:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788492160:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 57us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367908.665073:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 262 00000100:00100000:2.0:1787367908.671351:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788491776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 7007us (11071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367908.671395:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 260 00010000:00010000:1.0:1787367908.698768:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367909.274343:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808508416:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.274428:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.274473:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808508928:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.274500:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.274518:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808509440:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.274539:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.274555:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808509952:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.274575:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.274598:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787367909.274604:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808508800:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.274628:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.274646:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808509312:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.274666:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.274695:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808509824:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.274718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.274756:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808508544:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.274780:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.274857:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808509056:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.274878:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.274894:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808509568:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.275199:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.275225:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787367909.275231:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808508672:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.275258:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.275276:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808509184:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.275295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.275305:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808509696:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.275323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.275351:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808508416 00000100:00100000:1.0:1787367909.275376:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808508416 00000100:00100000:1.0:1787367909.275423:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787367909.275432:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808508416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.275480:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808508416:12345-0@lo:400:kworker.0 Request processed in 49us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367909.275488:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787367909.275517:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808508928 00000100:00100000:1.0:1787367909.275521:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808508928 00000100:00100000:1.0:1787367909.275543:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808508672 00000100:00100000:1.0:1787367909.275546:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808508672 00000100:00100000:1.0:1787367909.275570:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787367909.275576:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808508928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.275611:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808508928:12345-0@lo:400:kworker.0 Request processed in 35us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367909.275617:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787367909.275628:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787367909.275634:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808508672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.275665:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808508672:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367909.275670:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787367909.275687:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808509440 00000100:00100000:1.0:1787367909.275690:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808509440 00000100:00100000:1.0:1787367909.275717:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808509952 00000100:00100000:1.0:1787367909.275720:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808509952 00000100:00100000:1.0:1787367909.275731:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808509312 00000100:00100000:1.0:1787367909.275733:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808509312 00000100:00100000:1.0:1787367909.275743:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808509824 00000100:00100000:2.0:1787367909.276402:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787367909.276420:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808509440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.276465:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808509440:12345-0@lo:400:kworker.0 Request processed in 48us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.276471:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787367909.276486:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787367909.276493:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808509952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.276518:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808509952:12345-0@lo:400:kworker.0 Request processed in 27us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.276525:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787367909.276535:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787367909.276541:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808509312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.276566:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808509312:12345-0@lo:400:kworker.0 Request processed in 27us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.276572:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787367909.276613:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808508800 00000100:00100000:2.0:1787367909.276618:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808508800 00000100:00100000:2.0:1787367909.276640:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808508544 00000100:00100000:2.0:1787367909.276644:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808508544 00000100:00100000:2.0:1787367909.276655:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808509056 00000100:00100000:2.0:1787367909.276657:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808509056 00000100:00100000:2.0:1787367909.276670:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808509568 00000100:00100000:2.0:1787367909.276672:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808509568 00000100:00100000:2.0:1787367909.276683:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808509184 00000100:00100000:2.0:1787367909.276686:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808509184 00000100:00100000:0.0:1787367909.277316:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808508672:0@lo:400:kworker.0 00010000:00080000:0.0:1787367909.277370:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f0000 x1874190808509312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367909.277382:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808509312:0@lo:400:kworker.0 00000100:00100000:0.0:1787367909.277394:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808508416:0@lo:400:kworker.0 00000100:00100000:0.0:1787367909.277407:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808508928:0@lo:400:kworker.0 00010000:00080000:0.0:1787367909.277417:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f0a80 x1874190808509440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367909.277426:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808509440:0@lo:400:kworker.0 00000100:00100000:0.0:1787367909.277437:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808509952:0@lo:400:kworker.0 00000100:00080000:0.0:1787367909.277476:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367909.277481:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367909.277484:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367909.278078:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808509824 00000100:00100000:1.0:1787367909.278132:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787367909.278140:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808509824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.279284:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808509696 00000100:00100000:2.0:1787367909.279291:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808509696 00000100:00100000:2.0:1787367909.279318:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787367909.279326:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808508800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.279447:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808508800:12345-0@lo:400:kworker.0 Request processed in 122us (4818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.279455:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787367909.279472:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787367909.279479:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808508544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.279510:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808508544:12345-0@lo:400:kworker.0 Request processed in 31us (4729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.279516:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787367909.279529:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787367909.279535:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808509056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.279562:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808509056:12345-0@lo:400:kworker.0 Request processed in 28us (4683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.279568:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787367909.279582:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787367909.279588:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808509568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.279614:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808509568:12345-0@lo:400:kworker.0 Request processed in 27us (4697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.279620:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787367909.279631:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787367909.279637:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808509184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.279664:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808509184:12345-0@lo:400:kworker.0 Request processed in 27us (4368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.279670:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787367909.279682:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787367909.279688:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808509696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367909.279723:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808509696:12345-0@lo:400:kworker.0 Request processed in 36us (4399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.279729:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787367909.279873:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808509824:12345-0@lo:400:kworker.0 Request processed in 1732us (5151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367909.279881:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1787367909.279904:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367909.279909:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367909.280386:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808508800:0@lo:400:kworker.0 00000100:00100000:0.0:1787367909.280401:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808509824:0@lo:400:kworker.0 00010000:00080000:0.0:1787367909.280454:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5481bc2300 x1874190808509184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367909.280464:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808509184:0@lo:400:kworker.0 00010000:00080000:0.0:1787367909.280474:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f2680 x1874190808509696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367909.280482:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808509696:0@lo:400:kworker.0 00000100:00100000:0.0:1787367909.280493:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808508544:0@lo:400:kworker.0 00000100:00100000:0.0:1787367909.280501:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808509056:0@lo:400:kworker.0 00000100:00100000:0.0:1787367909.280510:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808509568:0@lo:400:kworker.0 00000100:00100000:1.0:1787367909.281461:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808510080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367909.281507:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367909.281548:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808510080 00000100:00100000:1.0:1787367909.281562:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808510080 00000100:00100000:1.0:1787367909.281601:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787367909.281608:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808510080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787367909.281635:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787367909.281675:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808510080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367909.281681:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787367909.283284:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808510080:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787367909.720526:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367909.784489:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808510208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367909.784575:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367909.784663:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808510208 00000100:00100000:0.0:1787367909.784670:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808510208 00000100:00100000:0.0:1787367909.784722:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787367909.784732:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808510208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367909.784759:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367909.784801:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808510208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367909.784808:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787367909.784859:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808510208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367909.785940:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808510336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367909.785999:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367909.786182:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808510336 00000100:00100000:2.0:1787367909.786190:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808510336 00000100:00100000:0.0:1787367909.786217:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808510464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367909.786236:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787367909.786247:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808510336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367909.786260:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787367909.786267:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367909.786308:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808510464 00000100:00100000:0.0:1787367909.786313:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808510464 00000100:00100000:2.0:1787367909.786314:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808510336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367909.786336:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787367909.786405:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808510336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367909.788619:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787367909.788685:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808510464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367909.788719:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367909.788795:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808510464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367909.788803:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1787367909.790034:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b30000 x1874190808510464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367909.790062:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808510464:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1787367909.801543:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:2.0:1787367909.801551:0:9534:0:(genops.c:885:class_export_put()) final put ffff9c55bd5d6000/6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:1.0:1787367909.803076:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd5d6000/6033427c-dc64-421a-b37f-d4458dbaa527 for lustre-OST0001 00000020:00000080:1.0:1787367909.803168:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55bd5d3800 for lustre-OST0001 00000100:00100000:0.0:1787367910.296665:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367910.296690:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808510592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367910.297136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367910.297821:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808510592 00000100:00100000:1.0:1787367910.297832:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808510592 00000100:00100000:1.0:1787367910.297930:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787367910.297941:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808510592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367910.297965:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367910.298037:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808510592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367910.298045:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1787367910.298080:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc512680 x1874190808510592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367910.298101:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808510592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367910.744580:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367911.320537:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808510720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787367911.320608:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367911.320693:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808510720 00000100:00100000:1.0:1787367911.320701:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808510720 00000100:00100000:1.0:1787367911.320759:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787367911.320769:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808510720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787367911.320804:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787367911.320859:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808510720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367911.320867:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787367911.320964:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808510720:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787367911.628066:0:14076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:05:10 (1787367910) 00010000:00010000:1.0:1787367911.768629:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367912.794224:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367913.782487:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367913.782535:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367913.782551:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367913.782564:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367913.782584:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367913.782674:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788492288 00000100:00100000:2.0:1787367913.782683:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788492288 00000100:00100000:2.0:1787367913.782737:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 377 00000100:00100000:2.0:1787367913.782747:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788492288:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367913.782826:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788492288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 80us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367913.782834:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 377 00000100:00100000:2.0:1787367913.782867:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788492544 00000100:00100000:2.0:1787367913.782871:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788492544 00000100:00100000:2.0:1787367913.782899:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788492800 00000100:00100000:2.0:1787367913.782902:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788492800 00000100:00100000:2.0:1787367913.782913:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788492416 00000100:00100000:2.0:1787367913.782915:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788492416 00000100:00100000:2.0:1787367913.782924:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788492672 00000100:00100000:2.0:1787367913.782926:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788492672 00000100:00100000:2.0:1787367913.782937:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 269 00000100:00100000:2.0:1787367913.782942:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788492544:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367913.782972:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788492544:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367913.782989:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 269 00000100:00100000:2.0:1787367913.783002:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 270 00000100:00100000:2.0:1787367913.783008:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788492800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367913.783034:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788492800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367913.783039:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 270 00000100:00100000:2.0:1787367913.783049:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 271 00000100:00100000:2.0:1787367913.783055:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788492416:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367913.783080:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788492416:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367913.783095:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 271 00000100:00100000:2.0:1787367913.783108:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 272 00000100:00100000:2.0:1787367913.783114:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788492672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367913.783151:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788492672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367913.783157:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 272 00000100:00080000:1.0:1787367913.783570:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367913.783575:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787367913.816593:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367913.999502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367913.999660:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788492928 00000100:00100000:2.0:1787367913.999669:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788492928 00000100:00100000:2.0:1787367913.999749:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:2.0:1787367913.999761:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:11099:x1874190788492928:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367913.999781:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367913.999806:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff0309c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6b1 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367913.999868:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff0309cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367913.999882:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff0309cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367913.999895:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff0309cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367913.999939:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787367913.999943:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367913.999994:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff0309cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.000033:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff0309c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6b1 expref: 7 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.000051:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff0309cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6b1 expref: 6 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.000059:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55a01e4c00) 00010000:00010000:2.0:1787367914.000062:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367914.000065:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673200, rc 0) 00000100:00100000:2.0:1787367914.000125:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:11099:x1874190788492928:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 366us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.000132:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:2.0:1787367914.005866:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367914.006013:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788493056 00000100:00100000:3.0:1787367914.006024:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788493056 00000100:00100000:3.0:1787367914.006092:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:3.0:1787367914.006102:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:11100:x1874190788493056:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367914.006122:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367914.006153:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff0309d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6b8 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006210:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006224:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006239:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006251:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006258:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006282:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006340:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175c00/0x66f5679bff0309e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006349:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175c00/0x66f5679bff0309e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006393:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175c00/0x66f5679bff0309e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367914.006437:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787367914.006441:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787367914.006460:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175c00/0x66f5679bff0309e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006470:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006475:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006481:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006486:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367914.006489:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006496:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006515:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55a01e4c00) 00010000:00010000:3.0:1787367914.006517:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367914.006522:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006528:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff0309da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006541:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006547:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006552:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006556:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367914.006559:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006565:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006572:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c5483331800) 00010000:00010000:3.0:1787367914.006575:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367914.006578:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006583:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff0309e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006624:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff0309d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6b8 expref: 8 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006637:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175c00/0x66f5679bff0309e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6b8 expref: 7 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367914.006645:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c5483331b00) 00010000:00010000:3.0:1787367914.006647:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787367914.006649:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175c00, rc 0) 00000100:00100000:3.0:1787367914.006712:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:11100:x1874190788493056:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 612us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367914.006719:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:3.0:1787367914.014439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367914.014573:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788493184 00000100:00100000:1.0:1787367914.014582:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788493184 00000100:00100000:1.0:1787367914.014640:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1787367914.014650:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6033427c-dc64-421a-b37f-d4458dbaa527+7:11100:x1874190788493184:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787367914.014735:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6033427c-dc64-421a-b37f-d4458dbaa527+7:11100:x1874190788493184:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367914.014743:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1787367914.018456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367914.018552:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788493440 00000100:00100000:2.0:1787367914.018562:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788493440 00000100:00100000:2.0:1787367914.018628:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:2.0:1787367914.018639:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:11100:x1874190788493440:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367914.018658:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367914.018679:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff0309ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6bf expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.018749:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.018762:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.018789:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.018832:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.018840:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.018847:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.018949:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83c00/0x66f5679bff030a04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.018957:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83c00/0x66f5679bff030a04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.018963:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83c00/0x66f5679bff030a04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367914.018972:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787367914.019066:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019074:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019080:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019086:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367914.019096:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019104:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019117:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c5483331b00) 00010000:00010000:2.0:1787367914.019133:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367914.019137:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019143:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff0309f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019158:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019164:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019170:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019175:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367914.019178:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019183:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019190:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c55a01e4d00) 00010000:00010000:2.0:1787367914.019192:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367914.019201:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019207:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff0309fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019513:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff0309ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6bf expref: 10 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019529:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83c00/0x66f5679bff030a04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6bf expref: 9 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367914.019536:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:2.0:1787367914.019538:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367914.019540:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa83c00, rc 0) 00000100:00100000:2.0:1787367914.019599:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+9:11100:x1874190788493440:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 962us (1155us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787367914.019607:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1787367914.024027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367914.024188:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788493568 00000100:00100000:3.0:1787367914.024197:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788493568 00000100:00100000:3.0:1787367914.024251:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1787367914.024262:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+9:11100:x1874190788493568:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787367914.024399:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+9:11100:x1874190788493568:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 139us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367914.024408:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1787367914.026706:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367914.026878:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788493696 00000100:00100000:2.0:1787367914.026887:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788493696 00000100:00100000:2.0:1787367914.026948:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1787367914.026958:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:11100:x1874190788493696:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1787367914.028431:0:6539:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1415us 00000100:00100000:3.0:1787367914.042108:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:11100:x1874190788493696:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 15139us (15397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367914.042132:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:3.0:1787367914.393589:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808510848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367914.393660:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367914.394047:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808510848 00000100:00100000:1.0:1787367914.394054:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808510848 00000100:00100000:1.0:1787367914.394107:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787367914.394116:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808510848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787367914.394158:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787367914.394216:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808510848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367914.394223:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787367914.394295:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808510848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367914.395540:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808511232:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.395590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.395636:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808511744:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.395675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.395696:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808512256:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.395738:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.395762:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787367914.395768:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808511104:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.395789:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.395805:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808511616:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.395825:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.395840:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808512128:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.395860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.395889:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808511744 00000100:00100000:2.0:1787367914.395894:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808511744 00000100:00100000:2.0:1787367914.395935:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808512256 00000100:00100000:2.0:1787367914.395939:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808512256 00000100:00100000:2.0:1787367914.395960:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787367914.395968:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396023:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808511744:12345-0@lo:400:kworker.0 Request processed in 56us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396030:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787367914.396045:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787367914.396052:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808512256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396079:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808512256:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396084:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787367914.396104:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808511232 00000100:00100000:2.0:1787367914.396108:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808511232 00000100:00100000:2.0:1787367914.396124:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808511104 00000100:00100000:2.0:1787367914.396127:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808511104 00000100:00100000:2.0:1787367914.396137:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808511616 00000100:00100000:2.0:1787367914.396158:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808511616 00000100:00100000:2.0:1787367914.396179:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808512128 00000100:00100000:2.0:1787367914.396181:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808512128 00000100:00100000:2.0:1787367914.396194:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787367914.396199:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808511232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396230:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808511232:12345-0@lo:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396236:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787367914.396249:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787367914.396254:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808511104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396280:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808511104:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396285:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787367914.396296:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787367914.396302:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808511616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396327:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808511616:12345-0@lo:400:kworker.0 Request processed in 26us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396333:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787367914.396344:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787367914.396349:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808512128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396407:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808512128:12345-0@lo:400:kworker.0 Request processed in 58us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396413:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:2.0:1787367914.396433:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787367914.396437:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367914.396439:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367914.396455:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808510976:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396490:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.396511:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808511488:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396528:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.396542:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808512000:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396557:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.396571:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787367914.396576:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808511360:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396594:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.396608:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808511872:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396625:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.396636:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808512384:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396651:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367914.396672:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808511360 00000100:00100000:2.0:1787367914.396676:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808511360 00000100:00100000:2.0:1787367914.396703:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787367914.396710:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808511360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396742:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808511360:12345-0@lo:400:kworker.0 Request processed in 33us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396747:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787367914.396760:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808511872 00000100:00100000:2.0:1787367914.396763:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808511872 00000100:00100000:2.0:1787367914.396780:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808512384 00000100:00100000:2.0:1787367914.396783:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808512384 00000100:00100000:2.0:1787367914.396797:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787367914.396802:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808511872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396826:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808511872:12345-0@lo:400:kworker.0 Request processed in 24us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396838:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787367914.396848:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787367914.396853:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808512384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396875:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808512384:12345-0@lo:400:kworker.0 Request processed in 22us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396880:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787367914.396895:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808511488 00000100:00100000:2.0:1787367914.396898:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808511488 00000100:00100000:2.0:1787367914.396911:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808512000 00000100:00100000:2.0:1787367914.396913:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808512000 00000100:00100000:2.0:1787367914.396922:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787367914.396927:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808511488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.396949:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808511488:12345-0@lo:400:kworker.0 Request processed in 22us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.396954:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787367914.396963:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787367914.396968:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808512000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.397004:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808512000:12345-0@lo:400:kworker.0 Request processed in 36us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367914.397009:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:2.0:1787367914.397021:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367914.397023:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367914.397025:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367914.397055:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808511360:0@lo:400:kworker.0 00010000:00080000:2.0:1787367914.397067:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f5500 x1874190808511872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367914.397088:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808511872:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.397100:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808512384:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.397107:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808511488:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.397115:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808512000:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.397151:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808511104:0@lo:400:kworker.0 00010000:00080000:2.0:1787367914.397161:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b32a00 x1874190808511616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367914.397170:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808511616:0@lo:400:kworker.0 00010000:00080000:2.0:1787367914.397178:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f2a00 x1874190808512128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367914.397186:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808512128:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.397194:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808511232:0@lo:400:kworker.0 00010000:00080000:2.0:1787367914.397203:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f5c00 x1874190808511744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367914.397210:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808511744:0@lo:400:kworker.0 00000100:00100000:2.0:1787367914.397219:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808512256:0@lo:400:kworker.0 00000100:00100000:0.0:1787367914.397445:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808510976 00000100:00100000:0.0:1787367914.397450:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808510976 00000100:00100000:0.0:1787367914.397484:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787367914.397491:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808510976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367914.397541:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808510976:12345-0@lo:400:kworker.0 Request processed in 51us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367914.397546:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787367914.397625:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808510976:0@lo:400:kworker.0 00000040:00080000:1.0:1787367914.778523:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787367914.779381:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787367914.843503:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367914.904901:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808512512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367914.904980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367914.905127:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808512512 00000100:00100000:0.0:1787367914.905135:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808512512 00000100:00100000:0.0:1787367914.905187:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787367914.905196:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808512512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367914.905224:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367914.905268:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808512512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367914.905277:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787367914.905299:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808512640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367914.905323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367914.905342:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367914.905348:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808512768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367914.905389:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367914.905414:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808512640 00000100:00100000:0.0:1787367914.905418:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808512640 00000100:00100000:0.0:1787367914.905434:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808512768 00000100:00100000:0.0:1787367914.905436:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808512768 00000100:00100000:0.0:1787367914.905448:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787367914.905458:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808512640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367914.905473:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367914.905506:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808512640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367914.905512:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787367914.905522:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787367914.905529:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808512768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367914.905550:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367914.905579:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808512768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367914.905585:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787367914.905626:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808512768:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787367914.905653:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f2680 x1874190808512640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367914.907920:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808512640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367914.908000:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808512512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367915.416823:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367915.416845:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808512896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367915.416916:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367915.417003:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808512896 00000100:00100000:2.0:1787367915.417011:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808512896 00000100:00100000:2.0:1787367915.417322:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787367915.417332:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808512896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367915.417379:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367915.417426:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808512896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367915.417433:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:2.0:1787367915.417469:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cb9500 x1874190808512896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367915.417484:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808512896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367915.864560:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367916.233270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367916.233341:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788493824 00000100:00100000:3.0:1787367916.233349:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788493824 00000100:00100000:3.0:1787367916.233725:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:3.0:1787367916.233735:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+9:11142:x1874190788493824:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1787367916.233753:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367916.233771:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030a12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6c6 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.234191:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235187:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235205:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235283:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235291:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235298:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235338:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235346:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235352:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235374:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367916.235378:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235386:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235399:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55a01e4c00) 00010000:00010000:3.0:1787367916.235403:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367916.235407:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235413:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030a19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235426:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235433:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235439:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235451:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367916.235455:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235463:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235473:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c5483331400) 00010000:00010000:3.0:1787367916.235475:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367916.235479:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235485:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030a20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235528:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030a12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6c6 expref: 10 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235540:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55a01e4c00) 00010000:00010000:3.0:1787367916.235543:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367916.235548:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030a12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6c6 expref: 10 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.235562:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2174800, rc 0) 00000100:00100000:3.0:1787367916.235729:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+9:11142:x1874190788493824:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1993us (2466us total) trans 0 rc 301/301 00000100:00100000:3.0:1787367916.235738:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00080000:2.0:1787367916.236528:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367916.241856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367916.241899:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788494080 00000100:00100000:0.0:1787367916.241907:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788494080 00000100:00100000:0.0:1787367916.241975:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:0.0:1787367916.241986:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+9:11142:x1874190788494080:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1787367916.242041:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367916.242074:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff0309cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6b1 expref: 9 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.242092:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55a01e4c00) 00010000:00010000:0.0:1787367916.242105:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367916.242244:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.242258:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.242280:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.242297:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.242305:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.242312:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243041:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243054:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243062:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367916.243078:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f7bdaed reply state 00000000dadd6946 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243088:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243095:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:0.0:1787367916.243099:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367916.243102:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787367916.243107:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787367916.243114:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243207:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243214:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243221:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367916.243225:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243233:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243244:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:0.0:1787367916.243247:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367916.243251:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243256:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a27 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367916.243275:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f7bdaed reply state 00000000dadd6946 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243285:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.243291:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c55937a6200) 00010000:00010000:0.0:1787367916.243293:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367916.243295:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787367916.243488:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+10:11142:x1874190788494080:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 1502us (1635us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787367916.243504:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1787367916.337481:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.337621:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788494208 00000100:00100000:2.0:1787367916.337630:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788494208 00000100:00100000:2.0:1787367916.337742:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:2.0:1787367916.337754:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+10:11150:x1874190788494208:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:2.0:1787367916.337777:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.337798:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030a3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6cd expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.337861:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff030a43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.337875:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff030a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.337886:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff030a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367916.337941:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787367916.337945:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367916.337991:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff030a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.338026:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030a3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6cd expref: 12 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.338044:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff030a43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6cd expref: 11 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.338052:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:2.0:1787367916.338055:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367916.338058:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82a00, rc 0) 00000100:00100000:2.0:1787367916.338119:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+11:11150:x1874190788494208:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 367us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367916.338126:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:0.0:1787367916.435579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.436668:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788494336 00000100:00100000:2.0:1787367916.436680:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788494336 00000100:00100000:2.0:1787367916.436763:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:2.0:1787367916.436775:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+11:11156:x1874190788494336:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787367916.436796:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.436818:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030a4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6d4 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.436880:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.436913:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.436925:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.436939:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.436948:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.436955:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437042:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff030a5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437051:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff030a5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437058:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff030a5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367916.437092:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787367916.437096:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367916.437522:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff030a5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437536:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437554:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437561:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437567:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367916.437572:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437579:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437593:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:2.0:1787367916.437596:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367916.437601:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437607:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437621:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437628:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437635:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437640:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367916.437649:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437656:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437665:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c55937a6200) 00010000:00010000:2.0:1787367916.437668:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367916.437671:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437676:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437800:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030a4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6d4 expref: 13 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437814:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff030a5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6d4 expref: 12 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.437820:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367916.437823:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787367916.437825:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa83200, rc 0) 00000100:00100000:2.0:1787367916.437892:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+12:11156:x1874190788494336:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1119us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367916.437899:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:2.0:1787367916.440600:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808513024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787367916.440674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367916.440801:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808513024 00000100:00100000:1.0:1787367916.440809:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808513024 00000100:00100000:1.0:1787367916.440853:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787367916.440861:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808513024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787367916.440891:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787367916.440950:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808513024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367916.440967:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787367916.441014:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808513024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367916.446250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367916.446316:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788494592 00000100:00100000:0.0:1787367916.446334:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788494592 00000100:00100000:0.0:1787367916.446430:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1787367916.446441:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+12:11156:x1874190788494592:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367916.446461:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367916.446480:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a66 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6db expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.446573:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.446587:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.446597:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.446610:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.446617:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.446623:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787367916.446937:0:9404:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787367916.447076:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447098:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447105:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447594:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447603:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447611:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447617:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367916.447621:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447628:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447641:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:0.0:1787367916.447644:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367916.447648:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447911:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030a6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367916.447925:0:9404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0db938c reply state 00000000d1d06d46 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447945:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.447952:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55937a6500) 00010000:00010000:0.0:1787367916.447955:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367916.447967:0:9404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787367916.448001:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030a66 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6db expref: 15 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.448017:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6db expref: 14 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.448024:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55937a6300) 00010000:00010000:0.0:1787367916.448026:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367916.448028:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a400, rc 0) 00000100:00100000:0.0:1787367916.448098:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+15:11156:x1874190788494592:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1660us (1856us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787367916.448106:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:3.0:1787367916.452526:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.452620:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788494720 00000100:00100000:2.0:1787367916.452637:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788494720 00000100:00100000:2.0:1787367916.452679:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1787367916.452687:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874190788494720:12345-192.168.203.4@tcp:8:bash.0 00010000:00080000:2.0:1787367916.452718:0:8451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:2.0:1787367916.452751:0:8451:0:(genops.c:1385:class_connect()) connect: client 6033427c-dc64-421a-b37f-d4458dbaa527, cookie 0x66f5679bff030a89 00002000:00100000:2.0:1787367916.452761:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6033427c-dc64-421a-b37f-d4458dbaa527/ffff9c5483db3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787367916.452772:0:8451:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787367916.452833:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787367916.452859:0:8451:0:(import.c:65:import_set_state_nolock()) ffff9c5483db7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787367916.452918:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2401:x1874190788494720:12345-192.168.203.4@tcp:8:bash.0 Request processed in 225us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367916.452926:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:1.0:1787367916.474532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.474632:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788494848 00000100:00100000:2.0:1787367916.474640:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788494848 00000100:00100000:2.0:1787367916.474723:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1787367916.474734:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:0:x1874190788494848:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787367916.474752:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.474775:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6e2 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367916.474801:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787367916.474818:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1787367916.474823:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367916.474832:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e2 expref: 7 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.474872:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e2 expref: 7 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.474886:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82800, rc 0) 00000100:00100000:2.0:1787367916.474947:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:0:x1874190788494848:12345-192.168.203.4@tcp:101:bash.0 Request processed in 215us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367916.474969:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00080000:0.0:1787367916.475914:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367916.482820:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367916.482923:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788494976 00000100:00100000:0.0:1787367916.482932:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788494976 00000100:00100000:0.0:1787367916.482992:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1787367916.483002:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:11156:x1874190788494976:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367916.483028:0:8925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367916.483049:0:8925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6e9 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.483098:0:8925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e2 expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.483116:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367916.483121:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367916.483127:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.483161:0:8925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e2 expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.483174:0:8925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e2 expref: 8 pid: 8454 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367916.483189:0:8925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8925:1874190808513152:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367916.483289:0:8925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55811caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367916.491080:0:8925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8925:1874190808513152:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367916.491123:0:8925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.491144:0:8925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a600, rc 0) 00000100:00100000:0.0:1787367916.491201:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+8:11156:x1874190788494976:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8200us (8391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367916.491891:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1787367916.495639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367916.495753:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788495104 00000100:00100000:3.0:1787367916.495762:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788495104 00010000:00010000:3.0:1787367916.495802:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e2 expref: 8 pid: 8454 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367916.495841:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:3.0:1787367916.495850:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788495104:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367916.495864:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367916.495883:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e2 expref: 8 pid: 8454 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.495896:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e2 expref: 8 pid: 8454 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.495930:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cbd24b8/0x66f5679bff030a90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e2 expref: 8 pid: 8454 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.495947:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367916.495951:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367916.495967:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.495978:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.496011:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367916.496045:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585102a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6523:1874190808513280:192.168.203.4@tcp:105: 00000100:00100000:3.0:1787367916.496427:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367916.500813:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585102a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6523:1874190808513280:192.168.203.4@tcp:105: 00010000:00010000:3.0:1787367916.500835:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367916.500884:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788495104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 5035us (5254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367916.500895:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:1.0:1787367916.503771:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.503856:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788495360 00000100:00100000:2.0:1787367916.503865:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788495360 00000100:00100000:2.0:1787367916.503924:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1787367916.503934:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+15:11156:x1874190788495360:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:2.0:1787367916.504632:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+16:11156:x1874190788495360:12345-192.168.203.4@tcp:35:bash.0 Request processed in 692us (861us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787367916.504641:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1787367916.582972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.583064:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788495616 00000100:00100000:2.0:1787367916.583072:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788495616 00000100:00100000:2.0:1787367916.583135:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:2.0:1787367916.583144:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+16:11166:x1874190788495616:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367916.583166:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.583182:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6f0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367916.583279:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787367916.583393:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6f0 expref: 18 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.583420:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:2.0:1787367916.583423:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367916.583428:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6f0 expref: 18 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.583442:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa83e00, rc 0) 00000100:00100000:2.0:1787367916.583494:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+17:11166:x1874190788495616:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 352us (539us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1787367916.583501:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1787367916.591924:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.592019:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788495872 00000100:00100000:2.0:1787367916.592028:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788495872 00000100:00100000:2.0:1787367916.592088:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1787367916.592096:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+17:11166:x1874190788495872:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787367916.592304:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:11166:x1874190788495872:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 208us (397us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787367916.592313:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1787367916.663450:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.663550:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788496000 00000100:00100000:2.0:1787367916.663560:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788496000 00000100:00100000:2.0:1787367916.663620:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:2.0:1787367916.663631:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:11172:x1874190788496000:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367916.663664:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.663684:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030aac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6f7 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.663749:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030ab3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.663778:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.663790:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367916.663831:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787367916.663834:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367916.663852:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.663877:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030aac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6f7 expref: 20 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.663894:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6f7 expref: 19 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.663903:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367916.663906:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367916.663909:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82e00, rc 0) 00000100:00100000:2.0:1787367916.663973:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+19:11172:x1874190788496000:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 343us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367916.663980:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:1.0:1787367916.666885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.666967:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788496256 00000100:00100000:2.0:1787367916.666976:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788496256 00000100:00100000:2.0:1787367916.667033:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:2.0:1787367916.667043:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+19:11172:x1874190788496256:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367916.667062:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.667092:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030aba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e6fe expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.667198:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030ac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.667210:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.667222:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367916.667231:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787367916.667323:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030aba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6fe expref: 22 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.667339:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6fe expref: 21 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.667348:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55937a6300) 00010000:00010000:2.0:1787367916.667351:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367916.667373:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa83a00, rc 0) 00000100:00100000:2.0:1787367916.667427:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+21:11172:x1874190788496256:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 386us (551us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787367916.667435:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:1.0:1787367916.671732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367916.671773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.671886:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788496640 00000100:00100000:2.0:1787367916.671895:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788496640 00000100:00100000:2.0:1787367916.671953:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1787367916.671970:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+21:11172:x1874190788496640:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367916.672006:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.672034:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030acf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e705 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.672128:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030ad6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.672142:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.672152:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367916.672164:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787367916.672247:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030acf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e705 expref: 24 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.672264:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e705 expref: 23 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.672273:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55937a6300) 00010000:00010000:2.0:1787367916.672276:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787367916.672279:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673c00, rc 0) 00000100:00100000:2.0:1787367916.672331:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+23:11172:x1874190788496640:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 363us (609us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787367916.672339:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:3.0:1787367916.672798:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788496512 00000100:00100000:3.0:1787367916.672803:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788496512 00000100:00100000:3.0:1787367916.672842:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1787367916.672849:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+23:2404:x1874190788496512:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367916.672858:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367916.672872:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030ac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6fe expref: 23 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.672883:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55937a6300) 00010000:00010000:3.0:1787367916.672887:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367916.672905:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+22:2404:x1874190788496512:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 57us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367916.672912:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1787367916.681572:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.681664:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788496768 00000100:00100000:2.0:1787367916.681681:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788496768 00000100:00100000:2.0:1787367916.681734:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1787367916.681755:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788496768:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:2.0:1787367916.681794:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.681814:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.681823:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367916.681827:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367916.681833:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.681864:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.681877:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 7 pid: 8925 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367916.681890:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1874190808513408:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367916.681990:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482540f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367916.684992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367916.685159:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788496896 00000100:00100000:3.0:1787367916.685168:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788496896 00002000:00100000:3.0:1787367916.685211:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9c5483794700 x1874190788496896/t0(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:557/0 lens 504/0 e 0 to 0 dl 1787367927 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787367916.685242:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483794700 with x1874190788496896 ext(0->12) 00010000:00010000:3.0:1787367916.685251:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 8 pid: 8925 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.685267:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 8 pid: 8925 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787367916.685275:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c5483794700 00000100:00100000:3.0:1787367916.685312:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1787367916.685322:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788496896:12345-192.168.203.4@tcp:4:lfs.0 00000001:00100000:1.0:1787367916.687107:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000100:00100000:3.0:1787367916.687666:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+9:2402:x1874190788496896:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 2339us (2674us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787367916.688416:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00002000:00100000:3.0:1787367916.688430:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9c5483794700 x1874190788496896/t4294967300(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:557/0 lens 504/448 e 0 to 0 dl 1787367927 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787367916.688441:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483794700 with x1874190788496896 ext(0->12) 00010000:00010000:3.0:1787367916.688450:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 9 pid: 8925 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.688466:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 9 pid: 8925 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787367916.688474:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c5483794700 00000100:00100000:2.0:1787367916.689092:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1874190808513408:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367916.689118:0:8454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367916.691300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.691400:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788497024 00000100:00100000:2.0:1787367916.691409:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788497024 00010000:00010000:2.0:1787367916.691451:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 9 pid: 8925 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367916.691487:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1787367916.691496:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+9:2404:x1874190788497024:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367916.691508:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787367916.691524:0:6525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787367916.691527:0:6525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787367916 00002000:00010000:2.0:1787367916.691530:0:6525:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787367917 00002000:00010000:2.0:1787367916.691532:0:6525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787367916 00002000:00010000:2.0:1787367916.691534:0:6525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787367916.691539:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 9 pid: 8925 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.691552:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 9 pid: 8925 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.691807:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff030a97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6e9 expref: 9 pid: 8925 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.691828:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367916.691832:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367916.691838:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.691848:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.691937:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367916.691999:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2404:x1874190788497024:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 503us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367916.692007:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00010000:00010000:0.0:1787367916.692504:0:8454:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.692517:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.692542:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.692550:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.692558:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.692566:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787367916.692571:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.692580:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.692596:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.692604:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000157825ef/0x66f5679bff030ae4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367916.692683:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788496768:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 10928us (11119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367916.692703:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1787367916.695923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.696010:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788497280 00000100:00100000:2.0:1787367916.696019:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788497280 00000100:00100000:2.0:1787367916.696073:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1787367916.696082:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+22:11172:x1874190788497280:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:2.0:1787367916.696146:0:6542:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e705 expref: 22 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367916.697076:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1787367916.697120:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787367916.697408:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1787367916.697443:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.697461:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6db expref: 26 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.697470:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.697501:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6db expref: 26 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.697514:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6db expref: 26 pid: 9404 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367916.697535:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6542:1874190808513536:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367916.697608:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367916.701306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367916.701384:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788497408 00000100:00100000:3.0:1787367916.701401:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788497408 00010000:00010000:3.0:1787367916.701433:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6db expref: 27 pid: 9404 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367916.701464:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:3.0:1787367916.701472:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+27:2403:x1874190788497408:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367916.701486:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367916.701492:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6db expref: 27 pid: 9404 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.701504:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6db expref: 27 pid: 9404 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.701525:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55937a6300) 00010000:00010000:3.0:1787367916.701531:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.701539:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.701547:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367916.701564:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367916.701619:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+27:2403:x1874190788497408:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 148us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367916.701626:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00010000:00010000:2.0:1787367916.702851:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6db expref: 26 pid: 9404 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367916.702872:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6542:1874190808513536:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367916.702892:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.702900:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.702906:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367916.703011:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1787367916.703220:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787367916.703296:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808513664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787367916.703345:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367916.703479:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367916.704005:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808513664 00000100:00100000:1.0:1787367916.704061:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808513664 00000100:00100000:1.0:1787367916.704217:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787367916.704225:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6542:x1874190808513664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787367916.704316:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6542:x1874190808513664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367916.704339:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787367916.704353:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808513664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787367916.704519:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00080000:0.0:1787367916.704530:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367916.704571:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808513792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787367916.704845:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367916.704871:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482540f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367916.704889:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808513792 00000100:00100000:1.0:1787367916.704894:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808513792 00000100:00100000:1.0:1787367916.704928:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787367916.704935:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6542:x1874190808513792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787367916.705217:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6542:x1874190808513792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 282us (371us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787367916.705225:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787367916.705273:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808513792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787367916.705322:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1787367916.705349:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.705431:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.705439:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.705445:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367916.705448:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.705455:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.705469:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55937a6300) 00010000:00010000:2.0:1787367916.705472:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787367916.705477:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.705483:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030aeb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787367916.705564:0:6542:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787367916.707519:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787367916.707544:0:6542:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373995188058ns, next at 374995184458ns, rc = 0 00000001:00080000:2.0:1787367916.707559:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1787367916.707624:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55937a6300) 00010000:00010000:2.0:1787367916.707629:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787367916.707653:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030ad6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e705 expref: 30 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367916.707780:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+29:11172:x1874190788497280:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 11697us (12207us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787367916.707790:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000020:00080000:2.0:1787367916.707795:0:6542:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787367916.710747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.710856:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788497536 00000100:00100000:2.0:1787367916.710865:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788497536 00000100:00100000:2.0:1787367916.710917:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1787367916.710927:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+29:11172:x1874190788497536:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367916.711062:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.711085:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030af2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e70c expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.711139:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030af2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e70c expref: 30 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.711154:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030af2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e70c expref: 30 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.711182:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367916.711186:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367916.711189:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673200, rc 0) 00000100:00100000:2.0:1787367916.711252:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+30:11172:x1874190788497536:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 318us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367916.711259:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1787367916.714262:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367916.714341:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788497792 00000100:00100000:0.0:1787367916.714349:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788497792 00000100:00100000:0.0:1787367916.714406:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1787367916.714416:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+30:11172:x1874190788497792:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787367916.714798:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+31:11172:x1874190788497792:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 383us (543us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787367916.714807:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1787367916.776472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.776572:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788498048 00000100:00100000:2.0:1787367916.776594:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788498048 00000100:00100000:2.0:1787367916.776648:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:2.0:1787367916.776658:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+31:11182:x1874190788498048:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367916.776681:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.776699:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e713 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367916.776809:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787367916.776893:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030af9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e713 expref: 33 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.776907:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:2.0:1787367916.776910:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367916.776915:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e713 expref: 33 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.776929:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673c00, rc 0) 00000100:00100000:2.0:1787367916.776993:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+32:11182:x1874190788498048:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 338us (532us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1787367916.777001:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1787367916.781447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367916.781575:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788498176 00000100:00100000:0.0:1787367916.781585:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788498176 00000100:00100000:0.0:1787367916.781638:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:0.0:1787367916.781648:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+32:11182:x1874190788498176:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1787367916.781719:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781735:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781747:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781758:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781780:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781786:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781846:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781853:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781860:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367916.781903:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781914:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781921:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781928:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781934:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367916.781937:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781945:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781977:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:0.0:1787367916.781979:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367916.781984:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.781991:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782002:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782008:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782013:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782018:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367916.782021:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782027:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782034:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55937a6500) 00010000:00010000:0.0:1787367916.782036:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367916.782038:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782327:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782348:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782476:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782484:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782489:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367916.782492:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782499:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782507:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367916.782510:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367916.782513:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367916.782519:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367916.782587:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+32:11182:x1874190788498176:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 941us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367916.782595:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:1.0:1787367916.786430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367916.786506:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788498432 00000100:00100000:0.0:1787367916.786515:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788498432 00000100:00100000:0.0:1787367916.786557:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1787367916.786586:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+32:11182:x1874190788498432:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787367916.786781:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+33:11182:x1874190788498432:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 204us (358us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787367916.786788:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1787367916.811731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.811919:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788498688 00000100:00100000:2.0:1787367916.811929:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788498688 00000100:00100000:2.0:1787367916.811999:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1787367916.812010:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+33:11185:x1874190788498688:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367916.812040:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367916.812060:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030b1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e71a expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812161:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812186:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812198:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812210:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812217:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812224:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812519:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812529:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812537:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367916.812546:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787367916.812624:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812785:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812801:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812808:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367916.812812:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812820:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812832:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367916.812836:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367916.812840:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812847:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030b23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812861:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812867:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812874:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812879:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367916.812882:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812897:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812905:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55937a6500) 00010000:00010000:2.0:1787367916.812908:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367916.812911:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812917:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030b2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812952:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030b1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e71a expref: 36 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812981:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e71a expref: 35 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.812988:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367916.812990:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367916.812992:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82800, rc 0) 00000100:00100000:2.0:1787367916.813060:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+35:11185:x1874190788498688:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1052us (1338us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787367916.813068:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:1.0:1787367916.816785:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367916.817499:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788498816 00000100:00100000:2.0:1787367916.817511:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788498816 00000100:00100000:2.0:1787367916.817567:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1787367916.817587:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+35:11185:x1874190788498816:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1787367916.817667:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.817684:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.817696:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.817731:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.817738:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.817745:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.817750:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367916.817754:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.817762:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.817773:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367916.817777:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367916.817781:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367916.817788:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030b3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367916.817889:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+35:11185:x1874190788498816:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 312us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367916.817897:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:1.0:1787367916.820050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367916.820131:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788499072 00000100:00100000:0.0:1787367916.820140:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788499072 00000100:00100000:0.0:1787367916.820191:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1787367916.820200:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+35:11185:x1874190788499072:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787367916.820413:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+36:11185:x1874190788499072:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 213us (368us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787367916.820420:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00010000:00010000:2.0:1787367916.890519:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367917.086075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367917.086871:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788499328 00000100:00100000:0.0:1787367917.086881:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788499328 00000100:00100000:0.0:1787367917.086940:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:0.0:1787367917.086949:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+36:11216:x1874190788499328:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1787367917.086981:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367917.087000:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e721 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.087099:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.087113:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.087124:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367917.087151:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787367917.087262:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e721 expref: 39 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.087279:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e721 expref: 38 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.087287:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367917.087290:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367917.087293:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b000, rc 0) 00000100:00100000:0.0:1787367917.087350:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+38:11216:x1874190788499328:12345-192.168.203.4@tcp:101:cat.0 Request processed in 402us (1286us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787367917.087517:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:1.0:1787367917.095175:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367917.095227:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367917.095329:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788499584 00000100:00100000:0.0:1787367917.095338:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788499584 00000100:00100000:0.0:1787367917.095417:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1787367917.095426:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+38:11216:x1874190788499584:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:0.0:1787367917.095812:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+39:11216:x1874190788499584:12345-192.168.203.4@tcp:35:cat.0 Request processed in 386us (644us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787367917.095820:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1787367917.106109:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788499712 00000100:00100000:3.0:1787367917.106122:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788499712 00000100:00100000:3.0:1787367917.106210:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1787367917.106221:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afaded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+39:2405:x1874190788499712:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367917.106237:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367917.106274:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e721 expref: 39 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.106293:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:3.0:1787367917.106299:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367917.106352:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afaded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+38:2405:x1874190788499712:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 133us (11124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367917.106390:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1787367917.137140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367917.137389:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788499968 00000100:00100000:0.0:1787367917.137398:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788499968 00000100:00100000:0.0:1787367917.137455:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:0.0:1787367917.137464:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+38:11222:x1874190788499968:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1787367917.137486:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367917.137500:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787367917.137524:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030ab3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6f7 expref: 38 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.137542:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:0.0:1787367917.137546:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367917.137559:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b5b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e728 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.137665:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.137678:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e71a expref: 38 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.137687:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.137714:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e71a expref: 38 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.137726:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e71a expref: 38 pid: 6539 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367917.137738:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808513920:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367917.137822:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5581377480 going to sleep for 11 seconds 00000100:00100000:0.0:1787367917.147221:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808513920:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367917.147249:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367917.148535:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367917.148794:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788500096 00000100:00100000:3.0:1787367917.148802:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788500096 00010000:00010000:3.0:1787367917.148834:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e71a expref: 39 pid: 6539 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367917.148915:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1787367917.148924:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+39:2404:x1874190788500096:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367917.148939:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367917.148946:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e71a expref: 39 pid: 6539 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.148970:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e71a expref: 39 pid: 6539 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.148992:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030b31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e71a expref: 39 pid: 6539 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.149027:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:3.0:1787367917.149033:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.149042:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.149050:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.149080:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367917.149140:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+38:2404:x1874190788500096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 218us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367917.149148:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00010000:00010000:1.0:1787367917.149518:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.149527:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367917.149543:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787367917.149679:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b5b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e728 expref: 39 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.149694:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e728 expref: 38 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.149701:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:1.0:1787367917.149704:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787367917.149707:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b800, rc 0) 00000100:00100000:1.0:1787367917.149744:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+38:11222:x1874190788499968:12345-192.168.203.4@tcp:101:dd.0 Request processed in 12282us (12613us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787367917.149751:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:1.0:1787367917.159258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367917.159334:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788500224 00000100:00100000:0.0:1787367917.159343:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788500224 00000100:00100000:0.0:1787367917.159423:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:0.0:1787367917.159432:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+38:11222:x1874190788500224:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1787367917.159455:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367917.159472:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030b70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e72f expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.159503:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.159518:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.159528:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.159642:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030b70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e72f expref: 40 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.159661:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e72f expref: 39 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.159668:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367917.159671:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787367917.159674:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a800, rc 0) 00000100:00100000:0.0:1787367917.159724:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+39:11222:x1874190788500224:12345-192.168.203.4@tcp:101:dd.0 Request processed in 292us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367917.159739:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:2.0:1787367917.165523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367917.165609:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788500480 00000100:00100000:0.0:1787367917.165618:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788500480 00000100:00100000:0.0:1787367917.165664:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:0.0:1787367917.165674:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+39:11222:x1874190788500480:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1787367917.165858:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.165873:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.165883:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367917.165918:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1787367917.165937:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3672751 reply state 000000003b060bfe transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.165948:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.165966:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367917.165969:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367917.165972:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367917.166061:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+42:11222:x1874190788500480:12345-192.168.203.4@tcp:36:dd.0 Request processed in 388us (546us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787367917.166068:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000020:00080000:0.0:1787367917.166073:0:6540:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787367917.541454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367917.541548:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788500608 00000100:00100000:0.0:1787367917.541558:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788500608 00000100:00100000:0.0:1787367917.541642:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:0.0:1787367917.541651:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+42:11237:x1874190788500608:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:0.0:1787367917.541674:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367917.541692:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030b85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e736 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541752:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541766:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541787:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541798:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541805:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541811:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541874:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541886:0:9404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e728 expref: 43 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541894:0:9404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541929:0:9404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e728 expref: 43 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.541942:0:9404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e728 expref: 43 pid: 6538 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367917.541970:0:9404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808514048:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367917.542081:0:9404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5581377a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367917.551316:0:9404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808514048:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367917.551347:0:9404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367917.556938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367917.557394:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788500864 00000100:00100000:2.0:1787367917.557402:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788500864 00000100:00100000:2.0:1787367917.557461:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1787367917.557471:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+44:6184:x1874190788500864:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787367917.557756:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+45:6184:x1874190788500864:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 285us (826us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787367917.557765:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1787367917.561192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367917.561422:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788500992 00000100:00100000:2.0:1787367917.561432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788500992 00010000:00010000:2.0:1787367917.561469:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e728 expref: 45 pid: 6538 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367917.561510:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:2.0:1787367917.561519:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+45:2402:x1874190788500992:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367917.561534:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367917.561541:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e728 expref: 45 pid: 6538 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367917.561554:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e728 expref: 45 pid: 6538 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367917.561595:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030b62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e728 expref: 45 pid: 6538 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367917.561612:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367917.561618:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367917.561627:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367917.561634:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367917.561669:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367917.561718:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+44:2402:x1874190788500992:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 200us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367917.561726:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00010000:00010000:1.0:1787367917.562854:0:9404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.562867:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367917.562919:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787367917.562923:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367917.562975:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.562988:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.562997:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563024:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563031:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563037:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367917.563042:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563048:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563059:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:1.0:1787367917.563062:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367917.563065:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563071:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff030b8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563083:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563089:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563104:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563110:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367917.563119:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563126:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563135:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55937a6500) 00010000:00010000:1.0:1787367917.563137:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367917.563140:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563146:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030b93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563352:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030b85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e736 expref: 44 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563412:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e736 expref: 43 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367917.563420:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:1.0:1787367917.563423:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367917.563426:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b000, rc 0) 00000100:00100000:1.0:1787367917.563474:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+43:11237:x1874190788500608:12345-192.168.203.4@tcp:101:stat.0 Request processed in 21824us (22029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367917.563482:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1787367917.693044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367917.693185:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788501248 00000100:00100000:0.0:1787367917.693194:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788501248 00000100:00100000:0.0:1787367917.693251:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:0.0:1787367917.693261:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+43:11243:x1874190788501248:12345-192.168.203.4@tcp:36:truncate.0 00010000:00010000:0.0:1787367917.693319:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367917.693342:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030b9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e736 expref: 43 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.693397:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367917.693402:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367917.693540:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.693552:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.693696:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367917.693734:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1787367917.693751:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f79c91a5 reply state 0000000030d76678 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.693763:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367917.693768:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367917.693771:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367917.693781:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367917.693892:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+45:11243:x1874190788501248:12345-192.168.203.4@tcp:36:truncate.0 Request processed in 632us (856us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787367917.693900:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000020:00080000:0.0:1787367917.693906:0:6540:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787367917.884884:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367917.885048:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788501376 00000100:00100000:3.0:1787367917.885059:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788501376 00000100:00100000:3.0:1787367917.885130:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1787367917.885142:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+45:11257:x1874190788501376:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:3.0:1787367917.885165:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367917.885186:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030ba8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e73d expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885250:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885265:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885291:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885304:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885514:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885524:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885836:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885847:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885854:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367917.885897:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787367917.885901:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787367917.885921:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885933:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885940:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885967:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885974:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885981:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367917.885985:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.885992:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886003:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:3.0:1787367917.886006:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367917.886010:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886016:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030baf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886030:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886036:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886042:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886047:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367917.886059:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886066:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886075:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55937a6500) 00010000:00010000:3.0:1787367917.886077:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367917.886081:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886086:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886586:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030ba8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e73d expref: 47 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886604:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e73d expref: 46 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367917.886613:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:3.0:1787367917.886615:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367917.886626:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2174c00, rc 0) 00000100:00100000:3.0:1787367917.886699:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+46:11257:x1874190788501376:12345-192.168.203.4@tcp:101:stat.0 Request processed in 1558us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367917.886707:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00010000:00010000:0.0:1787367917.914384:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367918.051653:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367918.051765:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788501632 00000100:00100000:0.0:1787367918.051784:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788501632 00000100:00100000:0.0:1787367918.051876:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:0.0:1787367918.051886:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+46:11267:x1874190788501632:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367918.051904:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367918.051922:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e744 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367918.052020:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787367918.052110:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030bc4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e744 expref: 48 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.052143:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:0.0:1787367918.052146:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367918.052151:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e744 expref: 48 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.052164:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b000, rc 0) 00000100:00100000:0.0:1787367918.052228:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+47:11267:x1874190788501632:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 345us (586us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1787367918.052236:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00080000:2.0:1787367918.052500:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367918.059763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.060017:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788501888 00000100:00100000:2.0:1787367918.060026:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788501888 00000100:00100000:2.0:1787367918.060084:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1787367918.060096:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+47:11267:x1874190788501888:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787367918.060315:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+48:11267:x1874190788501888:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 222us (561us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1787367918.060324:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:3.0:1787367918.160609:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367918.160756:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788502144 00000100:00100000:1.0:1787367918.160989:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788502144 00000100:00100000:1.0:1787367918.161095:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1787367918.161121:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+48:11273:x1874190788502144:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1787367918.161148:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367918.161169:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff030bd2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e74b expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.161271:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.161285:0:9404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e73d expref: 49 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.161293:0:9404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.161337:0:9404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e73d expref: 49 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.161350:0:9404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e73d expref: 49 pid: 6539 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367918.161401:0:9404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585141180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808514176:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367918.161560:0:9404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548239c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787367918.170044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.170187:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788502272 00000100:00100000:2.0:1787367918.170196:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788502272 00010000:00010000:2.0:1787367918.170245:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e73d expref: 50 pid: 6539 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367918.170286:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1787367918.170295:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5590f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+50:2403:x1874190788502272:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367918.170320:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367918.170327:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e73d expref: 50 pid: 6539 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.170340:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e73d expref: 50 pid: 6539 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.170387:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367918.170393:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.170403:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.170412:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.170431:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367918.170502:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5590f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+50:2403:x1874190788502272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 206us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367918.170511:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00010000:00010000:0.0:1787367918.172232:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030bbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e73d expref: 49 pid: 6539 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367918.172256:0:9404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585141180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808514176:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367918.172279:0:9404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.172288:0:9404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.172293:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367918.172324:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787367918.172517:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff030bd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e74b expref: 50 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.172532:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e74b expref: 49 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.172553:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367918.172555:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787367918.172559:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031c00, rc 0) 00000100:00100000:0.0:1787367918.172606:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+49:11273:x1874190788502144:12345-192.168.203.4@tcp:101:bash.0 Request processed in 11487us (12006us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787367918.172623:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1787367918.183487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367918.183574:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788502528 00000100:00100000:0.0:1787367918.183584:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788502528 00000100:00100000:0.0:1787367918.183650:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:0.0:1787367918.183661:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+49:11273:x1874190788502528:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:0.0:1787367918.183892:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.183909:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.183932:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367918.183984:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1787367918.184020:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003aa7c803 reply state 0000000078ce9d9a transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.184033:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.184041:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367918.184044:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367918.184059:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367918.184164:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+52:11273:x1874190788502528:12345-192.168.203.4@tcp:36:bash.0 Request processed in 504us (928us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787367918.184172:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000020:00080000:0.0:1787367918.184177:0:6540:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787367918.191649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367918.191737:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788502656 00000100:00100000:3.0:1787367918.191747:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788502656 00000100:00100000:3.0:1787367918.191802:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1787367918.191825:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+52:11273:x1874190788502656:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787367918.191851:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367918.191870:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030bee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e752 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367918.191965:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367918.191985:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e74b expref: 53 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367918.191993:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367918.192037:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e74b expref: 53 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367918.192053:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e74b expref: 53 pid: 9404 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367918.192064:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585100380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808514304:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367918.192142:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367918.194486:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585100380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808514304:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367918.194526:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367918.195194:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.195607:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788502784 00000100:00100000:2.0:1787367918.195624:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788502784 00010000:00010000:2.0:1787367918.195659:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e74b expref: 54 pid: 9404 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367918.195694:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1787367918.195703:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+54:2403:x1874190788502784:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367918.195717:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367918.195723:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e74b expref: 54 pid: 9404 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.195736:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e74b expref: 54 pid: 9404 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.195757:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030bd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e74b expref: 54 pid: 9404 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.195773:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367918.195788:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.195797:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.195804:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.195912:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367918.196021:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+53:2403:x1874190788502784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 318us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367918.196030:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00010000:00010000:0.0:1787367918.197544:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.197559:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367918.197877:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787367918.197881:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367918.197901:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.197939:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030bee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e752 expref: 53 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.197972:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e752 expref: 52 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.197981:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367918.197984:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367918.197987:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175400, rc 0) 00000100:00100000:0.0:1787367918.198042:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+52:11273:x1874190788502656:12345-192.168.203.4@tcp:101:bash.0 Request processed in 6218us (6401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367918.198050:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1787367918.206470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.206627:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788503040 00000100:00100000:2.0:1787367918.206636:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788503040 00000100:00100000:2.0:1787367918.206692:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1787367918.206703:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+52:11273:x1874190788503040:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:2.0:1787367918.206928:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+53:11273:x1874190788503040:12345-192.168.203.4@tcp:35:bash.0 Request processed in 216us (456us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787367918.206936:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:1.0:1787367918.366161:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367918.366299:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788503296 00000100:00100000:0.0:1787367918.366308:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788503296 00000100:00100000:0.0:1787367918.366410:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:0.0:1787367918.366420:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+53:11283:x1874190788503296:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367918.366440:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367918.366458:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030bfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e759 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367918.366547:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787367918.366627:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030bfc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e759 expref: 55 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.366641:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:0.0:1787367918.366644:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367918.366648:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030bfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e759 expref: 55 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.366660:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a600, rc 0) 00000100:00100000:0.0:1787367918.366764:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+54:11283:x1874190788503296:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 344us (611us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1787367918.366771:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1787367918.375522:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367918.375620:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788503424 00000100:00100000:0.0:1787367918.375628:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788503424 00000100:00100000:0.0:1787367918.375686:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1787367918.375704:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+54:11283:x1874190788503424:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1787367918.375779:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375796:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375815:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375827:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375834:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375841:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375901:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375909:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375916:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367918.375970:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375982:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.375998:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376005:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376020:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367918.376024:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376031:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376043:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:0.0:1787367918.376045:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367918.376050:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376056:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376069:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376075:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376081:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376086:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367918.376318:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376327:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376346:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55937a6500) 00010000:00010000:0.0:1787367918.376348:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367918.376351:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376409:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376420:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376426:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376432:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376437:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ac00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367918.376440:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376444:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376452:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367918.376454:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367918.376457:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.376463:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367918.376544:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+54:11283:x1874190788503424:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 840us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367918.376553:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:3.0:1787367918.378461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367918.378537:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788503680 00000100:00100000:0.0:1787367918.378546:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788503680 00000100:00100000:0.0:1787367918.378597:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1787367918.378605:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+54:11283:x1874190788503680:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787367918.378810:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+55:11283:x1874190788503680:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 205us (355us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787367918.378818:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1787367918.448783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367918.448882:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788503936 00000100:00100000:0.0:1787367918.448891:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788503936 00000100:00100000:0.0:1787367918.448955:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:0.0:1787367918.448965:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+55:11286:x1874190788503936:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367918.448994:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367918.449019:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e760 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449084:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449107:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449118:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449145:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449153:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449168:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449266:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030c34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449276:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449283:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367918.449292:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787367918.449389:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449397:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449404:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449411:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367918.449415:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449431:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449442:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:0.0:1787367918.449445:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367918.449449:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449455:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030c26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449467:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449473:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449479:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449484:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367918.449487:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449492:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449498:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55937a6500) 00010000:00010000:0.0:1787367918.449500:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367918.449503:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449517:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030c2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449588:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e760 expref: 58 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449601:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e760 expref: 57 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.449608:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367918.449611:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367918.449613:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a200, rc 0) 00000100:00100000:0.0:1787367918.449669:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+57:11286:x1874190788503936:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 706us (895us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787367918.449677:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:1.0:1787367918.456453:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367918.456558:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788504064 00000100:00100000:0.0:1787367918.456576:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788504064 00000100:00100000:0.0:1787367918.456649:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:0.0:1787367918.456659:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+57:11286:x1874190788504064:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1787367918.456724:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.456742:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.456754:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.456807:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.456814:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.456820:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.456826:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ac00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367918.456831:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.456838:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.456861:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:0.0:1787367918.456864:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367918.456869:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367918.456876:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff030c42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367918.457184:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+57:11286:x1874190788504064:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 526us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367918.457193:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:3.0:1787367918.464296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.464420:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788504192 00000100:00100000:2.0:1787367918.464429:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788504192 00000100:00100000:2.0:1787367918.464490:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1787367918.464500:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+57:2402:x1874190788504192:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367918.464515:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367918.464539:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030c34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e760 expref: 57 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.464558:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367918.464563:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367918.464903:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+56:2402:x1874190788504192:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 402us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367918.464912:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1787367918.480240:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367918.481586:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788504448 00000100:00100000:0.0:1787367918.481600:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788504448 00000100:00100000:0.0:1787367918.481668:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1787367918.481691:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+56:11286:x1874190788504448:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787367918.481911:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+57:11286:x1874190788504448:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 221us (1679us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787367918.481931:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1787367918.845443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.846758:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788504704 00000100:00100000:2.0:1787367918.846784:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788504704 00000100:00100000:2.0:1787367918.846853:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:2.0:1787367918.846864:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+57:11304:x1874190788504704:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:2.0:1787367918.846899:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367918.846927:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030c49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e767 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.847041:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c50 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.847056:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.847070:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367918.847081:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787367918.847198:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030c49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e767 expref: 60 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.847215:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e767 expref: 59 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.847224:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367918.847227:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787367918.847231:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa83a00, rc 0) 00000100:00100000:2.0:1787367918.847300:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+59:11304:x1874190788504704:12345-192.168.203.4@tcp:101:cat.0 Request processed in 438us (1866us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1787367918.847307:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000040:00080000:1.0:1787367918.873201:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787367918.875534:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787367918.902398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.902437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.902475:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.902508:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.902533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.902560:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788505344 00000100:00100000:2.0:1787367918.902569:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788505344 00000100:00080000:2.0:1787367918.902606:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367918.902658:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788504960 00000100:00100000:2.0:1787367918.902662:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788504960 00000100:00080000:2.0:1787367918.902677:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367918.902689:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788505216 00000100:00100000:2.0:1787367918.902692:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788505216 00000100:00080000:2.0:1787367918.902703:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367918.902721:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 279 00000100:00100000:2.0:1787367918.902730:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788505344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367918.902802:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788505344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367918.902810:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 279 00000100:00100000:2.0:1787367918.902826:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 280 00000100:00100000:2.0:1787367918.902833:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788504960:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367918.902857:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788504960:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367918.902864:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 280 00000100:00100000:2.0:1787367918.902874:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 281 00000100:00100000:2.0:1787367918.902880:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788505216:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367918.902902:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788505216:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367918.903330:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788504832 00000100:00100000:3.0:1787367918.903335:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788504832 00000100:00100000:3.0:1787367918.903387:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 379 00000100:00100000:3.0:1787367918.903394:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788504832:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367918.903427:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788504832:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367918.903434:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 379 00000100:00100000:0.0:1787367918.903653:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788505088 00000100:00100000:0.0:1787367918.903658:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788505088 00000100:00100000:0.0:1787367918.903707:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:0.0:1787367918.903715:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2403:x1874190788505088:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367918.903752:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2403:x1874190788505088:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367918.903759:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00080000:3.0:1787367918.904166:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367918.904254:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 281 00000100:00100000:1.0:1787367918.912849:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.913019:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788505472 00000100:00100000:2.0:1787367918.913028:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788505472 00000100:00100000:2.0:1787367918.913090:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:2.0:1787367918.913099:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+59:11305:x1874190788505472:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367918.913123:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367918.913145:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030c5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e76e expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.913208:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030c65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.913222:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030c65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.913232:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030c65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367918.913272:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787367918.913275:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367918.913294:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030c65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.914181:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030c5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e76e expref: 61 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.914208:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030c65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e76e expref: 60 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.914238:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367918.914241:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367918.914245:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82800, rc 0) 00000100:00100000:2.0:1787367918.914503:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+60:11305:x1874190788505472:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1403us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367918.914512:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:0.0:1787367918.926199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367918.926334:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788505856 00000100:00100000:3.0:1787367918.926345:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788505856 00000100:00100000:3.0:1787367918.926693:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1787367918.926704:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+60:11305:x1874190788505856:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1787367918.927138:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+61:11305:x1874190788505856:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 434us (947us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787367918.927147:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00010000:00010000:0.0:1787367918.936585:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367918.942279:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.943424:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788505984 00000100:00100000:2.0:1787367918.943436:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788505984 00000100:00100000:2.0:1787367918.943501:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1787367918.943513:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+61:11305:x1874190788505984:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:2.0:1787367918.943529:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787367918.943555:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030bf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e752 expref: 61 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.943579:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e767 expref: 60 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.943591:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030af2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e70c expref: 59 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.943602:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367918.943608:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367918.943673:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+58:11305:x1874190788505984:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 162us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367918.943680:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1787367918.945823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367918.949337:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788506112 00000100:00100000:2.0:1787367918.949349:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788506112 00000100:00100000:2.0:1787367918.949425:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1787367918.949433:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+58:11305:x1874190788506112:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:2.0:1787367918.949545:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.949561:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367918.949573:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367918.949793:0:6540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367918.949950:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787367918.950040:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787367918.950117:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+58:11305:x1874190788506112:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 683us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367918.950125:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:3.0:1787367918.992278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367918.992787:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788506240 00000100:00100000:1.0:1787367918.992797:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788506240 00000100:00100000:1.0:1787367918.992901:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1787367918.992922:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+58:11307:x1874190788506240:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367918.992950:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367918.992971:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff030c73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e775 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993035:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993050:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993062:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993093:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993101:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993107:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993182:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993197:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993205:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367918.993242:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787367918.993245:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367918.993265:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993276:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993284:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993291:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.993298:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994013:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367918.994018:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994025:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994038:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:1.0:1787367918.994041:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367918.994054:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994061:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff030c7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994078:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994085:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994091:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994096:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367918.994099:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994105:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994112:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55937a6500) 00010000:00010000:1.0:1787367918.994114:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367918.994117:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994122:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030c81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994151:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff030c73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e775 expref: 60 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994179:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e775 expref: 59 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367918.994186:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:1.0:1787367918.994189:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367918.994191:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e800, rc 0) 00000100:00100000:1.0:1787367918.994266:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+59:11307:x1874190788506240:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1355us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367918.994275:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:3.0:1787367919.512506:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367919.512527:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808514432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367919.512593:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367919.512654:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808514432 00000100:00100000:3.0:1787367919.512661:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808514432 00000100:00100000:3.0:1787367919.512701:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787367919.512710:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808514432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367919.512756:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446268928 avail 1300029440 00000100:00100000:3.0:1787367919.512798:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808514432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367919.512828:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787367919.512867:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808514432:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1787367919.534223:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1787367919.534271:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787367919.534286:0:6517:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c55bd6cf840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787367919.534291:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c5582a63400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c5598227e40 00000020:00080000:2.0:1787367919.534294:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c5582a63c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c5584c0d200 00010000:00010000:2.0:1787367919.534340:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534352:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534399:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534405:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367919.534409:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534416:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534432:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c55937a6200) 00010000:00010000:2.0:1787367919.534435:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367919.534439:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534445:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff030a2e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534462:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534468:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534473:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534478:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367919.534481:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534497:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534506:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367919.534509:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367919.534512:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534517:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030a35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534532:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534538:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534544:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534548:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613be00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367919.534551:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534557:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534563:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55937a6500) 00010000:00010000:2.0:1787367919.534566:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367919.534569:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534581:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030a74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534596:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534603:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534610:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534615:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613aa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367919.534618:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534625:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534633:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367919.534635:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367919.534638:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534645:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030b7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534653:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534659:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534670:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534675:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367919.534679:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534684:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534692:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367919.534695:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367919.534697:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534704:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030ba1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534714:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534720:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534727:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534744:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367919.534747:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534763:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534772:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367919.534774:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367919.534777:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.534783:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030be7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367919.534880:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367919.534896:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808514560:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787367919.534968:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787367919.539065:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787367919.539244:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787367919.539265:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808514688:0@lo:400:kworker.0 00000100:00100000:0.0:1787367919.539331:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367919.539397:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808515200:0@lo:400:kworker.0 00000100:00100000:0.0:1787367919.539423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367919.539442:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808515712:0@lo:400:kworker.0 00000100:00100000:0.0:1787367919.539463:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367919.539486:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787367919.539491:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808514816:0@lo:400:kworker.0 00000100:00100000:0.0:1787367919.539513:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367919.539539:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808515328:0@lo:400:kworker.0 00000100:00100000:0.0:1787367919.539559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367919.539574:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808515840:0@lo:400:kworker.0 00000100:00100000:0.0:1787367919.539595:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367919.539623:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808514560 00000100:00100000:0.0:1787367919.539630:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808514560 00000100:00100000:0.0:1787367919.539685:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808515840 00000100:00100000:0.0:1787367919.539688:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808515840 00000100:00100000:0.0:1787367919.539712:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787367919.539722:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808515840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367919.539785:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808515840:12345-0@lo:400:kworker.0 Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367919.539793:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787367919.539808:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367919.539816:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afaddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808514560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787367919.539836:0:8454:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1787367919.539867:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8911ec, atime: 0x6a8911ed, ctime: 0x6a8911ec, blocks: 0x8 00010000:00010000:0.0:1787367919.539875:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367919.539890:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1787367919.539894:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367919.539900:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367919.539915:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367919.539946:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367919.539954:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367919.539973:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787367919.540076:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afaddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3651:x1874190808514560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 261us (5106us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787367919.540082:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367919.540121:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808515840:0@lo:400:kworker.0 00000100:00080000:3.0:1787367919.540432:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367919.540438:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367919.540454:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808515072:0@lo:400:kworker.0 00000100:00100000:3.0:1787367919.540487:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367919.540507:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808515584:0@lo:400:kworker.0 00000100:00100000:3.0:1787367919.540528:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367919.540540:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787367919.540546:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808514944:0@lo:400:kworker.0 00000100:00100000:3.0:1787367919.540564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367919.540575:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808515456:0@lo:400:kworker.0 00000100:00100000:3.0:1787367919.540594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367919.540612:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808515968:0@lo:400:kworker.0 00000100:00100000:3.0:1787367919.540644:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367919.540671:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808515456 00000100:00100000:3.0:1787367919.540676:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808515456 00000100:00100000:3.0:1787367919.540706:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808515968 00000100:00100000:3.0:1787367919.540708:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808515968 00000100:00100000:3.0:1787367919.540724:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787367919.540739:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808515456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367919.540777:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808515456:12345-0@lo:400:kworker.0 Request processed in 47us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367919.540783:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787367919.540798:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787367919.540810:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808515968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367919.540841:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808515968:12345-0@lo:400:kworker.0 Request processed in 31us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367919.540846:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1787367919.540862:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367919.540864:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367919.540883:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808515456:0@lo:400:kworker.0 00000100:00100000:3.0:1787367919.540893:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808515968:0@lo:400:kworker.0 00000100:00100000:1.0:1787367919.542317:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808515200 00000100:00100000:1.0:1787367919.542326:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808515200 00000100:00100000:1.0:1787367919.542645:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808515712 00000100:00100000:1.0:1787367919.542650:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808515712 00000100:00100000:1.0:1787367919.542666:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808514816 00000100:00100000:1.0:1787367919.542669:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808514816 00000100:00080000:3.0:1787367919.544276:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787367919.544283:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367919.544433:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808515328 00000100:00100000:1.0:1787367919.544441:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808515328 00000100:00100000:1.0:1787367919.544485:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808515584 00000100:00100000:1.0:1787367919.544489:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808515584 00000100:00100000:1.0:1787367919.544499:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808514944 00000100:00100000:1.0:1787367919.544501:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808514944 00000100:00100000:1.0:1787367919.544517:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787367919.544525:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808515200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367919.544604:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808515200:12345-0@lo:400:kworker.0 Request processed in 79us (5179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367919.544612:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787367919.544631:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787367919.544637:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808515712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367919.544686:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808515712:12345-0@lo:400:kworker.0 Request processed in 43us (5215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367919.544693:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787367919.544705:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787367919.544711:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808514816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367919.544750:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808514816:12345-0@lo:400:kworker.0 Request processed in 39us (5236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367919.544756:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787367919.544767:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787367919.544773:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808515328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367919.544797:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808515328:12345-0@lo:400:kworker.0 Request processed in 25us (5237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367919.544803:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787367919.544812:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787367919.544817:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808515584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367919.544847:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808515584:12345-0@lo:400:kworker.0 Request processed in 30us (4319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367919.544852:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787367919.544862:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787367919.544868:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808514944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367919.544894:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808514944:12345-0@lo:400:kworker.0 Request processed in 27us (4329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367919.544900:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787367919.546423:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808514816:0@lo:400:kworker.0 00010000:00080000:0.0:1787367919.546442:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483795500 x1874190808515328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367919.546451:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808515328:0@lo:400:kworker.0 00000100:00100000:0.0:1787367919.546464:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808515200:0@lo:400:kworker.0 00010000:00080000:0.0:1787367919.546474:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55912f2a00 x1874190808515712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367919.546482:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808515712:0@lo:400:kworker.0 00000004:00080000:2.0:1787367919.546577:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c55afaddf80/2, rc 0, transno 4294967302 00000100:00100000:2.0:1787367919.546584:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808514560:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787367919.546606:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808514688 00000100:00100000:2.0:1787367919.546612:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808514688 00000100:00100000:2.0:1787367919.546666:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787367919.546674:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808514688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367919.546749:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808514688:12345-0@lo:400:kworker.0 Request processed in 74us (7417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367919.546756:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:3.0:1787367919.546836:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367919.546841:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367919.546864:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808514944:0@lo:400:kworker.0 00000100:00100000:3.0:1787367919.546876:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55912f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808515584:0@lo:400:kworker.0 00010000:00010000:3.0:1787367919.547090:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367919.547099:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.547110:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367919.547115:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.547125:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.547146:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.547166:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff030c8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.547190:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367919.547192:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367919.547194:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367919.551657:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808514688:0@lo:400:kworker.0 00000100:00100000:1.0:1787367919.551786:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808515072 00000100:00100000:1.0:1787367919.551794:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808515072 00000100:00100000:1.0:1787367919.551893:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787367919.551903:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808515072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367919.552002:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808515072:12345-0@lo:400:kworker.0 Request processed in 101us (11513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367919.552010:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787367919.558233:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808515072:0@lo:400:kworker.0 00000040:00080000:2.0:1787367919.898947:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367919.898957:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367919.898994:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787367919.899007:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787367919.899129:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808516096:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367919.899886:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367919.914420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367919.914558:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808516096:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787367919.919986:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788506368 00000100:00100000:3.0:1787367919.920002:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788506368 00000100:00100000:3.0:1787367919.920104:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:3.0:1787367919.920116:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+12:11318:x1874190788506368:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787367919.920148:0:6539:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787367919.920277:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+12:11318:x1874190788506368:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 163us (5863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367919.920284:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:3.0:1787367919.935698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367919.935872:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788506496 00000100:00100000:1.0:1787367919.935882:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788506496 00000100:00100000:1.0:1787367919.935948:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:1.0:1787367919.935958:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+12:11318:x1874190788506496:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787367919.936029:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936045:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936057:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936129:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936138:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936144:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936169:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936191:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936198:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367919.936242:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787367919.936246:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367919.936261:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936272:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936279:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936285:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936291:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367919.936295:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936303:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936314:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:1.0:1787367919.936317:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367919.936322:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936337:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030c96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936351:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936543:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936549:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936554:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367919.936558:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936565:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936573:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9c5483604f00) 00010000:00010000:1.0:1787367919.936575:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367919.936578:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936584:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030c9d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936597:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936603:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936615:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936620:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367919.936623:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936629:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936638:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:1.0:1787367919.936641:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367919.936643:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.936649:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ca4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367919.936907:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+12:11318:x1874190788506496:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 949us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367919.936915:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:3.0:1787367919.942193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367919.942311:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788506752 00000100:00100000:1.0:1787367919.942321:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788506752 00000100:00100000:1.0:1787367919.942404:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:1.0:1787367919.942415:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+12:11318:x1874190788506752:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367919.942437:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367919.942457:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e77c expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942574:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942588:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942600:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367919.942610:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787367919.942684:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942693:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942700:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942705:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367919.942710:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942717:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942729:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:1.0:1787367919.942732:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367919.942736:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942764:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942909:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cab lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e77c expref: 14 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942920:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:1.0:1787367919.942922:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367919.942926:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e77c expref: 14 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.942953:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f600, rc 0) 00000100:00100000:1.0:1787367919.943008:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+13:11318:x1874190788506752:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 595us (823us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1787367919.943016:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:2.0:1787367919.951384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367919.951571:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788506880 00000100:00100000:3.0:1787367919.951580:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788506880 00000100:00100000:3.0:1787367919.951645:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:3.0:1787367919.951655:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+13:11318:x1874190788506880:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787367919.951691:0:6538:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787367919.952009:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+13:11318:x1874190788506880:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 355us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367919.952032:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:1.0:1787367919.964087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367919.964764:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788507136 00000100:00100000:3.0:1787367919.964783:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788507136 00000100:00100000:3.0:1787367919.964840:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:3.0:1787367919.964850:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+13:11318:x1874190788507136:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367919.964869:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367919.964872:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787367919.964897:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030c65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e76e expref: 13 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.964917:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:3.0:1787367919.964923:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367919.964947:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cc0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e783 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367919.965878:0:6539:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787367919.966216:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030cc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.966230:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.966240:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.966293:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cc0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e783 expref: 15 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.966327:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e783 expref: 14 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367919.966335:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c5483331400) 00010000:00010000:3.0:1787367919.966337:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367919.966339:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175a00, rc 0) 00000100:00100000:3.0:1787367919.967907:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+14:11318:x1874190788507136:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 3048us (3825us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787367919.967918:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00010000:00010000:0.0:1787367919.969588:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367919.983197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367919.983234:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788507392 00000100:00100000:1.0:1787367919.983242:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788507392 00000100:00100000:1.0:1787367919.983294:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:1.0:1787367919.983304:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+14:11318:x1874190788507392:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787367919.983374:0:9404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367919.983400:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030cc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e783 expref: 14 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.983416:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c5483331400) 00010000:00010000:1.0:1787367919.983844:0:9404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367919.983871:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.983885:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.983896:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.983910:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.983918:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.983925:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.983978:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.983986:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984584:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984594:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367919.984598:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984606:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984623:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:1.0:1787367919.984626:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367919.984630:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984636:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030cd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984647:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984652:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984657:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984662:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367919.984664:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984670:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984677:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa6e17c58 (ffff9c5483604f00) 00010000:00010000:1.0:1787367919.984679:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367919.984681:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367919.984687:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff030cdc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa6e17c58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367919.985894:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+13:11318:x1874190788507392:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 2584us (2807us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367919.985905:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00000040:00080000:0.0:1787367919.990291:0:14225:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367919.990300:0:14225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367919.990336:0:14225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787367919.990341:0:14225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787367919.991929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367919.992187:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788507520 00000100:00100000:2.0:1787367919.992196:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788507520 00000100:00100000:2.0:1787367919.992284:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:2.0:1787367919.992295:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+13:11318:x1874190788507520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367919.992315:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367919.992337:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030ce3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e78a expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.992388:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.992402:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.992413:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.992528:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030ce3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e78a expref: 15 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.992545:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e78a expref: 14 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367919.992553:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367919.992563:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787367919.992567:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82800, rc 0) 00000100:00100000:2.0:1787367919.992621:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+14:11318:x1874190788507520:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 327us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367919.992628:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:0.0:1787367920.003968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367920.009152:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788507776 00000100:00100000:1.0:1787367920.009167:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788507776 00000100:00100000:0.0:1787367920.009599:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:0.0:1787367920.009614:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+14:11318:x1874190788507776:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787367920.009688:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.009705:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.009715:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367920.009880:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787367920.009889:0:6539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377297532630ns, next at 378297530586ns, rc = 0 00000004:00010000:0.0:1787367920.009946:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3fe4271 reply state 000000002269338b transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.009959:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.009967:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367920.009970:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787367920.009974:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367920.010087:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+16:11318:x1874190788507776:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 469us (6116us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787367920.010095:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00080000:1.0:1787367920.011807:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367920.014671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367920.014733:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788507904 00000100:00100000:3.0:1787367920.014800:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788507904 00000100:00100000:3.0:1787367920.014853:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:3.0:1787367920.014863:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+16:11318:x1874190788507904:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367920.014884:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367920.014904:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e791 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.014970:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e791 expref: 17 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.014983:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e791 expref: 17 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.015071:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367920.015075:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367920.015151:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175600, rc 0) 00000100:00100000:3.0:1787367920.015209:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+17:11318:x1874190788507904:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 348us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367920.015217:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:0.0:1787367920.026716:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367920.027714:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808516224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367920.027856:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367920.027924:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808516352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367920.027975:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367920.028065:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367920.028073:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808516480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367920.028158:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367920.028194:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808516224 00000100:00100000:0.0:1787367920.028202:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808516224 00000100:00100000:0.0:1787367920.028236:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808516352 00000100:00100000:0.0:1787367920.028239:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808516352 00000100:00100000:0.0:1787367920.028249:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808516480 00000100:00100000:0.0:1787367920.028251:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808516480 00000100:00100000:0.0:1787367920.028265:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787367920.028274:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808516224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367920.028300:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787367920.028341:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808516224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367920.028349:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787367920.028387:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787367920.028395:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808516352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367920.028409:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367920.028580:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787367920.028590:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808516480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367920.028601:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787367920.028636:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808516480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367920.028642:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787367920.029979:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808516352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1578us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367920.034104:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787367920.034201:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808516224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367920.034240:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808516480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367920.034262:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808516352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367920.034757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367920.034831:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788508032 00000100:00100000:0.0:1787367920.034837:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788508032 00000100:00100000:0.0:1787367920.034877:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1787367920.034884:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874190788508032:12345-192.168.203.4@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787367920.034911:0:8454:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:0.0:1787367920.034948:0:8454:0:(genops.c:1385:class_connect()) connect: client 6033427c-dc64-421a-b37f-d4458dbaa527, cookie 0x66f5679bff030cff 00002000:00100000:0.0:1787367920.034959:0:8454:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6033427c-dc64-421a-b37f-d4458dbaa527/ffff9c5483744800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787367920.034968:0:8454:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787367920.035045:0:8454:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787367920.035070:0:8454:0:(import.c:65:import_set_state_nolock()) ffff9c5483746000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367920.035123:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2401:x1874190788508032:12345-192.168.203.4@tcp:8:lhsmtool_posix.0 Request processed in 238us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367920.035131:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:1.0:1787367920.045295:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367920.045405:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788508160 00000100:00100000:2.0:1787367920.045415:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788508160 00000100:00100000:2.0:1787367920.045622:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1787367920.045633:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:0:x1874190788508160:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787367920.049328:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787367920.051120:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1787367920.051132:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000100:00100000:3.0:1787367920.052257:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:0:x1874190788508160:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 6618us (6962us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787367920.052269:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:0.0:1787367920.060769:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367920.060851:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788508416 00000100:00100000:1.0:1787367920.060861:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788508416 00000100:00100000:1.0:1787367920.060916:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1787367920.060926:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+17:11318:x1874190788508416:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787367920.061160:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:11318:x1874190788508416:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 234us (400us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1787367920.061169:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1787367920.080269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367920.080386:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788508672 00000100:00100000:1.0:1787367920.080396:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788508672 00000100:00100000:1.0:1787367920.080462:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:1.0:1787367920.080472:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+18:11318:x1874190788508672:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787367920.081201:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+18:11318:x1874190788508672:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 727us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367920.081211:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:3.0:1787367920.106905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367920.107056:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788508800 00000100:00100000:2.0:1787367920.107067:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788508800 00000100:00100000:2.0:1787367920.107137:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:2.0:1787367920.107149:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+18:11318:x1874190788508800:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367920.107169:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367920.107189:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030d06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e798 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.107253:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030d0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.107268:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.107278:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367920.107321:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367920.107339:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.107405:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030d06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e798 expref: 20 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.107422:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030d0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e798 expref: 19 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.107430:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367920.107433:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787367920.107437:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa82e00, rc 0) 00000100:00100000:2.0:1787367920.107489:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+19:11318:x1874190788508800:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 342us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367920.107496:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:1.0:1787367920.123230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367920.123311:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788508928 00000100:00100000:3.0:1787367920.123321:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788508928 00000100:00100000:3.0:1787367920.123392:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:3.0:1787367920.123403:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788508928:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367920.123420:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367920.123443:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e79f expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787367920.123468:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8911f0, blocks: 0x0 00010000:00010000:3.0:1787367920.123487:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787367920.123491:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367920.123501:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e79f expref: 6 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.123534:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e79f expref: 6 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.123548:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175a00, rc 0) 00000100:00100000:3.0:1787367920.124928:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788508928:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1520us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367920.124948:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1787367920.130703:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367920.130915:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788509184 00000100:00100000:0.0:1787367920.130925:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788509184 00000100:00100000:0.0:1787367920.131005:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:0.0:1787367920.131016:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:11318:x1874190788509184:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787367920.131128:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:11318:x1874190788509184:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 113us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367920.131136:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:0.0:1787367920.135728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367920.137225:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788509312 00000100:00100000:1.0:1787367920.137237:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788509312 00000100:00100000:1.0:1787367920.137299:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1787367920.137309:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:11318:x1874190788509312:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367920.137327:0:8925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367920.137346:0:8925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7a6 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.137405:0:8925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e79f expref: 7 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.137414:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367920.137418:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367920.137424:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.137473:0:8925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e79f expref: 7 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.137489:0:8925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e79f expref: 7 pid: 8454 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367920.137504:0:8925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8925:1874190808516608:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367920.137604:0:8925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548239cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367920.149211:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367920.150180:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788509440 00000100:00100000:3.0:1787367920.150193:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788509440 00010000:00010000:3.0:1787367920.150237:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e79f expref: 8 pid: 8454 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367920.150294:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1787367920.150304:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788509440:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367920.150320:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367920.150341:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e79f expref: 8 pid: 8454 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.150376:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e79f expref: 8 pid: 8454 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.150402:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367920.150407:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367920.150415:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.150433:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.150471:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367920.150484:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483647800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874190808516736:192.168.203.4@tcp:105: 00000100:00100000:3.0:1787367920.150562:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58a80 going to sleep for 11 seconds 00010000:00010000:0.0:1787367920.153215:0:8925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026fb6dbd/0x66f5679bff030d14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e79f expref: 8 pid: 8454 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367920.153242:0:8925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8925:1874190808516608:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367920.153272:0:8925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.153287:0:8925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fe00, rc 0) 00000100:00100000:0.0:1787367920.154407:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:11318:x1874190788509312:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 17094us (18681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367920.154419:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1787367920.162805:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483647800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874190808516736:192.168.203.4@tcp:105: 00010000:00010000:2.0:1787367920.162830:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367920.162874:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788509440:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 12570us (14888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367920.162886:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:0.0:1787367920.170060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367920.174845:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788509568 00000100:00100000:2.0:1787367920.174859:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788509568 00002000:00100000:2.0:1787367920.174905:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c5483ea0380 x1874190788509568/t0(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:561/0 lens 504/0 e 0 to 0 dl 1787367931 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367920.174917:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483ea0380 with x1874190788509568 ext(0->8) 00002000:00010000:2.0:1787367920.174922:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483ea0380 00000100:00100000:2.0:1787367920.174967:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1787367920.174983:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788509568:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787367920.176314:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2403:x1874190788509568:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 1326us (6323us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787367920.176325:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00002000:00100000:2.0:1787367920.176335:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c5483ea0380 x1874190788509568/t4294967303(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:561/0 lens 504/448 e 0 to 0 dl 1787367931 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367920.176345:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483ea0380 with x1874190788509568 ext(0->8) 00002000:00010000:2.0:1787367920.176350:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483ea0380 00000100:00100000:3.0:1787367920.188142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367920.188225:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788509696 00000100:00100000:0.0:1787367920.188234:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788509696 00000100:00100000:0.0:1787367920.188292:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:0.0:1787367920.188301:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+19:11318:x1874190788509696:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787367920.190338:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1787367920.190352:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787367920.190391:0:6517:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787367920.190476:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787367920.190486:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787367920.190501:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808516864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787367920.190562:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367920.190612:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808516864 00000100:00100000:0.0:1787367920.190618:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808516864 00000100:00100000:0.0:1787367920.190670:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787367920.190679:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808516864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787367920.190799:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787367920.190803:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787367920 00002000:00010000:0.0:1787367920.190806:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787367920.190808:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787367920 -> 1787367920 00002000:00010000:0.0:1787367920.190810:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787367920.190848:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808516864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (285us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787367920.190855:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1787367920.190895:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c5483ea3480/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787367920.190901:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808516864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787367920.191004:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+15:11318:x1874190788509696:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 2692us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367920.191014:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00010000:00010000:3.0:1787367920.191508:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.191519:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.191526:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.191532:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613aa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367920.191536:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.191543:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.191557:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367920.191560:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787367920.191574:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.191581:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030cf1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367920.193288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367920.193384:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788509824 00000100:00100000:3.0:1787367920.193393:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788509824 00000100:00100000:3.0:1787367920.193435:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:3.0:1787367920.193445:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2403:x1874190788509824:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787367920.196895:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787367920.196907:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1787367920.197261:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788509824:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 3812us (3976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367920.197271:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:0.0:1787367920.202881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367920.203207:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788510080 00000100:00100000:3.0:1787367920.203218:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788510080 00000100:00100000:3.0:1787367920.203281:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:3.0:1787367920.203292:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+14:11318:x1874190788510080:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787367920.203345:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367920.203404:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030d0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e798 expref: 14 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.203421:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367920.203426:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367920.203528:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.203541:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.203552:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367920.203681:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d5cef2a reply state 00000000aee03fe9 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.203708:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.203715:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367920.203718:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787367920.203721:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367920.203921:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+15:11318:x1874190788510080:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 630us (1046us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787367920.203929:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:3.0:1787367920.206612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367920.206753:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788510208 00000100:00100000:0.0:1787367920.206761:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788510208 00000100:00100000:0.0:1787367920.206813:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1787367920.206822:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b62fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788510208:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787367920.206974:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787367920.206978:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787367920 -> 1787367918 00002000:00010000:0.0:1787367920.206980:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787367917 00002000:00010000:0.0:1787367920.207004:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787367920 -> 1787367918 00002000:00010000:0.0:1787367920.207006:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787367920.207063:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b62fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788510208:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 240us (458us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787367920.207071:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1787367920.212567:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367920.212644:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788510464 00000100:00100000:3.0:1787367920.212653:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788510464 00000100:00100000:3.0:1787367920.212705:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:3.0:1787367920.212714:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+15:11318:x1874190788510464:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787367920.212855:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.212871:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e78a expref: 15 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.212880:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.212908:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e78a expref: 15 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.212920:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e78a expref: 15 pid: 6540 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367920.212956:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483647480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808516992:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367920.213568:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367920.218408:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367920.218618:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483647480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808516992:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367920.218642:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367920.218816:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788510592 00000100:00100000:0.0:1787367920.218823:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788510592 00010000:00010000:0.0:1787367920.218858:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e78a expref: 16 pid: 6540 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367920.218896:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:0.0:1787367920.218905:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+16:2402:x1874190788510592:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367920.218919:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367920.218925:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e78a expref: 16 pid: 6540 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.218949:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e78a expref: 16 pid: 6540 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.218969:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030cea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e78a expref: 16 pid: 6540 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.218982:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367920.218987:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.219139:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.219155:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.219213:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367920.219265:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+15:2402:x1874190788510592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 361us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367920.219274:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00010000:00010000:3.0:1787367920.220329:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.220340:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.220540:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.220548:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.220554:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.220560:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367920.220565:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.220572:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.220842:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367920.220853:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787367920.220858:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.220863:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d29 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367920.220965:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+14:11318:x1874190788510464:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 8249us (8403us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787367920.220974:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:1.0:1787367920.223313:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367920.223498:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788510720 00000100:00100000:0.0:1787367920.223507:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788510720 00000100:00100000:0.0:1787367920.223585:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:0.0:1787367920.223595:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:2403:x1874190788510720:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787367920.223632:0:8925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.223652:0:8925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.223661:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367920.223665:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367920.223670:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.223701:0:8925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.223714:0:8925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 7 pid: 8925 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367920.225163:0:8925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8925:1874190808517120:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367920.225259:0:8925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5581377a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367920.240232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367920.240272:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788510848 00000100:00100000:1.0:1787367920.240281:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788510848 00010000:00010000:1.0:1787367920.240319:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 8 pid: 8925 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367920.240378:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:1.0:1787367920.240388:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788510848:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367920.240405:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367920.240425:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 8 pid: 8925 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.240451:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 8 pid: 8925 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.240476:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367920.240481:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367920.240489:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.240500:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.240519:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367920.240568:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788510848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 182us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367920.240589:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00010000:00010000:3.0:1787367920.241350:0:8925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186b4e3a/0x66f5679bff030d1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7a6 expref: 7 pid: 8925 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367920.241388:0:8925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8925:1874190808517120:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367920.241410:0:8925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.241421:0:8925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.241436:0:8925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.241457:0:8925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.241465:0:8925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.241481:0:8925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.241488:0:8925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ac00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367920.241492:0:8925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.241499:0:8925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.241513:0:8925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.241520:0:8925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff030d30 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367920.241581:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788510720:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 17988us (18275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367920.241589:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1787367920.246201:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367920.246421:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788511104 00000100:00100000:3.0:1787367920.246439:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788511104 00000100:00100000:3.0:1787367920.246487:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:3.0:1787367920.246496:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+14:11318:x1874190788511104:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787367920.246563:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.246587:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e72f expref: 14 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.246597:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.246627:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e72f expref: 14 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.246639:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e72f expref: 14 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367920.246651:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483647480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808517248:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367920.246712:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367920.255732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367920.256837:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788511232 00000100:00100000:1.0:1787367920.256848:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788511232 00010000:00010000:1.0:1787367920.256886:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e72f expref: 15 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367920.256922:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:1.0:1787367920.256941:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55833d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+15:2403:x1874190788511232:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367920.256956:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367920.256963:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e72f expref: 15 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.256975:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e72f expref: 15 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.257005:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:1.0:1787367920.257011:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.257021:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.257028:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.257045:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367920.257109:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55833d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+15:2403:x1874190788511232:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 178us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367920.257124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00010000:00010000:3.0:1787367920.258656:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030b77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e72f expref: 14 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367920.258677:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483647480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808517248:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367920.258698:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.258707:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.258712:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.258870:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.258889:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e791 expref: 14 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.258897:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.258930:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e791 expref: 14 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367920.258954:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e791 expref: 14 pid: 6539 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367920.258967:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483647480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808517376:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367920.259046:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367920.263376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367920.263462:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788511360 00000100:00100000:1.0:1787367920.263471:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788511360 00010000:00010000:1.0:1787367920.263508:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e791 expref: 15 pid: 6539 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367920.263547:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:1.0:1787367920.263556:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+15:2402:x1874190788511360:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367920.263570:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367920.263587:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e791 expref: 15 pid: 6539 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.263599:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e791 expref: 15 pid: 6539 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.263620:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367920.263625:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.263635:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.263642:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.263659:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367920.263705:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+15:2402:x1874190788511360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 150us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367920.263729:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00010000:00010000:1.0:1787367920.263874:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030cf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e791 expref: 14 pid: 6539 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367920.263888:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483647480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808517376:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367920.263906:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.263914:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.263919:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367920.264038:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1787367920.264154:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1787367920.264190:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1787367920.264276:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6538:1874190808517504:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787367920.264322:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367920.264350:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548239c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367920.264397:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808517504 00000100:00100000:1.0:1787367920.264403:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808517504 00000100:00100000:1.0:1787367920.264435:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787367920.264442:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6538:x1874190808517504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787367920.264516:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6538:x1874190808517504:12345-0@lo:1000:mdt00_000.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367920.264523:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787367920.264551:0:6538:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787367920.264561:0:6538:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c5483ea3480, transno 4294967304 00000100:00100000:1.0:1787367920.264573:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6538:1874190808517504:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787367920.264673:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1787367920.264709:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6538:1874190808517632:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787367920.264739:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367920.264753:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548239cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367920.264820:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808517632 00000100:00100000:1.0:1787367920.264824:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808517632 00000100:00100000:1.0:1787367920.264847:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787367920.264853:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6538:x1874190808517632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787367920.264948:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6538:x1874190808517632:12345-0@lo:1000:mdt00_000.0 Request processed in 95us (209us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787367920.264954:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787367920.264984:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6538:1874190808517632:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787367920.265012:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265020:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265027:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265034:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367920.265038:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265045:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265066:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367920.265068:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787367920.265072:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265078:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d3e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265104:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265109:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265114:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265118:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367920.265120:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265125:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265132:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:1.0:1787367920.265134:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787367920.265137:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265141:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030c6c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265172:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265184:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e775 expref: 17 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265192:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265213:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e775 expref: 17 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.265225:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e775 expref: 17 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367920.265234:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808517760:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367920.265286:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587d8ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367920.269484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367920.269781:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808517760:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367920.269807:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367920.271848:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788511488 00000100:00100000:1.0:1787367920.271860:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788511488 00010000:00010000:1.0:1787367920.271901:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e775 expref: 18 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367920.271952:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1787367920.271961:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+18:2402:x1874190788511488:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367920.271975:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367920.271981:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e775 expref: 18 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.272547:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e775 expref: 18 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.272569:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030c88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e775 expref: 18 pid: 9404 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.272672:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:1.0:1787367920.272677:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.272687:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.272694:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.274986:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367920.275054:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+17:2402:x1874190788511488:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3090us (5575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367920.275066:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00010000:00010000:2.0:1787367920.282179:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282195:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282210:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282217:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282224:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282243:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367920.282247:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282255:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282271:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367920.282273:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367920.282278:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282283:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030d45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282294:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282300:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282305:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282309:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367920.282311:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282317:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282337:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c55c21ff200) 00010000:00010000:2.0:1787367920.282339:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787367920.282343:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367920.282349:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367920.283398:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+16:11318:x1874190788511104:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 36896us (37198us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787367920.283409:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00000020:00080000:2.0:1787367920.283414:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787367920.291535:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367920.295688:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788511744 00000100:00100000:1.0:1787367920.295703:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788511744 00000100:00100000:1.0:1787367920.297802:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1787367920.297821:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+16:11318:x1874190788511744:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787367920.298096:0:6542:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787367920.298128:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1787367920.298162:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.298188:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.298200:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.298209:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.298216:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.298223:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367920.298238:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787367920.298324:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:11318:x1874190788511744:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 509us (6797us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787367920.298333:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000020:00080000:1.0:1787367920.298338:0:6542:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1787367920.298548:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367920.298553:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787367920.298571:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787367920.298577:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787367920.299524:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367920.299533:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.299542:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787367920.299546:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.299554:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.299567:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367920.299570:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787367920.299574:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.299579:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030d4c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367920.299590:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367920.299592:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367920.299594:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367920.536731:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808517888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367920.536823:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367920.537225:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808517888 00000100:00100000:0.0:1787367920.537233:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808517888 00000100:00100000:0.0:1787367920.537290:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787367920.537300:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808517888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367920.537332:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787367920.537404:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808517888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367920.537411:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787367920.537493:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808517888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367920.984570:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367921.560536:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367921.560568:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808518016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367921.560665:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367921.560752:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808518016 00000100:00100000:1.0:1787367921.560761:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808518016 00000100:00100000:1.0:1787367921.560816:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787367921.560844:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808518016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787367921.560885:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787367921.560956:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808518016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367921.560964:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787367921.562959:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808518016:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787367922.008514:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787367922.173991:0:14276:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367922.174000:0:14276:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367922.174025:0:14276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787367922.174032:0:14276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367922.321446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367922.321554:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788512000 00000100:00100000:0.0:1787367922.321565:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788512000 00000100:00100000:0.0:1787367922.321640:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:0.0:1787367922.321651:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+18:11337:x1874190788512000:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367922.321673:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367922.321693:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030d53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7ad expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.321795:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030d5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.321810:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030d5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.321820:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030d5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367922.321831:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787367922.321931:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030d53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ad expref: 21 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.321949:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030d5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ad expref: 20 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.321969:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:0.0:1787367922.321972:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787367922.321975:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b000, rc 0) 00000100:00080000:3.0:1787367922.322232:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367922.322792:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+20:11337:x1874190788512000:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1139us (1351us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787367922.322800:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:2.0:1787367922.332448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.332533:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788512128 00000100:00100000:3.0:1787367922.332542:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788512128 00000100:00100000:3.0:1787367922.332599:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:3.0:1787367922.332609:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+20:11337:x1874190788512128:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1787367922.332680:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332696:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332708:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332722:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332729:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332736:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332811:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332820:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332827:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367922.332870:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332893:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332899:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332905:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332911:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367922.332915:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332936:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332948:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:3.0:1787367922.332951:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367922.332956:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332962:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030d68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332973:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332989:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.332995:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333007:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367922.333010:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333016:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333024:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483331900) 00010000:00010000:3.0:1787367922.333027:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367922.333029:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333035:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030d6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333049:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333055:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333061:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333077:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367922.333080:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333086:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333105:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c5483331500) 00010000:00010000:3.0:1787367922.333108:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367922.333110:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.333188:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030d76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367922.333265:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+20:11337:x1874190788512128:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 656us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367922.333273:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:2.0:1787367922.406261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367922.406334:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788512384 00000100:00100000:0.0:1787367922.406344:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788512384 00000100:00100000:0.0:1787367922.406426:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:0.0:1787367922.406436:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+20:11340:x1874190788512384:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367922.406457:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367922.406475:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030d7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7b4 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406546:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406561:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406572:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406586:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406593:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406610:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406719:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406727:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406734:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367922.406742:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787367922.406813:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406820:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406826:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406832:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367922.406836:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406843:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406854:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:0.0:1787367922.406858:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367922.406868:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406873:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff030d84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406885:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406890:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406895:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406899:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613be00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367922.406902:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406907:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406914:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c54824f2400) 00010000:00010000:0.0:1787367922.406930:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367922.406934:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406940:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030d8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.406987:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030d7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7b4 expref: 23 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.407013:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7b4 expref: 22 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.407020:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:0.0:1787367922.407022:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367922.407024:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b600, rc 0) 00000100:00100000:0.0:1787367922.407090:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+22:11340:x1874190788512384:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 655us (838us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787367922.407098:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:0.0:1787367922.411530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367922.411610:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788512512 00000100:00100000:1.0:1787367922.411620:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788512512 00000100:00100000:1.0:1787367922.411675:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:1.0:1787367922.411685:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+22:11340:x1874190788512512:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:1.0:1787367922.411751:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.411768:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.411778:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.411813:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.411820:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.411829:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.411836:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367922.411840:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.411858:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.411870:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:1.0:1787367922.411873:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367922.411878:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.411884:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff030da0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367922.412269:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+22:11340:x1874190788512512:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 583us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367922.412277:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:3.0:1787367922.414711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367922.414781:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788512768 00000100:00100000:0.0:1787367922.414790:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788512768 00000100:00100000:0.0:1787367922.414842:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1787367922.414853:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+22:11340:x1874190788512768:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787367922.415229:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+23:11340:x1874190788512768:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 377us (527us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1787367922.415237:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1787367922.456008:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367922.457087:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788513024 00000100:00100000:0.0:1787367922.457101:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788513024 00000100:00100000:0.0:1787367922.457187:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:0.0:1787367922.457204:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+23:10858:x1874190788513024:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367922.457232:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367922.457252:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030da7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7bb expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.457423:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.457440:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7b4 expref: 24 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.457455:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.457496:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7b4 expref: 24 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.457517:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7b4 expref: 24 pid: 9404 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367922.457531:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808518144:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367922.457662:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482540300 going to sleep for 11 seconds 00000100:00100000:3.0:1787367922.460671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367922.460704:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808518144:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367922.460731:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367922.460844:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788513152 00000100:00100000:1.0:1787367922.460852:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788513152 00010000:00010000:1.0:1787367922.460888:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7b4 expref: 25 pid: 9404 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367922.460933:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:1.0:1787367922.460942:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+25:2402:x1874190788513152:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367922.460956:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367922.460963:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7b4 expref: 25 pid: 9404 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.460975:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7b4 expref: 25 pid: 9404 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.461022:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff030d92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7b4 expref: 25 pid: 9404 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.461036:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:1.0:1787367922.461042:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.461050:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.461057:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.461083:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367922.461128:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+24:2402:x1874190788513152:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 186us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367922.461135:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00010000:00010000:0.0:1787367922.461227:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.461235:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367922.461252:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787367922.461395:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030da7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7bb expref: 25 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.461411:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7bb expref: 24 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.461418:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:0.0:1787367922.461421:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787367922.461424:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613be00, rc 0) 00000100:00100000:0.0:1787367922.461454:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+24:10858:x1874190788513024:12345-192.168.203.4@tcp:101:bash.0 Request processed in 4254us (5457us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1787367922.461462:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:0.0:1787367922.467321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367922.467415:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788513280 00000100:00100000:2.0:1787367922.467424:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788513280 00000100:00100000:2.0:1787367922.467477:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:2.0:1787367922.467486:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+24:10858:x1874190788513280:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787367922.467509:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367922.467535:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030dbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7c2 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.467566:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030dc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.467578:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.467602:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.467719:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030dbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7c2 expref: 26 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.467736:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7c2 expref: 25 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.467744:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:2.0:1787367922.467747:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787367922.467751:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673200, rc 0) 00000100:00100000:2.0:1787367922.467811:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+25:10858:x1874190788513280:12345-192.168.203.4@tcp:101:bash.0 Request processed in 325us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367922.467818:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:3.0:1787367922.471456:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367922.471639:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788513536 00000100:00100000:2.0:1787367922.471648:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788513536 00000100:00100000:2.0:1787367922.471807:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:2.0:1787367922.471818:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+25:10858:x1874190788513536:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:2.0:1787367922.472104:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.472121:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.472132:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367922.472185:0:9404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1787367922.472205:0:9404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c37b4885 reply state 00000000021718b1 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.472217:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.472224:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:2.0:1787367922.472227:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787367922.472231:0:9404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787367922.472261:0:9404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1787367922.472347:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+29:10858:x1874190788513536:12345-192.168.203.4@tcp:36:bash.0 Request processed in 530us (899us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787367922.472489:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00000020:00080000:2.0:1787367922.472495:0:9404:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787367922.477880:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367922.477958:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788513664 00000100:00100000:2.0:1787367922.477967:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788513664 00000100:00100000:2.0:1787367922.478023:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:2.0:1787367922.478032:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+29:10858:x1874190788513664:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787367922.478055:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367922.478074:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030dd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7c9 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.478130:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7c9 expref: 30 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.478144:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7c9 expref: 30 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.478179:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:2.0:1787367922.478182:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367922.478185:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673c00, rc 0) 00000100:00100000:2.0:1787367922.478249:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+30:10858:x1874190788513664:12345-192.168.203.4@tcp:101:bash.0 Request processed in 217us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367922.478256:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:0.0:1787367922.481940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367922.482184:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788513792 00000100:00100000:1.0:1787367922.482194:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788513792 00000100:00080000:3.0:1787367922.482242:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367922.482262:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:1.0:1787367922.482271:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:10858:x1874190788513792:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1787367922.482289:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367922.482309:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7d0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367922.482333:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8911ee, atime: 0x6a8911ed, ctime: 0x6a8911ee, blocks: 0x8 00010000:00010000:1.0:1787367922.482353:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1787367922.482387:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367922.482396:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d0 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.482414:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d0 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.482426:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f200, rc 0) 00000100:00100000:1.0:1787367922.482483:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:10858:x1874190788513792:12345-192.168.203.4@tcp:101:bash.0 Request processed in 213us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367922.482490:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:0.0:1787367922.489506:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.489589:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788513920 00000100:00100000:3.0:1787367922.489600:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788513920 00002000:00010000:3.0:1787367922.489646:0:8457:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1787367922.489652:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483ea1c00 with x1874190788513920 ext(0->18446744073709551615) 00002000:00010000:3.0:1787367922.489665:0:8457:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483ea1c00. 00000100:00100000:3.0:1787367922.489697:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1787367922.489707:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788513920:12345-192.168.203.4@tcp:10:bash.0 00002000:00010000:3.0:1787367922.489965:0:8457:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787367922.489968:0:8457:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787367918 -> 1787367922 00002000:00010000:3.0:1787367922.489971:0:8457:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787367917 -> 1787367917 00002000:00010000:3.0:1787367922.489982:0:8457:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787367918 -> 1787367922 00002000:00010000:3.0:1787367922.489985:0:8457:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1787367922.490048:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788513920:12345-192.168.203.4@tcp:10:bash.0 Request processed in 342us (692us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787367922.490056:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00002000:00010000:3.0:1787367922.490060:0:8457:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1787367922.490225:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483ea1c00 with x1874190788513920 ext(0->18446744073709551615) 00002000:00010000:3.0:1787367922.490231:0:8457:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483ea1c00. 00000100:00100000:0.0:1787367922.562677:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367922.562765:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788514048 00000100:00100000:1.0:1787367922.562774:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788514048 00000100:00100000:1.0:1787367922.562828:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:1.0:1787367922.562838:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+30:11354:x1874190788514048:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1787367922.562912:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.562938:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.562950:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.562965:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.562971:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563005:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563094:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563104:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563111:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367922.563169:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563182:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563189:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563195:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563201:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367922.563205:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563212:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563225:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:1.0:1787367922.563234:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367922.563240:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563248:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff030ddf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563264:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563271:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563277:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563282:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367922.563285:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563291:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563299:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483604f00) 00010000:00010000:1.0:1787367922.563302:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367922.563304:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563311:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff030de6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563325:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563336:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563342:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563348:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367922.563351:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563419:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563428:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:1.0:1787367922.563431:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367922.563434:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.563440:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff030ded lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367922.563512:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+30:11354:x1874190788514048:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 675us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367922.563520:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 102 00000001:00080000:1.0:1787367922.596592:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1787367922.596611:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:1.0:1787367922.617075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367922.617228:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788514304 00000100:00100000:2.0:1787367922.617238:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788514304 00000100:00100000:2.0:1787367922.617334:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:2.0:1787367922.617346:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+30:11357:x1874190788514304:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367922.617400:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367922.617421:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030df4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7d7 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617490:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617505:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617515:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617540:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617548:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617572:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617679:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030e09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617689:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617708:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367922.617718:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787367922.617789:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617797:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617803:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617808:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367922.617813:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617820:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617833:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367922.617836:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367922.617847:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617853:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82800/0x66f5679bff030dfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617866:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617871:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617876:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617881:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367922.617883:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617888:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617895:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c55bc700500) 00010000:00010000:2.0:1787367922.617897:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367922.617899:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617905:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82e00/0x66f5679bff030e02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617951:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83a00/0x66f5679bff030df4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d7 expref: 33 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617977:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d7 expref: 32 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.617985:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:2.0:1787367922.617987:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787367922.617990:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55afa83e00, rc 0) 00000100:00100000:2.0:1787367922.618055:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+32:11357:x1874190788514304:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 712us (998us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787367922.618062:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:0.0:1787367922.623640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367922.623825:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788514432 00000100:00100000:2.0:1787367922.623835:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788514432 00000100:00100000:2.0:1787367922.623891:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:2.0:1787367922.623901:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+32:11357:x1874190788514432:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1787367922.624000:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.624016:0:9404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7bb expref: 32 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.624026:0:9404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.624058:0:9404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7bb expref: 32 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.625962:0:9404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7bb expref: 32 pid: 6539 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367922.626006:0:9404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808518272:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367922.626460:0:9404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367922.633710:0:9404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808518272:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367922.633737:0:9404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367922.634041:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.634154:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788514688 00000100:00100000:3.0:1787367922.634162:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788514688 00000100:00100000:3.0:1787367922.634217:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1787367922.634227:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+33:6184:x1874190788514688:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787367922.634514:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+34:6184:x1874190788514688:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 288us (474us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787367922.634523:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1787367922.636558:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367922.636648:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788514816 00000100:00100000:2.0:1787367922.636657:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788514816 00010000:00010000:2.0:1787367922.637028:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7bb expref: 34 pid: 6539 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367922.637074:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:2.0:1787367922.637085:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+34:2403:x1874190788514816:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367922.637100:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367922.637106:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7bb expref: 34 pid: 6539 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.637119:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7bb expref: 34 pid: 6539 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.637140:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff030dae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7bb expref: 34 pid: 6539 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.637157:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:2.0:1787367922.637162:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.637189:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.637198:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.637270:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367922.637321:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+33:2403:x1874190788514816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 238us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367922.637329:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00010000:00010000:0.0:1787367922.638383:0:9404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.638397:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.638436:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.638461:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.638467:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.638473:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367922.638523:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.638532:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.638547:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:0.0:1787367922.638550:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367922.638555:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367922.638560:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff030e17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367922.638624:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+32:11357:x1874190788514432:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 14723us (14991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367922.638633:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:0.0:1787367922.641666:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.641796:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788515072 00000100:00100000:3.0:1787367922.641805:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788515072 00000100:00100000:3.0:1787367922.641854:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:3.0:1787367922.641862:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+32:11357:x1874190788515072:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1787367922.642092:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+33:11357:x1874190788515072:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 230us (433us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787367922.642100:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1787367922.737397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.737474:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788515328 00000100:00100000:3.0:1787367922.737483:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788515328 00000100:00100000:3.0:1787367922.737549:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:3.0:1787367922.737560:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+33:11368:x1874190788515328:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:3.0:1787367922.737593:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367922.737615:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030e1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7de expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737702:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737716:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737729:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737742:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737748:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737755:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737849:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737858:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737865:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367922.737875:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787367922.737958:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737966:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737979:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737984:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367922.737989:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.737996:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738009:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:3.0:1787367922.738012:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367922.738017:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738023:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738040:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738046:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738052:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738057:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367922.738590:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738610:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738620:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483331500) 00010000:00010000:3.0:1787367922.738622:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367922.738625:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738631:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738679:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030e1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7de expref: 36 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738693:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7de expref: 35 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.738700:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:3.0:1787367922.738702:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367922.738705:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175a00, rc 0) 00000100:00100000:3.0:1787367922.738767:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+35:11368:x1874190788515328:12345-192.168.203.4@tcp:101:cat.0 Request processed in 1209us (1415us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787367922.738775:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:1.0:1787367922.746211:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.746320:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788515584 00000100:00100000:3.0:1787367922.746329:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788515584 00000100:00100000:3.0:1787367922.746407:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:3.0:1787367922.746417:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+35:11368:x1874190788515584:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:3.0:1787367922.746718:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+36:11368:x1874190788515584:12345-192.168.203.4@tcp:35:cat.0 Request processed in 302us (514us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787367922.746726:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1787367922.766809:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367922.766899:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788515840 00000100:00100000:1.0:1787367922.766930:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788515840 00000100:00100000:1.0:1787367922.766993:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:1.0:1787367922.767003:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+36:11369:x1874190788515840:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:1.0:1787367922.767057:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787367922.767091:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673c00/0x66f5679bff030dd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7c9 expref: 36 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767113:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7de expref: 35 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767126:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83e00/0x66f5679bff030e09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d7 expref: 34 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767137:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff030dc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7c2 expref: 33 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767146:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:1.0:1787367922.767151:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367922.767171:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767183:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767192:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767206:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767222:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767229:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767296:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767304:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767310:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787367922.767843:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1787367922.767852:0:6539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380055496360ns, next at 381055494180ns, rc = 0 00010000:00010000:1.0:1787367922.767893:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767902:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767910:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767928:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767934:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.767950:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768101:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367922.768122:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768128:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768134:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768149:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367922.768153:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768161:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768171:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:1.0:1787367922.768175:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787367922.768179:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768184:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff030e4f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768199:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768205:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768216:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768221:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367922.768224:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768230:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768237:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:1.0:1787367922.768239:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367922.768242:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768248:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030e41 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367922.768256:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000411737c4 reply state 000000002006a82c transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768266:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367922.768271:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483604900) 00010000:00010000:1.0:1787367922.768273:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787367922.768275:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367922.768347:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+34:11369:x1874190788515840:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1344us (1544us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787367922.768381:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 106 00010000:00010000:3.0:1787367922.770209:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367922.770224:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.770234:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ee00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367922.770238:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.770248:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.770265:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:3.0:1787367922.770268:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787367922.770272:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.770277:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030e56 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.770292:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367922.770294:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367922.770296:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367922.829650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.829741:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788516096 00000100:00100000:3.0:1787367922.829751:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788516096 00000100:00100000:3.0:1787367922.829804:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:3.0:1787367922.829813:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+34:11375:x1874190788516096:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787367922.829836:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367922.829867:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030e5d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7e5 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.829982:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.829997:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830008:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830018:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830025:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830031:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367922.830338:0:6540:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787367922.830513:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830522:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830529:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830558:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830579:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830584:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830590:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367922.830594:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830601:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830613:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:3.0:1787367922.830616:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367922.830621:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830625:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030e64 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367922.830638:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006da4d345 reply state 000000004c867ed1 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830647:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830652:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483604900) 00010000:00010000:3.0:1787367922.830655:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787367922.830657:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787367922.830682:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030e5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7e5 expref: 37 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830702:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7e5 expref: 36 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.830710:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c5483331500) 00010000:00010000:3.0:1787367922.830712:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367922.830714:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175a00, rc 0) 00000100:00100000:3.0:1787367922.830765:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+37:11375:x1874190788516096:12345-192.168.203.4@tcp:101:bash.0 Request processed in 953us (1124us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787367922.830773:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:0.0:1787367922.837669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.837856:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788516224 00000100:00100000:3.0:1787367922.837866:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788516224 00000100:00080000:1.0:1787367922.837995:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367922.838034:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:3.0:1787367922.838044:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788516224:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787367922.838070:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367922.838089:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7ec expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787367922.838113:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787367922.838132:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1787367922.838136:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367922.838147:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ec expref: 6 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.838166:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ec expref: 6 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.838200:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2175600, rc 0) 00000100:00100000:3.0:1787367922.838256:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788516224:12345-192.168.203.4@tcp:101:bash.0 Request processed in 214us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367922.838263:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1787367922.842479:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.842687:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788516352 00000100:00100000:3.0:1787367922.842760:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788516352 00000100:00100000:3.0:1787367922.842858:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1787367922.842869:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:11375:x1874190788516352:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787367922.842885:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367922.842902:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7f3 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.842944:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ec expref: 7 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.842954:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367922.842958:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367922.842964:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 7 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.843004:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ec expref: 7 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.843020:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ec expref: 7 pid: 8453 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367922.843053:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483645500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1874190808518400:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367922.843314:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58240 going to sleep for 11 seconds 00000100:00100000:1.0:1787367922.846992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367922.847296:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788516480 00000100:00100000:2.0:1787367922.847304:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788516480 00010000:00010000:2.0:1787367922.847344:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ec expref: 8 pid: 8453 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367922.847416:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1787367922.847426:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2403:x1874190788516480:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367922.847440:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367922.847461:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ec expref: 8 pid: 8453 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.847476:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ec expref: 8 pid: 8453 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.847500:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367922.847504:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367922.847533:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.847550:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367922.847598:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367922.847612:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6524:1874190808518528:192.168.203.4@tcp:105: 00000100:00100000:2.0:1787367922.847820:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c939c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787367922.850882:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2c56340/0x66f5679bff030e80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ec expref: 8 pid: 8453 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367922.850909:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483645500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1874190808518400:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367922.850949:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 7 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367922.850962:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2174800, rc 0) 00000100:00100000:3.0:1787367922.851217:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:11375:x1874190788516352:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8349us (8747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367922.851226:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:2.0:1787367922.853594:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6524:1874190808518528:192.168.203.4@tcp:105: 00010000:00010000:2.0:1787367922.853616:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367922.853677:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788516480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 6253us (6702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367922.853694:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1787367922.855782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367922.855870:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788516736 00000100:00100000:3.0:1787367922.855879:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788516736 00000100:00100000:3.0:1787367922.856065:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1787367922.856076:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+37:11375:x1874190788516736:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:3.0:1787367922.856348:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+38:11375:x1874190788516736:12345-192.168.203.4@tcp:35:bash.0 Request processed in 273us (573us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787367922.856375:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00010000:00010000:3.0:1787367923.032604:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367923.053985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.054411:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788516864 00000100:00100000:2.0:1787367923.054420:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788516864 00000100:00100000:2.0:1787367923.054481:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:2.0:1787367923.054492:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+38:11391:x1874190788516864:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367923.054515:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367923.054535:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff030e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e7fa expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.054607:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff030e95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.054637:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff030e95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.054649:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff030e95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367923.054694:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787367923.054697:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367923.054715:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff030e95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.054738:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff030e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7fa expref: 40 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.054757:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff030e95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7fa expref: 39 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.054766:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367923.054769:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367923.054772:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c400, rc 0) 00000100:00100000:2.0:1787367923.054833:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+39:11391:x1874190788516864:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 343us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367923.054841:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:1.0:1787367923.059226:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367923.059347:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788517120 00000100:00100000:3.0:1787367923.059449:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788517120 00000100:00100000:3.0:1787367923.059563:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:3.0:1787367923.059574:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+39:11391:x1874190788517120:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1787367923.059594:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367923.059614:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030e9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e801 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.059720:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030ea3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.059735:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.059746:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367923.059757:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787367923.059872:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175600/0x66f5679bff030e9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e801 expref: 42 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.059890:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e801 expref: 41 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.059898:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c5483331500) 00010000:00010000:3.0:1787367923.059901:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367923.059904:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031c00, rc 0) 00000100:00100000:3.0:1787367923.059962:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+41:11391:x1874190788517120:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 390us (746us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1787367923.059969:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:0.0:1787367923.067718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367923.070883:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367923.071035:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788517504 00000100:00100000:0.0:1787367923.071044:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788517504 00000100:00100000:0.0:1787367923.071119:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:0.0:1787367923.071129:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+41:11391:x1874190788517504:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367923.071153:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367923.071173:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030eb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e808 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.071271:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030eb8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.071285:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.071296:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367923.071308:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787367923.071442:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff030eb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e808 expref: 44 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.071461:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e808 expref: 43 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.071468:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c5483331500) 00010000:00010000:0.0:1787367923.071471:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787367923.071474:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a000, rc 0) 00000100:00100000:0.0:1787367923.071529:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+43:11391:x1874190788517504:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 401us (655us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787367923.071551:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:2.0:1787367923.075305:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788517248 00000100:00100000:2.0:1787367923.075320:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788517248 00000100:00100000:2.0:1787367923.075426:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1787367923.075437:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+43:2402:x1874190788517248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367923.075452:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367923.075490:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030ea3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e801 expref: 43 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.075509:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c5483331500) 00010000:00010000:2.0:1787367923.075514:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367923.075574:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+42:2402:x1874190788517248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 138us (7864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367923.075582:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1787367923.084038:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367923.084112:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788517632 00000100:00100000:0.0:1787367923.084121:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788517632 00000100:00100000:0.0:1787367923.084181:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:0.0:1787367923.084191:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788517632:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1787367923.084234:0:8925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.084253:0:8925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 6 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.084261:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367923.084265:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367923.084270:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.084304:0:8925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 6 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.084318:0:8925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 6 pid: 8454 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367923.084333:0:8925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8925:1874190808518656:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367923.084788:0:8925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482540300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367923.089784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.089875:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788517760 00000100:00100000:2.0:1787367923.089884:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788517760 00002000:00100000:2.0:1787367923.089941:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c54836bb480 x1874190788517760/t0(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:564/0 lens 504/0 e 0 to 0 dl 1787367934 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367923.089951:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c54836bb480 with x1874190788517760 ext(0->8) 00010000:00010000:2.0:1787367923.089960:0:8459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 7 pid: 8454 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.089985:0:8459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 7 pid: 8454 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367923.089992:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c54836bb480 00000100:00100000:2.0:1787367923.090023:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1787367923.090033:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788517760:12345-192.168.203.4@tcp:4:lfs.0 00000100:00100000:3.0:1787367923.090707:0:8925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8925:1874190808518656:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367923.090737:0:8925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367923.096710:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+9:2402:x1874190788517760:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 6668us (6925us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787367923.096726:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00002000:00100000:2.0:1787367923.096740:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c54836bb480 x1874190788517760/t4294967303(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:564/0 lens 504/448 e 0 to 0 dl 1787367934 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367923.096764:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c54836bb480 with x1874190788517760 ext(0->8) 00010000:00010000:2.0:1787367923.096775:0:8459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 9 pid: 8454 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.096794:0:8459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 9 pid: 8454 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367923.096803:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c54836bb480 00000100:00100000:1.0:1787367923.101424:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367923.101591:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788517888 00000100:00100000:0.0:1787367923.101613:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788517888 00010000:00010000:0.0:1787367923.101650:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 9 pid: 8454 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367923.101693:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:0.0:1787367923.101702:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55833d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+9:2405:x1874190788517888:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367923.101718:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787367923.101734:0:8469:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787367923.101737:0:8469:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787367923 00002000:00010000:0.0:1787367923.101739:0:8469:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787367923 00002000:00010000:0.0:1787367923.101741:0:8469:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787367923 00002000:00010000:0.0:1787367923.101743:0:8469:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787367923.101749:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 9 pid: 8454 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.101762:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 9 pid: 8454 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.101782:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065f04603/0x66f5679bff030e87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7f3 expref: 9 pid: 8454 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.101800:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367923.101805:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367923.101811:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.101821:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.101859:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367923.101910:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55833d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+8:2405:x1874190788517888:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 209us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367923.101926:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00010000:00010000:3.0:1787367923.102220:0:8925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.102229:0:8925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.102249:0:8925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.102258:0:8925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.102266:0:8925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.102273:0:8925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367923.102277:0:8925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.102285:0:8925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.102296:0:8925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.102311:0:8925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cbda86d/0x66f5679bff030ec6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367923.102406:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788517632:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 18216us (18378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367923.102415:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1787367923.120877:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367923.120976:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788518144 00000100:00100000:0.0:1787367923.120985:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788518144 00000100:00100000:0.0:1787367923.121046:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1787367923.121056:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+42:11391:x1874190788518144:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:0.0:1787367923.121122:0:6542:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e808 expref: 42 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367923.121295:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1787367923.121328:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787367923.122855:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1787367923.122903:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.122930:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7e5 expref: 46 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.122939:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.122975:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7e5 expref: 46 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.122991:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7e5 expref: 46 pid: 6540 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367923.123009:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6542:1874190808518784:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367923.126054:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1787367923.129672:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6542:1874190808518784:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367923.129700:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367923.135058:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.135153:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788518272 00000100:00100000:2.0:1787367923.135163:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788518272 00010000:00010000:2.0:1787367923.135215:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7e5 expref: 47 pid: 6540 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367923.135254:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:2.0:1787367923.135263:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+47:2402:x1874190788518272:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367923.135278:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367923.135285:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7e5 expref: 47 pid: 6540 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.135298:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7e5 expref: 47 pid: 6540 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.135339:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030e72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7e5 expref: 47 pid: 6540 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.135407:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c5483331500) 00010000:00010000:2.0:1787367923.135413:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.135422:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.135429:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.135464:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367923.135511:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+46:2402:x1874190788518272:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 249us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367923.135519:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00010000:00010000:1.0:1787367923.135963:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.135979:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367923.136080:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1787367923.136210:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787367923.136297:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808518912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787367923.136342:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367923.136403:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ffe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367923.138419:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808518912 00000100:00100000:2.0:1787367923.138431:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808518912 00000100:00100000:2.0:1787367923.138500:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787367923.138510:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6542:x1874190808518912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787367923.138630:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6542:x1874190808518912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367923.138637:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787367923.138726:0:6542:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1787367923.138732:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1787367923.138749:0:6542:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c55afaddf80, transno 4294967302 00000100:00100000:0.0:1787367923.138766:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808518912:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787367923.138892:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1787367923.138964:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808519040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787367923.138999:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367923.139020:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787367923.139035:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808519040 00000100:00100000:0.0:1787367923.139038:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808519040 00000100:00100000:0.0:1787367923.139060:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787367923.139065:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6542:x1874190808519040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787367923.139172:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6542:x1874190808519040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (172us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787367923.139179:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787367923.139217:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808519040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787367923.139253:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1787367923.139282:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.139292:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.139300:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.139306:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fc00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367923.139310:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.139317:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.139332:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c5483331500) 00010000:00010000:0.0:1787367923.139335:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787367923.139340:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.139346:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030ecd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787367923.139453:0:6542:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787367923.139512:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787367923.139522:0:6542:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380427165782ns, next at 381427164007ns, rc = 0 00000001:00080000:0.0:1787367923.139528:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1787367923.139546:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c5483331500) 00010000:00010000:0.0:1787367923.139549:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787367923.139555:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030eb8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e808 expref: 50 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367923.139635:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+49:11391:x1874190788518144:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 18581us (18768us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787367923.139644:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000020:00080000:0.0:1787367923.139648:0:6542:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1787367923.140750:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367923.148777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.148897:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788518400 00000100:00100000:2.0:1787367923.148907:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788518400 00000100:00100000:2.0:1787367923.148966:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:2.0:1787367923.148974:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+49:11391:x1874190788518400:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367923.149015:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367923.149037:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff030ed4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e80f expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.149093:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff030ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e80f expref: 50 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.149107:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff030ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e80f expref: 50 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.149126:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367923.149128:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367923.149132:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241d600, rc 0) 00000100:00100000:2.0:1787367923.149243:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+50:11391:x1874190788518400:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 269us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367923.149250:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:0.0:1787367923.158847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367923.159001:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788518656 00000100:00100000:3.0:1787367923.159011:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788518656 00000100:00100000:3.0:1787367923.159063:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:3.0:1787367923.159079:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+50:11391:x1874190788518656:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1787367923.159632:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+51:11391:x1874190788518656:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 553us (794us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787367923.159641:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1787367923.244471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.244570:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788518784 00000100:00100000:2.0:1787367923.244579:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788518784 00000100:00100000:2.0:1787367923.244639:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:2.0:1787367923.244649:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+51:11401:x1874190788518784:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1787367923.244727:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244744:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244756:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244786:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244794:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244801:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244866:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244875:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244882:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367923.244937:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244951:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244958:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244965:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244971:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241de00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367923.244975:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.244990:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245002:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367923.245004:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367923.245009:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245016:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030edb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245029:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245035:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245041:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245046:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367923.245049:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245055:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245073:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483604900) 00010000:00010000:2.0:1787367923.245075:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367923.245079:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245095:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ee2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245106:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245112:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245118:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245123:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367923.245126:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245132:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245140:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367923.245143:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367923.245145:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.245152:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ee9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367923.245220:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+51:11401:x1874190788518784:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 572us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367923.245228:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:1.0:1787367923.310007:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.310186:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788519040 00000100:00100000:2.0:1787367923.310196:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788519040 00000100:00100000:2.0:1787367923.310255:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:2.0:1787367923.310265:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+51:11404:x1874190788519040:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367923.310284:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367923.310303:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ef0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e816 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310402:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310415:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310426:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310436:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310443:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310449:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310551:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241da00/0x66f5679bff030f05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310559:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241da00/0x66f5679bff030f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310596:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241da00/0x66f5679bff030f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367923.310606:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787367923.310676:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310684:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310690:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310697:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367923.310701:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310708:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310873:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367923.310878:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367923.310883:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310890:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030ef7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310902:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310908:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310932:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310937:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241de00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367923.310939:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310945:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310953:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483604900) 00010000:00010000:2.0:1787367923.310956:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367923.310959:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.310963:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030efe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.311009:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ef0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e816 expref: 54 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.311021:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241da00/0x66f5679bff030f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e816 expref: 53 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.311028:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367923.311030:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367923.311032:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241da00, rc 0) 00000100:00100000:2.0:1787367923.311212:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+53:11404:x1874190788519040:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 947us (1211us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787367923.311229:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:0.0:1787367923.321455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.321821:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788519168 00000100:00100000:2.0:1787367923.321830:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788519168 00000100:00100000:2.0:1787367923.321889:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1787367923.321899:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+53:11404:x1874190788519168:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1787367923.321988:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.322005:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.322017:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.322050:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.322067:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.322074:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.322081:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367923.322085:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.322094:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.322105:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367923.322120:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367923.322125:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.322132:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367923.322212:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+53:11404:x1874190788519168:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 314us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367923.322219:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:0.0:1787367923.332637:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.332744:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788519424 00000100:00100000:2.0:1787367923.332754:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788519424 00000100:00100000:2.0:1787367923.332810:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1787367923.332820:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+53:11404:x1874190788519424:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787367923.333056:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+54:11404:x1874190788519424:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 237us (427us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787367923.333072:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:3.0:1787367923.432941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367923.433046:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788519680 00000100:00100000:1.0:1787367923.433057:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788519680 00000100:00100000:1.0:1787367923.433136:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:1.0:1787367923.433146:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+54:11414:x1874190788519680:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1787367923.433170:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367923.433173:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787367923.433199:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff030e95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7fa expref: 54 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.433217:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:1.0:1787367923.433222:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367923.433247:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff030f1a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e81d expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.433345:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030f21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.433421:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.433432:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367923.433445:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787367923.433541:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff030f1a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e81d expref: 56 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.433555:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030f21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e81d expref: 55 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.433561:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367923.433564:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367923.433566:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fc00, rc 0) 00000100:00100000:1.0:1787367923.433627:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+55:11414:x1874190788519680:12345-192.168.203.4@tcp:101:bash.0 Request processed in 481us (692us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787367923.433635:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:0.0:1787367923.438574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367923.438633:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.438685:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788519808 00000100:00100000:2.0:1787367923.438694:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788519808 00000100:00100000:2.0:1787367923.438752:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:2.0:1787367923.438763:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+55:11414:x1874190788519808:12345-192.168.203.4@tcp:101:bash.0 00000100:00100000:1.0:1787367923.438781:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788519936 00010000:00010000:2.0:1787367923.438785:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787367923.438799:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788519936 00010000:00010000:2.0:1787367923.438804:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e824 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367923.438829:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1787367923.438835:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+57:2402:x1874190788519936:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367923.438836:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.438846:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367923.438848:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.438872:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.439343:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff030f21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e81d expref: 57 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.439406:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367923.439411:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367923.439459:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+56:2402:x1874190788519936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 623us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367923.439467:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00010000:00010000:2.0:1787367923.439486:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e824 expref: 56 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.439501:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e824 expref: 55 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.439508:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367923.439511:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787367923.439514:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241de00, rc 0) 00000100:00100000:2.0:1787367923.439548:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+55:11414:x1874190788519808:12345-192.168.203.4@tcp:101:bash.0 Request processed in 787us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367923.439554:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:0.0:1787367923.443671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.444328:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788520192 00000100:00100000:2.0:1787367923.444339:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788520192 00000100:00100000:2.0:1787367923.444407:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:2.0:1787367923.444416:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+55:11414:x1874190788520192:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:2.0:1787367923.444462:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367923.444483:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241da00/0x66f5679bff030f05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e816 expref: 55 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.444499:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367923.444503:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367923.444837:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.444863:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.444873:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367923.448157:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1787367923.448465:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000149a85c reply state 0000000079875e00 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.448485:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.448493:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367923.448496:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787367923.448500:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367923.449145:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+57:11414:x1874190788520192:12345-192.168.203.4@tcp:36:bash.0 Request processed in 4723us (5474us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787367923.449155:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000020:00080000:2.0:1787367923.449161:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787367923.475554:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367923.475696:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788520320 00000100:00100000:0.0:1787367923.475706:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788520320 00000100:00100000:0.0:1787367923.475817:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:0.0:1787367923.475830:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+57:11414:x1874190788520320:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367923.475867:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367923.475889:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030f44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e82b expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.476001:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.476029:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.476042:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367923.476083:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787367923.476088:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367923.476106:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.476134:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff030f44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e82b expref: 59 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.476153:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e82b expref: 58 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.476162:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:0.0:1787367923.476165:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367923.476168:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a400, rc 0) 00000100:00100000:0.0:1787367923.476226:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+58:11414:x1874190788520320:12345-192.168.203.4@tcp:101:bash.0 Request processed in 399us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367923.476234:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:0.0:1787367923.486442:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.486545:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788520576 00000100:00100000:2.0:1787367923.486554:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788520576 00000100:00100000:2.0:1787367923.486612:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1787367923.486622:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+58:11414:x1874190788520576:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:2.0:1787367923.486833:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+59:11414:x1874190788520576:12345-192.168.203.4@tcp:35:bash.0 Request processed in 212us (400us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1787367923.486842:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1787367923.562412:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367923.563014:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788520704 00000100:00100000:3.0:1787367923.563025:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788520704 00000100:00100000:3.0:1787367923.563097:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:3.0:1787367923.563108:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+59:11420:x1874190788520704:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1787367923.563136:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367923.563160:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff030f52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e832 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.563228:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff030f59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.563264:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff030f59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.563274:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff030f59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367923.563321:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787367923.563325:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787367923.563343:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff030f59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.563402:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff030f52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e832 expref: 61 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.563422:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff030f59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e832 expref: 60 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.563430:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:3.0:1787367923.563433:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787367923.563437:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580030600, rc 0) 00000100:00100000:3.0:1787367923.563503:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+60:11420:x1874190788520704:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 397us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367923.563510:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:0.0:1787367923.568389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367923.572905:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788520832 00000100:00100000:2.0:1787367923.572944:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788520832 00000100:00100000:2.0:1787367923.573055:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:2.0:1787367923.573065:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+60:11420:x1874190788520832:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367923.573087:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367923.573107:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241da00/0x66f5679bff030f60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e839 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573173:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573188:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573199:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573209:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573217:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573224:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573290:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff030f75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573299:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff030f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573306:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff030f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367923.573352:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787367923.573376:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367923.573396:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff030f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573408:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff030f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573417:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573423:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573429:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573435:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367923.573440:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573448:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573461:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367923.573464:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367923.573469:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573476:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030f67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573503:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573510:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573516:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573521:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367923.573524:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573531:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573539:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483604900) 00010000:00010000:2.0:1787367923.573541:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367923.573544:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573550:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030f6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573596:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241da00/0x66f5679bff030f60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e839 expref: 62 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573611:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff030f75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e839 expref: 61 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.573630:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367923.573633:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367923.573635:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c600, rc 0) 00000100:00100000:2.0:1787367923.573706:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+61:11420:x1874190788520832:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 642us (5351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367923.573715:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:3.0:1787367923.579680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367923.580386:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788521216 00000100:00100000:1.0:1787367923.580396:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788521216 00000100:00100000:1.0:1787367923.580455:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1787367923.580466:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+61:2404:x1874190788521216:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367923.580482:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367923.580507:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff030f75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e839 expref: 61 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.580526:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367923.580531:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367923.580605:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+60:2404:x1874190788521216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 140us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367923.580612:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1787367923.583720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367923.583851:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788521088 00000100:00100000:3.0:1787367923.583860:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788521088 00000100:00100000:3.0:1787367923.583977:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:3.0:1787367923.583989:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+60:11420:x1874190788521088:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1787367923.584027:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367923.584049:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff030f7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e840 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.584438:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.584454:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e82b expref: 61 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.584464:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.584495:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e82b expref: 61 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367923.584510:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e82b expref: 61 pid: 6539 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367923.584523:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483644700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808519168:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367923.584881:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367923.590558:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367923.590717:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483644700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808519168:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367923.590754:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367923.590949:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788521344 00000100:00100000:0.0:1787367923.590956:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788521344 00010000:00010000:0.0:1787367923.591003:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e82b expref: 62 pid: 6539 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367923.591073:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:0.0:1787367923.591082:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+62:2402:x1874190788521344:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367923.591098:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367923.591104:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e82b expref: 62 pid: 6539 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.591116:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e82b expref: 62 pid: 6539 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.591136:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e82b expref: 62 pid: 6539 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.591151:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:0.0:1787367923.591155:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.591165:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.591173:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.591204:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367923.591256:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+61:2402:x1874190788521344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 174us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367923.591264:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00010000:00010000:2.0:1787367923.591420:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.591428:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367923.591447:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787367923.591572:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff030f7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e840 expref: 62 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.591588:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e840 expref: 61 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367923.591609:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367923.591612:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787367923.591615:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031c00, rc 0) 00000100:00100000:2.0:1787367923.591644:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+61:11420:x1874190788521088:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 7658us (7934us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787367923.591652:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:0.0:1787367923.594489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367923.594588:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788521600 00000100:00100000:1.0:1787367923.594597:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788521600 00000100:00100000:1.0:1787367923.594659:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1787367923.594669:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+61:11420:x1874190788521600:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:1.0:1787367923.594691:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367923.594714:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff030ed4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e80f expref: 61 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.594730:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367923.594734:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367923.594806:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+60:11420:x1874190788521600:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 139us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367923.594813:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1787367923.598285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367923.598386:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788521728 00000100:00100000:0.0:1787367923.598395:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788521728 00000100:00100000:0.0:1787367923.598456:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:0.0:1787367923.598467:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+60:11420:x1874190788521728:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:0.0:1787367923.598573:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.598591:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367923.598601:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367923.598693:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787367923.598802:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+60:11420:x1874190788521728:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 324us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367923.598811:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:0.0:1787367923.601325:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367923.601430:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788521856 00000100:00100000:1.0:1787367923.601440:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788521856 00000100:00100000:1.0:1787367923.601487:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:1.0:1787367923.601495:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+60:11420:x1874190788521856:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367923.601515:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367923.601534:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e847 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.601579:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.601589:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e847 expref: 61 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.601606:0:6540:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.601618:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e847 expref: 61 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.601643:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367923.601646:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787367923.601650:0:6540:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e847 expref: 61 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367923.601658:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fe00, rc 0) 00000100:00100000:1.0:1787367923.601700:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+61:11420:x1874190788521856:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 206us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367923.601707:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:3.0:1787367924.020827:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.020876:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.020919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.020974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.021005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.021031:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788522240 00000100:00100000:3.0:1787367924.021039:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788522240 00000100:00100000:2.0:1787367924.021120:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788522112 00000100:00100000:2.0:1787367924.021125:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788522112 00000100:00080000:2.0:1787367924.021154:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367924.021190:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788522368 00000100:00100000:2.0:1787367924.021194:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788522368 00000100:00080000:2.0:1787367924.021207:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367924.021219:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788522496 00000100:00100000:2.0:1787367924.021221:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788522496 00000100:00080000:2.0:1787367924.021231:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787367924.021246:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 288 00000100:00100000:2.0:1787367924.021255:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788522112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367924.021326:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 289 00000100:00100000:2.0:1787367924.021330:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788522112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.021340:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 288 00000100:00100000:2.0:1787367924.021397:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 290 00000100:00100000:2.0:1787367924.021405:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788522496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367924.021431:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788522496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.021437:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 290 00000100:00100000:0.0:1787367924.021569:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788522368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367924.021621:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788522368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 286us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367924.021628:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 289 00000100:00100000:1.0:1787367924.022063:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788521984 00000100:00100000:1.0:1787367924.022068:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788521984 00000100:00100000:1.0:1787367924.022106:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 381 00000100:00100000:1.0:1787367924.022114:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788521984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367924.022153:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788521984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.022160:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 381 00000100:00100000:3.0:1787367924.022479:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:3.0:1787367924.022487:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2404:x1874190788522240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367924.022516:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2404:x1874190788522240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367924.022523:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00080000:2.0:1787367924.026338:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787367924.056698:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787367924.379415:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367924.379424:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367924.379459:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787367924.379469:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367924.379616:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7dfb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808519296:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787367924.379732:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367924.384091:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7dfb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808519296:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787367924.391271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.393449:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788522624 00000100:00100000:2.0:1787367924.393464:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788522624 00000100:00100000:2.0:1787367924.393567:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:2.0:1787367924.393579:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+61:11422:x1874190788522624:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787367924.393611:0:6538:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787367924.393744:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+61:11422:x1874190788522624:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 165us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.393752:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00080000:0.0:1787367924.393898:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367924.397995:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367924.398108:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788522752 00000100:00100000:0.0:1787367924.398117:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788522752 00000100:00100000:0.0:1787367924.398176:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:0.0:1787367924.398187:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+61:11422:x1874190788522752:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787367924.398258:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398274:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398285:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398301:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398308:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398314:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398334:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398344:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398393:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367924.398439:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787367924.398443:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367924.398455:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398465:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398472:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398479:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398485:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367924.398489:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398496:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398507:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:0.0:1787367924.398510:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367924.398515:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398522:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff030f9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398545:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398552:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398558:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398563:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613aa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367924.398566:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398573:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398580:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9c54824f2400) 00010000:00010000:0.0:1787367924.398582:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367924.398585:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398591:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff030fa6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398603:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398608:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398613:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398624:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367924.398627:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398633:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398641:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:0.0:1787367924.398643:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367924.398647:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.398652:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff030fad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367924.398722:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+61:11422:x1874190788522752:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 536us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367924.398731:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:1.0:1787367924.407067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.407135:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788523008 00000100:00100000:2.0:1787367924.407145:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788523008 00000100:00100000:2.0:1787367924.407200:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:2.0:1787367924.407209:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+61:11422:x1874190788523008:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367924.407230:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367924.407247:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030fb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e84e expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407347:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407404:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407415:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367924.407426:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787367924.407498:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407506:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407512:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407518:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367924.407522:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407529:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407555:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367924.407558:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367924.407564:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407571:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030fbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407610:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030fb4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e84e expref: 63 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407620:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:2.0:1787367924.407623:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367924.407626:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030fb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e84e expref: 63 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.407635:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c000, rc 0) 00000100:00100000:2.0:1787367924.407704:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+62:11422:x1874190788523008:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 496us (655us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787367924.407712:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:3.0:1787367924.411324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.411488:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788523136 00000100:00100000:1.0:1787367924.411498:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788523136 00000100:00100000:1.0:1787367924.411547:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:1.0:1787367924.411557:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+62:11422:x1874190788523136:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787367924.411589:0:6540:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787367924.411742:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+62:11422:x1874190788523136:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 185us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.411761:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:2.0:1787367924.428195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.428266:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788523392 00000100:00100000:3.0:1787367924.428339:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788523392 00000100:00100000:3.0:1787367924.428415:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:3.0:1787367924.428426:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+62:11422:x1874190788523392:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367924.428446:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367924.428449:0:9404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787367924.428473:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff030f59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e832 expref: 62 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.428492:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:3.0:1787367924.428497:0:9404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367924.428508:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030fc9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e855 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367924.429795:0:9404:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787367924.430226:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030fd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.430265:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.430340:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.430428:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175a00/0x66f5679bff030fc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e855 expref: 64 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.430445:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e855 expref: 63 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.430452:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c5483331100) 00010000:00010000:3.0:1787367924.430455:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367924.430458:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55c2174800, rc 0) 00000100:00100000:3.0:1787367924.430521:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+63:11422:x1874190788523392:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 2097us (2336us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787367924.430530:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:2.0:1787367924.445492:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.446408:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788523648 00000100:00100000:1.0:1787367924.446421:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788523648 00000100:00100000:1.0:1787367924.446540:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:1.0:1787367924.446551:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+63:11422:x1874190788523648:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787367924.446713:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367924.446742:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174800/0x66f5679bff030fd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e855 expref: 63 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446760:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c5483331100) 00010000:00010000:1.0:1787367924.446769:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367924.446788:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446800:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446808:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446867:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446875:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446881:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446935:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446954:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446960:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.446965:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367924.447030:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447038:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447157:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:1.0:1787367924.447161:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367924.447165:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447170:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff030fde lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447181:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447186:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447191:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447196:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ee00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367924.447204:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447210:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447217:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x51be73c7 (ffff9c5483604400) 00010000:00010000:1.0:1787367924.447219:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367924.447222:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.447227:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff030fe5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x51be73c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.447498:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+62:11422:x1874190788523648:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 947us (2013us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367924.447506:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:3.0:1787367924.450147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.450298:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788523776 00000100:00100000:2.0:1787367924.450307:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788523776 00000100:00100000:2.0:1787367924.450395:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:2.0:1787367924.450404:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+62:11422:x1874190788523776:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367924.450423:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367924.450457:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030fec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e85c expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.450492:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.450503:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.450513:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.450621:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff030fec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e85c expref: 64 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.450638:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e85c expref: 63 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.450646:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:2.0:1787367924.450649:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787367924.450651:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ce00, rc 0) 00000100:00100000:2.0:1787367924.450698:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+63:11422:x1874190788523776:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 296us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.450705:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:3.0:1787367924.454568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.455270:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788524032 00000100:00100000:1.0:1787367924.455288:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788524032 00000100:00100000:1.0:1787367924.455346:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:1.0:1787367924.455378:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+63:11422:x1874190788524032:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787367924.455457:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.455474:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.455485:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787367924.455852:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787367924.455874:0:6540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381743517871ns, next at 382743515578ns, rc = 0 00000004:00010000:1.0:1787367924.455933:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068444231 reply state 00000000fc0591aa transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.455944:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.455950:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:1.0:1787367924.455953:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787367924.455956:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367924.457863:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+65:11422:x1874190788524032:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 1238us (2033us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787367924.457875:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:3.0:1787367924.463995:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.464084:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788524160 00000100:00100000:2.0:1787367924.464093:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788524160 00000100:00100000:2.0:1787367924.464156:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:2.0:1787367924.464166:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+65:11422:x1874190788524160:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367924.464189:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367924.464220:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e863 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.464286:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e863 expref: 66 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.464301:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e863 expref: 66 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.464319:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:2.0:1787367924.464322:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367924.464326:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241dc00, rc 0) 00000100:00100000:2.0:1787367924.464418:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+66:11422:x1874190788524160:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 253us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.464425:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:3.0:1787367924.471335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.471516:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788524288 00000100:00100000:2.0:1787367924.471526:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788524288 00000100:00100000:2.0:1787367924.471585:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:2.0:1787367924.471596:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2403:x1874190788524288:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787367924.471990:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+9:2403:x1874190788524288:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 395us (663us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787367924.471999:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:3.0:1787367924.476690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367924.476852:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788524544 00000100:00100000:0.0:1787367924.476862:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788524544 00000100:00100000:0.0:1787367924.476924:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1787367924.476933:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+66:11422:x1874190788524544:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787367924.477263:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+67:11422:x1874190788524544:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 330us (581us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1787367924.477323:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1787367924.480460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.480550:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788524800 00000100:00100000:1.0:1787367924.480558:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788524800 00000100:00100000:1.0:1787367924.480633:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:1.0:1787367924.480643:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+67:11422:x1874190788524800:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787367924.480739:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+67:11422:x1874190788524800:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.480747:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:3.0:1787367924.492850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.492959:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788524928 00000100:00100000:2.0:1787367924.492970:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788524928 00000100:00100000:2.0:1787367924.493099:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:2.0:1787367924.493111:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+67:11422:x1874190788524928:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367924.493131:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367924.493165:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff031008 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e86a expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.493250:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff03100f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.493264:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff03100f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.493276:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff03100f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367924.493336:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367924.493394:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff03100f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.493423:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff031008 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e86a expref: 69 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.493439:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff03100f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e86a expref: 68 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.493448:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:2.0:1787367924.493451:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787367924.493455:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241cc00, rc 0) 00000100:00100000:2.0:1787367924.493656:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+68:11422:x1874190788524928:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 547us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.493664:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:3.0:1787367924.505019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.505172:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788525056 00000100:00100000:1.0:1787367924.505180:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788525056 00000100:00100000:1.0:1787367924.505235:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1787367924.505245:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+9:2405:x1874190788525056:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367924.505261:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367924.505279:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e871 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367924.505332:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8911f4, blocks: 0x0 00010000:00010000:1.0:1787367924.505350:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1787367924.505462:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367924.505474:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e871 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.505491:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e871 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.505575:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67ee00, rc 0) 00000100:00100000:1.0:1787367924.505874:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+10:2405:x1874190788525056:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 629us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.505883:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1787367924.520887:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.521049:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788525312 00000100:00100000:2.0:1787367924.521059:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788525312 00000100:00100000:2.0:1787367924.521132:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:2.0:1787367924.521142:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+68:11422:x1874190788525312:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787367924.521247:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+68:11422:x1874190788525312:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.521255:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:1.0:1787367924.525797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.526007:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788525440 00000100:00100000:2.0:1787367924.526017:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788525440 00000100:00100000:2.0:1787367924.526082:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:2.0:1787367924.526092:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+10:11422:x1874190788525440:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367924.526111:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367924.526128:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e878 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.526160:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e871 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.526170:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367924.526173:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367924.526178:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 11 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.526211:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e871 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.526224:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e871 expref: 11 pid: 8451 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367924.526259:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585103480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1874190808519424:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367924.526403:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367924.531289:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585103480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1874190808519424:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367924.531328:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 11 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.531723:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c000, rc 0) 00000100:00100000:2.0:1787367924.531788:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+11:11422:x1874190788525440:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 5696us (5997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.531797:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:1.0:1787367924.531832:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367924.532273:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788525568 00000100:00100000:0.0:1787367924.532378:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788525568 00010000:00010000:0.0:1787367924.532416:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e871 expref: 11 pid: 8451 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367924.532491:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1787367924.532796:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+11:2403:x1874190788525568:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367924.532812:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367924.532831:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e871 expref: 11 pid: 8451 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.532845:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e871 expref: 11 pid: 8451 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.532869:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031016 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e871 expref: 11 pid: 8451 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.532883:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367924.532887:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367924.532894:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 10 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.532916:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 10 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.532952:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 10 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367924.532982:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874190808519552:192.168.203.4@tcp:105: 00000100:00100000:0.0:1787367924.533130:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787367924.536267:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874190808519552:192.168.203.4@tcp:105: 00010000:00010000:0.0:1787367924.536294:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367924.536425:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+10:2403:x1874190788525568:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3923us (4590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367924.536437:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:3.0:1787367924.537575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367924.537791:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788525696 00000100:00100000:0.0:1787367924.537865:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788525696 00002000:00100000:0.0:1787367924.537921:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c5483796a00 x1874190788525696/t0(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:565/0 lens 504/0 e 0 to 0 dl 1787367935 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787367924.537932:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483796a00 with x1874190788525696 ext(0->12) 00002000:00010000:0.0:1787367924.537937:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483796a00 00000100:00100000:0.0:1787367924.538027:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:0.0:1787367924.538037:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6033427c-dc64-421a-b37f-d4458dbaa527+10:2403:x1874190788525696:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787367924.539195:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6033427c-dc64-421a-b37f-d4458dbaa527+12:2403:x1874190788525696:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 1152us (1617us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787367924.539206:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00002000:00100000:0.0:1787367924.539217:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c5483796a00 x1874190788525696/t4294967309(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:565/0 lens 504/448 e 0 to 0 dl 1787367935 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787367924.539226:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483796a00 with x1874190788525696 ext(0->12) 00002000:00010000:0.0:1787367924.539230:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483796a00 00000100:00100000:3.0:1787367924.544439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.544912:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788525824 00000100:00100000:2.0:1787367924.544923:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788525824 00000100:00100000:2.0:1787367924.545227:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:2.0:1787367924.545238:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+68:11422:x1874190788525824:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787367924.547455:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1787367924.547472:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787367924.547516:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787367924.547542:0:6517:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c5598227e40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787367924.547547:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c558121ef00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c5482540300 00000020:00080000:0.0:1787367924.547551:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c558121e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c548223a800 00000004:00080000:0.0:1787367924.547572:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787367924.547594:0:6517:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c5582bdf180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787367924.547597:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55bd75ac00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c5582bdf000 00000020:00080000:0.0:1787367924.547601:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55bd75a700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c5483e5fa00 00000020:00080000:0.0:1787367924.547624:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787367924.547678:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787367924.547956:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367924.547987:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808519680:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787367924.548064:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367924.548107:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808519680 00000100:00100000:3.0:1787367924.548114:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808519680 00000100:00100000:3.0:1787367924.548157:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787367924.548166:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808519680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787367924.548189:0:8454:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1787367924.548218:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8911f3, atime: 0x6a8911f3, ctime: 0x6a8911f3, blocks: 0x8 00010000:00010000:3.0:1787367924.548226:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.548242:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1787367924.548246:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367924.548252:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.548266:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.548276:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.548283:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.548316:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787367924.548457:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1874190808519680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 291us (392us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787367924.548464:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1787367924.548483:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367924.548489:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.548703:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808519808:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787367924.548737:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367924.548757:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367924.548763:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808519936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787367924.548783:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787367924.548877:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175a00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367924.548882:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.548892:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.548916:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.548925:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026fb6dbd/0x66f5679bff031024 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.548942:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367924.548944:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367924.548945:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787367924.548977:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c5483797800/2, rc 0, transno 4294967305 00000100:00100000:3.0:1787367924.548983:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808519680:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787367924.549008:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808519808 00000100:00100000:3.0:1787367924.549013:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808519808 00000100:00100000:3.0:1787367924.549173:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808519936 00000100:00100000:3.0:1787367924.549177:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808519936 00000100:00100000:3.0:1787367924.549195:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787367924.549200:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1874190808519808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787367924.549216:0:8925:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1787367924.549231:0:8925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.549245:0:8925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d0 expref: 11 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.549252:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787367924.549256:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367924.549260:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.549283:0:8925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d0 expref: 11 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.549297:0:8925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d0 expref: 11 pid: 8451 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367924.549309:0:8925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8925:1874190808520064:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367924.549402:0:8925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58180 going to sleep for 11 seconds 00000100:00100000:3.0:1787367924.549425:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787367924.549433:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3651:x1874190808519936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787367924.549706:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787367924.549710:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787367924 00002000:00010000:3.0:1787367924.549713:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787367924.549715:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787367924 -> 1787367924 00002000:00010000:3.0:1787367924.549717:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787367924.549766:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3651:x1874190808519936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 333us (980us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787367924.549773:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787367924.549888:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787367924.549966:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c55be7f4e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787367924.549973:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808519936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787367924.550537:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+22:11422:x1874190788525824:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 5300us (6107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367924.550546:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 136 00010000:00010000:2.0:1787367924.552939:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.552955:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.552963:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.552979:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367924.552984:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553008:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553026:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367924.553028:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367924.553033:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553039:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175400/0x66f5679bff030d22 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553077:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553084:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553089:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553093:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367924.553097:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553103:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553111:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:2.0:1787367924.553113:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367924.553116:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553133:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff030dca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553152:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553159:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553164:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553169:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367924.553172:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553178:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553187:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483604900) 00010000:00010000:2.0:1787367924.553189:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367924.553192:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553197:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff030e48 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553208:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553215:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553227:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553233:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367924.553236:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553243:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553251:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483604900) 00010000:00010000:2.0:1787367924.553254:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367924.553257:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553262:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2174c00/0x66f5679bff030e6b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553279:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553284:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553290:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553295:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367924.553298:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553313:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553321:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367924.553323:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367924.553326:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553331:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff030f3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553342:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553349:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553371:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553376:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367924.553379:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553385:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553392:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:2.0:1787367924.553394:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367924.553397:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.553414:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff030ffa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.555172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.555318:0:8925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8925:1874190808520064:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367924.555342:0:8925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367924.555686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788525952 00000100:00100000:2.0:1787367924.555694:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788525952 00010000:00010000:2.0:1787367924.555730:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d0 expref: 12 pid: 8451 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367924.555767:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:2.0:1787367924.555776:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55833d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+12:2402:x1874190788525952:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367924.555791:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367924.555797:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d0 expref: 12 pid: 8451 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.555940:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d0 expref: 12 pid: 8451 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.555971:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff030dd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7d0 expref: 12 pid: 8451 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.555987:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367924.555991:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367924.555997:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.556006:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.556199:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367924.556285:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55833d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+11:2402:x1874190788525952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 509us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.556294:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00010000:00010000:0.0:1787367924.556384:0:8925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.556394:0:8925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.556404:0:8925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.556425:0:8925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.556445:0:8925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787367924.556643:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3651:x1874190808519808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7440us (7904us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787367924.556650:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1787367924.556846:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c55be7f5880/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787367924.556853:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808519808:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787367924.557007:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367924.557014:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.557023:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2175600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787367924.557028:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.557038:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.557063:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.557070:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2c56340/0x66f5679bff03102b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.557091:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367924.557093:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367924.557095:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367924.561221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367924.561312:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788526080 00000100:00100000:0.0:1787367924.561322:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788526080 00000100:00100000:0.0:1787367924.561536:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1787367924.561547:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+11:2403:x1874190788526080:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787367924.564096:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787367924.564113:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787367924.564280:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788526080:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 2731us (3064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.564306:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1787367924.569308:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.569386:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788526336 00000100:00100000:3.0:1787367924.569396:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788526336 00000100:00100000:3.0:1787367924.569454:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:3.0:1787367924.569464:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+16:11422:x1874190788526336:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787367924.569636:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367924.569662:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff03100f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e86a expref: 16 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.569679:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:3.0:1787367924.569685:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367924.569712:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.569737:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.569746:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367924.570481:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047b938f4 reply state 00000000e9297e39 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.570770:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.570782:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:3.0:1787367924.570785:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787367924.570788:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367924.570918:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+17:11422:x1874190788526336:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 1455us (1619us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1787367924.570926:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:1.0:1787367924.576667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367924.576762:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788526464 00000100:00100000:0.0:1787367924.576772:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788526464 00000100:00100000:0.0:1787367924.576930:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1787367924.576941:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788526464:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787367924.577109:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787367924.577113:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787367924 -> 1787367923 00002000:00010000:0.0:1787367924.577115:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787367923 00002000:00010000:0.0:1787367924.577117:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787367924 -> 1787367923 00002000:00010000:0.0:1787367924.577130:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787367924.577193:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788526464:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 254us (534us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787367924.577217:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1787367924.580194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.580304:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788526720 00000100:00100000:3.0:1787367924.580314:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788526720 00000100:00100000:3.0:1787367924.580395:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:3.0:1787367924.580405:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+17:11422:x1874190788526720:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787367924.580466:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.580485:0:9404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e85c expref: 17 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.580494:0:9404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.580551:0:9404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e85c expref: 17 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.580565:0:9404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e85c expref: 17 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367924.580579:0:9404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808520192:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367924.580645:0:9404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367924.584069:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.584170:0:9404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808520192:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367924.584195:0:9404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367924.584332:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788526848 00000100:00100000:2.0:1787367924.584339:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788526848 00010000:00010000:2.0:1787367924.584403:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e85c expref: 18 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367924.584439:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:2.0:1787367924.584448:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:2402:x1874190788526848:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367924.584464:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367924.584471:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e85c expref: 18 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.584483:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e85c expref: 18 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.584516:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff030ff3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e85c expref: 18 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.584532:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:2.0:1787367924.584537:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.584546:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.584553:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.584603:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367924.584652:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+17:2402:x1874190788526848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 205us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.584661:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00010000:00010000:3.0:1787367924.584976:0:9404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.584984:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.585020:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.585026:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.585033:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.585040:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367924.585043:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.585059:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.585068:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:3.0:1787367924.585071:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787367924.585075:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.585081:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74a00/0x66f5679bff031039 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367924.585148:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+16:11422:x1874190788526720:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 4744us (4960us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787367924.585156:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:1.0:1787367924.589024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.589113:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788526976 00000100:00100000:3.0:1787367924.589130:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788526976 00000100:00100000:3.0:1787367924.589183:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:3.0:1787367924.589194:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2403:x1874190788526976:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787367924.589235:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.589254:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.589263:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367924.589267:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367924.589272:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.589320:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.589333:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 7 pid: 8453 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367924.589347:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8451:1874190808520320:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367924.589453:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367924.595071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.595249:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788527104 00000100:00100000:1.0:1787367924.595258:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788527104 00010000:00010000:1.0:1787367924.595299:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 8 pid: 8453 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.595338:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:1.0:1787367924.595349:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788527104:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367924.595401:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367924.595423:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 8 pid: 8453 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.595437:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 8 pid: 8453 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.595462:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367924.595467:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367924.595472:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.595483:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.595518:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367924.595567:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788527104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 219us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.595589:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00010000:00010000:3.0:1787367924.596091:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008888fb08/0x66f5679bff03101d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e878 expref: 7 pid: 8453 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367924.596107:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8451:1874190808520320:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367924.596136:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.596147:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.596155:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.596175:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.596197:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.596205:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.596212:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367924.596215:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.596224:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.596236:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.596243:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000931493a1/0x66f5679bff031040 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367924.596316:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788526976:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 7123us (7300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367924.596324:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1787367924.600160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.600273:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788527360 00000100:00100000:1.0:1787367924.600282:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788527360 00000100:00100000:1.0:1787367924.600338:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:1.0:1787367924.600349:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+16:11422:x1874190788527360:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787367924.600442:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.600459:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e824 expref: 16 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.600469:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.600534:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e824 expref: 16 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.600548:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e824 expref: 16 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.600562:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808520448:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367924.600640:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367924.605033:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808520448:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367924.605551:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367924.606105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.606514:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788527488 00000100:00100000:3.0:1787367924.606522:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788527488 00010000:00010000:3.0:1787367924.606557:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e824 expref: 17 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367924.606619:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:3.0:1787367924.606628:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+17:2403:x1874190788527488:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367924.606644:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367924.606651:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e824 expref: 17 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.606664:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e824 expref: 17 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.606684:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff030f36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e824 expref: 17 pid: 9404 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.606699:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:3.0:1787367924.606705:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e847 expref: 16 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.606715:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.606723:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.606731:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.606761:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367924.607172:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.607181:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.607334:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.607347:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e863 expref: 17 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.607882:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.607928:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e863 expref: 17 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.607941:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e863 expref: 17 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367924.607955:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808520576:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367924.608098:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+17:2403:x1874190788527488:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1468us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367924.608113:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:2.0:1787367924.608444:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93900 going to sleep for 11 seconds 00000100:00100000:2.0:1787367924.611428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367924.611540:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788527616 00000100:00100000:3.0:1787367924.611549:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788527616 00010000:00010000:3.0:1787367924.611599:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e863 expref: 17 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367924.611638:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:3.0:1787367924.611648:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+17:2402:x1874190788527616:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367924.611664:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367924.611671:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e863 expref: 17 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.611684:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e863 expref: 17 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.611704:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:3.0:1787367924.611709:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.611718:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.611727:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.611744:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367924.611792:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+17:2402:x1874190788527616:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 145us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367924.611827:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00010000:00010000:1.0:1787367924.612114:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031001 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e863 expref: 16 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.612150:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808520576:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367924.612168:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.612177:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.612182:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367924.612283:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1787367924.612427:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1787367924.612463:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1787367924.612534:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6540:1874190808520704:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787367924.612596:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367924.612928:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ffb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367924.614252:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808520704 00000100:00100000:2.0:1787367924.614264:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808520704 00000100:00100000:2.0:1787367924.614320:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787367924.614330:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6540:x1874190808520704:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787367924.614479:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6540:x1874190808520704:12345-0@lo:1000:mdt00_002.0 Request processed in 150us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.614488:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787367924.614624:0:6540:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1787367924.614631:0:6540:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1787367924.614653:0:6540:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c55be7f4e00, transno 4294967310 00000004:00080000:1.0:1787367924.614670:0:6540:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c55be7f5880, transno 4294967311 00000100:00100000:1.0:1787367924.614677:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6540:1874190808520704:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787367924.614797:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1787367924.615313:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6540:1874190808520832:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787367924.615380:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367924.615407:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367924.615489:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808520832 00000100:00100000:3.0:1787367924.615496:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808520832 00000100:00100000:3.0:1787367924.615528:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787367924.615536:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6540:x1874190808520832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787367924.615657:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6540:x1874190808520832:12345-0@lo:1000:mdt00_002.0 Request processed in 121us (303us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787367924.615663:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787367924.615810:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6540:1874190808520832:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787367924.615858:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615868:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615875:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615881:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367924.615885:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615892:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615917:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:1.0:1787367924.615921:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787367924.615926:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615933:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03104e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615956:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615972:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615979:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.615995:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367924.615998:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.616004:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.616013:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367924.616015:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787367924.616021:0:6540:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e847 expref: 19 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.616031:0:6540:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e847 expref: 19 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.616040:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e847 expref: 19 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.616074:0:6540:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e847 expref: 19 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.616085:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808520960:192.168.203.4@tcp:105: 00000100:00100000:1.0:1787367924.616152:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff240 going to sleep for 11 seconds 00000100:00100000:2.0:1787367924.624584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.624699:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808520960:192.168.203.4@tcp:105: 00010000:00010000:1.0:1787367924.624737:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624766:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff030f91 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624810:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624825:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624835:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624846:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624853:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624860:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624866:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367924.624870:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624877:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624887:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367924.624890:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367924.624893:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624917:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031055 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624929:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624936:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624942:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624947:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367924.624951:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624957:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624966:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367924.624977:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787367924.624981:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.624987:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031047 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.625161:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+19:11422:x1874190788527360:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 24812us (25008us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787367924.625170:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 139 00000020:00080000:1.0:1787367924.625181:0:6540:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787367924.625741:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367924.625746:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367924.626273:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787367924.626282:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367924.626505:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788527744 00000100:00100000:0.0:1787367924.626513:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788527744 00000100:00100000:0.0:1787367924.626562:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:0.0:1787367924.626571:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:11420:x1874190788527744:12345-192.168.203.4@tcp:49:lfs.0 00000100:00100000:0.0:1787367924.626680:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:11420:x1874190788527744:12345-192.168.203.4@tcp:49:lfs.0 Request processed in 109us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367924.626689:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1787367924.631446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367924.631530:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788528000 00000100:00100000:0.0:1787367924.631540:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788528000 00000100:00100000:0.0:1787367924.631601:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:0.0:1787367924.631611:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+19:11420:x1874190788528000:12345-192.168.203.4@tcp:58:lfs.0 00000040:00080000:0.0:1787367924.631780:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787367924.632026:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+19:11420:x1874190788528000:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 415us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367924.632035:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:2.0:1787367924.634283:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367924.634306:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808521088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367924.634405:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367924.634912:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808521088 00000100:00100000:3.0:1787367924.634920:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808521088 00000100:00100000:3.0:1787367924.634984:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787367924.634994:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808521088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787367924.635030:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787367924.635103:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808521088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367924.635110:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787367924.635307:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808521088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367924.636091:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808521472:0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636135:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367924.636160:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808521984:0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636186:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367924.636207:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787367924.636213:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808521344:0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636235:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367924.636248:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808521856:0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636279:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367924.636296:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808522368:0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636316:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367924.636344:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808521984 00000100:00100000:2.0:1787367924.636350:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808521984 00000100:00100000:2.0:1787367924.636414:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808522368 00000100:00100000:2.0:1787367924.636417:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808522368 00000100:00100000:2.0:1787367924.636442:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787367924.636450:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808521984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636492:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808521984:12345-0@lo:400:kworker.0 Request processed in 43us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.636499:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787367924.636513:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787367924.636519:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808522368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636547:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808522368:12345-0@lo:400:kworker.0 Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.636552:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787367924.636591:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808522368:0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636601:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808521984:0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636627:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808521472 00000100:00100000:2.0:1787367924.636631:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808521472 00000100:00100000:2.0:1787367924.636654:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808521344 00000100:00100000:2.0:1787367924.636657:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808521344 00000100:00100000:2.0:1787367924.636667:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808521856 00000100:00100000:2.0:1787367924.636670:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808521856 00000100:00100000:2.0:1787367924.636685:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787367924.636691:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808521472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636732:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808521472:12345-0@lo:400:kworker.0 Request processed in 41us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.636739:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787367924.636761:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808521472:0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.636778:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787367924.636785:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808521344:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787367924.637038:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367924.637053:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367924.637055:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367924.637068:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808521216:0@lo:400:kworker.0 00000100:00100000:0.0:1787367924.638181:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808521600:0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.643499:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367924.643553:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808521728:0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.643604:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367924.643620:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808522240:0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.643640:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367924.643676:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808521216 00000100:00100000:1.0:1787367924.643683:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808521216 00000100:00100000:1.0:1787367924.643726:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787367924.643735:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808521216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.643785:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808521216:12345-0@lo:400:kworker.0 Request processed in 50us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.643792:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787367924.643838:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808521216:0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.643861:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808521728 00000100:00100000:1.0:1787367924.643864:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808521728 00000100:00080000:1.0:1787367924.643884:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367924.643914:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808522240 00000100:00100000:1.0:1787367924.643918:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808522240 00000100:00100000:0.0:1787367924.643927:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787367924.643931:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787367924.643946:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787367924.643950:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808522112:0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.643952:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808521856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367924.643974:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367924.644017:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808521856:12345-0@lo:400:kworker.0 Request processed in 65us (7738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.644024:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00080000:1.0:1787367924.644229:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b32a00 x1874190808521856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367924.644241:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808521856:0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.644262:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808522112 00000100:00100000:1.0:1787367924.644265:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808522112 00000100:00080000:1.0:1787367924.644279:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367924.644296:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787367924.644302:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808521728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.644336:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808521728:12345-0@lo:400:kworker.0 Request processed in 34us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.644343:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787367924.644383:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808521728:0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.644400:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787367924.644406:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808522240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.644437:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808522240:12345-0@lo:400:kworker.0 Request processed in 32us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.644443:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00010000:00080000:1.0:1787367924.644464:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483def480 x1874190808522240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367924.644473:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808522240:0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.644490:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787367924.644505:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808522112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367924.644536:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808522112:12345-0@lo:400:kworker.0 Request processed in 33us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.644542:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787367924.644720:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808521344:12345-0@lo:400:kworker.0 Request processed in 7934us (8482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.644728:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787367924.644809:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808521344:0@lo:400:kworker.0 00000100:00100000:0.0:1787367924.645087:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808521600 00000100:00100000:0.0:1787367924.645092:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808521600 00000100:00100000:0.0:1787367924.645136:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787367924.645144:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808521600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367924.645189:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808521600:12345-0@lo:400:kworker.0 Request processed in 47us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367924.645195:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787367924.645224:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808521600:0@lo:400:kworker.0 00000100:00100000:0.0:1787367924.645233:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808522112:0@lo:400:kworker.0 00000100:00100000:2.0:1787367924.648646:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367924.648694:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788528256 00000100:00100000:0.0:1787367924.648704:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788528256 00000100:00100000:0.0:1787367924.648769:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:0.0:1787367924.648780:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:11422:x1874190788528256:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787367924.649071:0:6541:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787367924.649103:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1787367924.649135:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.649151:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.649163:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.649171:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.649177:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.649184:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367924.649226:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787367924.649323:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+21:11422:x1874190788528256:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 544us (685us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787367924.649332:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000020:00080000:0.0:1787367924.649337:0:6541:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787367924.651527:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367924.651541:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.651552:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367924.651556:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.651565:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.651592:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:3.0:1787367924.651610:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787367924.651615:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.651621:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03105c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367924.651637:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367924.651638:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367924.651640:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367924.663653:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.663958:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788528384 00000100:00100000:1.0:1787367924.663978:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788528384 00000100:00100000:1.0:1787367924.664037:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:1.0:1787367924.664047:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+21:11424:x1874190788528384:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367924.664079:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367924.664099:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031063 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e87f expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664160:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664174:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664185:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664199:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664206:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664212:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664294:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664304:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e840 expref: 22 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664312:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664342:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e840 expref: 22 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.664397:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e840 expref: 22 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.664409:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808522496:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367924.664492:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff840 going to sleep for 11 seconds 00000100:00100000:1.0:1787367924.666988:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808522496:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367924.667016:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367924.668249:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367924.668341:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788528640 00000100:00100000:2.0:1787367924.668348:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788528640 00000100:00100000:2.0:1787367924.668438:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1787367924.668447:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+23:6184:x1874190788528640:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787367924.668671:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+24:6184:x1874190788528640:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 224us (426us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787367924.668679:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1787367924.671275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367924.671419:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788528768 00000100:00100000:1.0:1787367924.671429:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788528768 00010000:00010000:1.0:1787367924.671467:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e840 expref: 24 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367924.671495:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1787367924.671504:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+24:2403:x1874190788528768:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367924.671530:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367924.671537:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e840 expref: 24 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.671549:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e840 expref: 24 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.671570:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff030f83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e840 expref: 24 pid: 6538 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.671647:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367924.671653:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.671663:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.671670:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367924.671741:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367924.671795:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+23:2403:x1874190788528768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 291us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367924.671804:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00010000:00010000:2.0:1787367924.672766:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.672779:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367924.672832:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787367924.672837:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367924.672870:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.672884:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.672893:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.672910:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.672918:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.672925:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367924.672929:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.672936:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.672947:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367924.672950:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367924.672954:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673023:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03106a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673040:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673047:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673126:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673132:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367924.673135:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673141:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673149:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c5483604000) 00010000:00010000:2.0:1787367924.673151:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367924.673154:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673159:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031071 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673197:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031063 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e87f expref: 23 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673210:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e87f expref: 22 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367924.673217:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367924.673218:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367924.673221:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67ee00, rc 0) 00000100:00100000:2.0:1787367924.673276:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+22:11424:x1874190788528384:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 9231us (9636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367924.673294:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 141 00010000:00010000:3.0:1787367925.082036:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367925.144494:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808522624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367925.144563:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367925.144625:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55a9484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808522752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367925.144651:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367925.144683:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808522624 00000100:00100000:0.0:1787367925.144689:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808522624 00000100:00100000:0.0:1787367925.144727:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808522752 00000100:00100000:0.0:1787367925.144731:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808522752 00000100:00100000:0.0:1787367925.144746:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787367925.144754:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808522624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367925.144775:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787367925.144818:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808522624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367925.144825:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787367925.144840:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787367925.144846:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808522752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367925.144863:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787367925.144896:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808522752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367925.144913:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787367925.144971:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55a9484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808522752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367925.145002:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808522624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367925.146805:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808522880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367925.146866:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367925.146970:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808522880 00000100:00100000:3.0:1787367925.146977:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808522880 00000100:00100000:3.0:1787367925.147025:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787367925.147035:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808522880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367925.147055:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1787367925.147177:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808522880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367925.147184:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787367925.147225:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808522880:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787367925.607954:0:14328:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367925.607964:0:14328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367925.608005:0:14328:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787367925.608019:0:14328:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787367925.656889:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367925.656920:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808523008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367925.657004:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367925.657077:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808523008 00000100:00100000:1.0:1787367925.657084:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808523008 00000100:00100000:1.0:1787367925.657146:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787367925.657154:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808523008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367925.657174:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787367925.657217:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808523008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367925.657236:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1787367925.657255:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367925.657289:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808523008:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787367925.658180:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367925.658186:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367925.658219:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787367925.658467:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367925.658832:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585142680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808523136:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787367925.658918:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367925.665875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367925.665935:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788528896 00000100:00100000:2.0:1787367925.665944:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788528896 00000100:00100000:2.0:1787367925.665998:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:2.0:1787367925.666006:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+23:11435:x1874190788528896:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787367925.666047:0:9404:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787367925.666278:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585142680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808523136:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367925.667127:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+22:11435:x1874190788528896:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 1034us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367925.667137:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:3.0:1787367925.672113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367925.676334:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788529152 00000100:00100000:2.0:1787367925.676349:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788529152 00000100:00100000:2.0:1787367925.676437:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 143 00000100:00100000:2.0:1787367925.676448:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+22:11435:x1874190788529152:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367925.676468:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367925.676486:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03107f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e886 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367925.676708:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031086 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367925.676721:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367925.676740:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367925.676751:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787367925.676853:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03107f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e886 expref: 25 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367925.676867:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031086 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e886 expref: 24 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367925.676875:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367925.676878:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367925.676881:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ce00, rc 0) 00000100:00100000:2.0:1787367925.677045:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+24:11435:x1874190788529152:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 598us (4941us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787367925.677053:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 143 00000100:00100000:0.0:1787367925.682141:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367925.682275:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788529408 00000100:00100000:3.0:1787367925.682285:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788529408 00000100:00100000:3.0:1787367925.682345:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:3.0:1787367925.682391:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a9484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+24:11435:x1874190788529408:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787367925.682463:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.682481:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.682492:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.682820:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.682828:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.682834:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.682839:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367925.682843:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.682850:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.682861:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:3.0:1787367925.682873:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787367925.682879:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.682885:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74800/0x66f5679bff031094 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367925.683011:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a9484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+25:11435:x1874190788529408:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 656us (878us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787367925.683018:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 144 00000040:00080000:1.0:1787367925.683200:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367925.683205:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787367925.683833:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787367925.683842:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367925.685631:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367925.685763:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788529536 00000100:00100000:3.0:1787367925.685773:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788529536 00000100:00100000:3.0:1787367925.685833:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1787367925.685842:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+25:2403:x1874190788529536:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367925.685856:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367925.685879:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031086 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e886 expref: 25 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367925.685906:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:3.0:1787367925.685912:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367925.685962:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+24:2403:x1874190788529536:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 120us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367925.685970:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1787367925.701618:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367925.701837:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788529792 00000100:00100000:1.0:1787367925.701846:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788529792 00000100:00100000:1.0:1787367925.701909:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1787367925.701919:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+24:11435:x1874190788529792:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787367925.702103:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+25:11435:x1874190788529792:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 186us (497us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787367925.702112:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00010000:00010000:2.0:1787367926.104566:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367926.680660:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808523264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367926.680729:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367926.681032:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808523264 00000100:00100000:2.0:1787367926.681040:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808523264 00000100:00100000:2.0:1787367926.681093:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787367926.681103:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808523264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367926.681135:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367926.681195:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808523264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367926.681212:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787367926.681393:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808523264:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787367927.129709:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787367927.539624:0:14380:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367927.539634:0:14380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367927.539668:0:14380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787367927.539674:0:14380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367927.724208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367927.724385:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788530048 00000100:00100000:1.0:1787367927.724393:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788530048 00000100:00100000:1.0:1787367927.724454:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:1.0:1787367927.724464:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+25:11456:x1874190788530048:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367927.724498:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367927.724517:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03109b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e88d expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.724618:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff0310a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.724632:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff0310a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.724644:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff0310a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367927.724655:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787367927.724752:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03109b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e88d expref: 28 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.724768:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff0310a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e88d expref: 27 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.724776:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367927.724778:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787367927.724781:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f800, rc 0) 00000100:00100000:1.0:1787367927.724830:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+27:11456:x1874190788530048:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 368us (631us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787367927.724838:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00080000:3.0:1787367927.726268:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367927.736831:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367927.736870:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788530176 00000100:00100000:1.0:1787367927.736878:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788530176 00000100:00100000:1.0:1787367927.738125:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:1.0:1787367927.738135:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+27:11456:x1874190788530176:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:1.0:1787367927.738196:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.738213:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.738224:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.738255:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.738262:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.738268:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.738275:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367927.738279:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.738286:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.738297:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:1.0:1787367927.738300:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367927.738303:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367927.738320:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0310b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367927.738411:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+27:11456:x1874190788530176:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 277us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367927.738418:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 146 00000100:00100000:3.0:1787367927.825824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367927.825996:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788530304 00000100:00100000:2.0:1787367927.826007:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788530304 00000100:00100000:2.0:1787367927.826093:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1787367927.826112:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2404:x1874190788530304:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:2.0:1787367927.826131:0:8925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367927.826149:0:8925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a75d8b6/0x66f5679bff0310b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e894 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367927.826173:0:8925:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8911f3, atime: 0x6a8911f3, ctime: 0x6a8911f3, blocks: 0x8 00010000:00010000:2.0:1787367927.826192:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1787367927.826197:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367927.826206:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a75d8b6/0x66f5679bff0310b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e894 expref: 7 pid: 8925 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367927.826223:0:8925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a75d8b6/0x66f5679bff0310b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e894 expref: 7 pid: 8925 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367927.826236:0:8925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ca00, rc 0) 00000100:00100000:2.0:1787367927.826297:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:2404:x1874190788530304:12345-192.168.203.4@tcp:101:cat.0 Request processed in 188us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367927.826304:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00080000:3.0:1787367927.826847:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367927.830705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367927.834820:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788530432 00000100:00100000:0.0:1787367927.834835:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788530432 00002000:00100000:0.0:1787367927.834911:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9c5483cef800 x1874190788530432/t0(0) o3->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:568/0 lens 488/0 e 0 to 0 dl 1787367938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787367927.834922:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483cef800 with x1874190788530432 ext(0->4095) 00002000:00010000:0.0:1787367927.834927:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483cef800 00000100:00100000:0.0:1787367927.835033:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1787367927.835045:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788530432:12345-192.168.203.4@tcp:3:cat.0 00000100:00100000:0.0:1787367927.835218:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788530432:12345-192.168.203.4@tcp:3:cat.0 Request processed in 175us (4521us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787367927.835226:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00002000:00100000:0.0:1787367927.835234:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9c5483cef800 x1874190788530432/t0(0) o3->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:568/0 lens 488/4536 e 0 to 0 dl 1787367938 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787367927.835242:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483cef800 with x1874190788530432 ext(0->4095) 00002000:00010000:0.0:1787367927.835246:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483cef800 00000040:00080000:1.0:1787367928.089319:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787367928.152555:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787367928.734811:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1787367928.734826:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:1.0:1787367928.792654:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367928.792663:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787367928.792682:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787367928.792692:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787367929.154471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367929.154506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367929.154528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367929.154553:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367929.154571:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367929.154590:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367929.154610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367929.154635:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788530688 00000100:00100000:1.0:1787367929.154645:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788530688 00000100:00100000:1.0:1787367929.154696:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788531200 00000100:00100000:1.0:1787367929.154699:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788531200 00000100:00100000:1.0:1787367929.154713:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788530816 00000100:00100000:1.0:1787367929.154715:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788530816 00000100:00100000:1.0:1787367929.154727:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788531328 00000100:00100000:1.0:1787367929.154730:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788531328 00000100:00100000:1.0:1787367929.154745:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:1.0:1787367929.154754:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+27:2404:x1874190788530688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367929.154828:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+27:2404:x1874190788530688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 75us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367929.154837:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 297 00000100:00100000:1.0:1787367929.154854:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 298 00000100:00100000:1.0:1787367929.154861:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788531200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367929.154899:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788531200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367929.154905:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 298 00000100:00100000:1.0:1787367929.154918:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 299 00000100:00100000:1.0:1787367929.154923:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788530816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367929.154946:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788530816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367929.154952:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 299 00000100:00100000:1.0:1787367929.154963:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 300 00000100:00100000:1.0:1787367929.154969:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788531328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367929.154989:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788531328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367929.154995:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 300 00000100:00080000:1.0:1787367929.155015:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367929.155018:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367929.155240:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788530944 00000100:00100000:0.0:1787367929.155245:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788530944 00000100:00100000:0.0:1787367929.155285:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788531072 00000100:00100000:0.0:1787367929.155289:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788531072 00000100:00100000:0.0:1787367929.155308:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:0.0:1787367929.155315:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788530944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367929.155349:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788530944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.155376:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:0.0:1787367929.155389:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:0.0:1787367929.155396:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2404:x1874190788531072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367929.155430:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2404:x1874190788531072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.155436:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00080000:1.0:1787367929.155617:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367929.155620:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367929.156558:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788530560 00000100:00100000:2.0:1787367929.156567:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788530560 00000100:00100000:2.0:1787367929.156607:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 383 00000100:00100000:2.0:1787367929.156616:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788530560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367929.156665:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788530560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367929.156672:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 383 00010000:00010000:2.0:1787367929.178739:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367929.752671:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808523392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367929.752749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367929.753724:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808523392 00000100:00100000:2.0:1787367929.753735:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808523392 00000100:00100000:2.0:1787367929.755768:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787367929.755800:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808523392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787367929.755838:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787367929.755940:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808523392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (3190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367929.755959:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787367929.756067:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808523392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367929.756128:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808523648:0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.756165:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367929.756202:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808524160:0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.756243:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367929.756264:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808524672:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.756284:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808523520:0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.756285:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367929.756302:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787367929.756308:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808523776:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.756312:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367929.756327:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367929.756332:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548373c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808524032:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.756349:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367929.756349:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808524288:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.756378:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808524544:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.756395:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367929.756396:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367929.756408:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787367929.756410:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808524800:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.756413:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808523904:0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.756427:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367929.756429:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367929.756821:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808523648 00000100:00100000:0.0:1787367929.756828:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808523648 00000100:00100000:0.0:1787367929.756879:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808524160 00000100:00100000:0.0:1787367929.756882:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808524160 00000100:00100000:0.0:1787367929.756906:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808524672 00000100:00100000:0.0:1787367929.756909:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808524672 00000100:00100000:0.0:1787367929.756920:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808523776 00000100:00100000:0.0:1787367929.756922:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808523776 00000100:00100000:0.0:1787367929.756931:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808524032 00000100:00100000:0.0:1787367929.756933:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808524032 00000100:00100000:0.0:1787367929.757016:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808524544 00000100:00100000:0.0:1787367929.757019:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808524544 00000100:00100000:0.0:1787367929.757038:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787367929.757045:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808523648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757095:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808523648:12345-0@lo:400:kworker.0 Request processed in 50us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.757101:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787367929.757115:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787367929.757126:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808524160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757153:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808524160:12345-0@lo:400:kworker.0 Request processed in 33us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.757159:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787367929.757170:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787367929.757177:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808524672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757217:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808524672:12345-0@lo:400:kworker.0 Request processed in 40us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.757222:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787367929.757234:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787367929.757240:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808523776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757265:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808523776:12345-0@lo:400:kworker.0 Request processed in 26us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.757270:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787367929.757280:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787367929.757285:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808524032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757308:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808524032:12345-0@lo:400:kworker.0 Request processed in 24us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.757313:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787367929.757324:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787367929.757329:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808524544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757350:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808524544:12345-0@lo:400:kworker.0 Request processed in 21us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.757375:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787367929.757400:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808524288 00000100:00100000:0.0:1787367929.757403:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808524288 00000100:00100000:0.0:1787367929.757426:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808524800 00000100:00100000:0.0:1787367929.757429:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808524800 00000100:00100000:0.0:1787367929.757446:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787367929.757451:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808524288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757476:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808524288:12345-0@lo:400:kworker.0 Request processed in 26us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.757491:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787367929.757501:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787367929.757505:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808524800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757532:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808524800:12345-0@lo:400:kworker.0 Request processed in 27us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.757538:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787367929.757574:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808523776:0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757584:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808524288:0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757593:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808524800:0@lo:400:kworker.0 00010000:00080000:0.0:1787367929.757603:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c548373c000 x1874190808524160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367929.757614:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808524160:0@lo:400:kworker.0 00010000:00080000:0.0:1787367929.757623:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483791180 x1874190808524672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367929.757631:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808524672:0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757640:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808523648:0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757680:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808523520 00000100:00100000:0.0:1787367929.757684:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808523520 00000100:00100000:0.0:1787367929.757707:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787367929.757712:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808523520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367929.757739:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808523520:12345-0@lo:400:kworker.0 Request processed in 27us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367929.757754:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:0.0:1787367929.757790:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367929.757794:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367929.757796:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367929.757798:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367929.763521:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808523904 00000100:00100000:3.0:1787367929.763537:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808523904 00000100:00100000:3.0:1787367929.763610:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787367929.763630:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808523904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367929.763733:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808523904:12345-0@lo:400:kworker.0 Request processed in 105us (7302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367929.763741:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787367929.764984:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808523904:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.765000:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808524416:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.765046:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367929.765079:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808524928:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.765097:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367929.765179:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808523520:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.765192:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548373c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808524032:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.765215:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808524544:0@lo:400:kworker.0 00000100:00100000:3.0:1787367929.765431:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808524416 00000100:00100000:3.0:1787367929.765437:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808524416 00000100:00100000:3.0:1787367929.765488:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808524928 00000100:00100000:3.0:1787367929.765491:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808524928 00000100:00100000:3.0:1787367929.765515:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787367929.765524:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808524416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367929.765575:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808524416:12345-0@lo:400:kworker.0 Request processed in 52us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367929.765582:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787367929.765597:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787367929.765603:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808524928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367929.765642:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808524928:12345-0@lo:400:kworker.0 Request processed in 40us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367929.765648:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1787367929.765710:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367929.765715:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367929.765732:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787367929.765737:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1787367929.765754:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c5483797800, transno 4294967305 00000100:00100000:1.0:1787367929.765771:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808524416:0@lo:400:kworker.0 00000100:00100000:1.0:1787367929.765783:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808524928:0@lo:400:kworker.0 00000001:00080000:1.0:1787367929.772863:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1787367929.772911:0:6517:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c54825ffb40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787367929.772917:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55b611b500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c54825ffc00 00000020:00080000:1.0:1787367929.772920:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55b611bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c5584c0da00 00000020:00080000:1.0:1787367929.772943:0:6517:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1787367929.775782:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787367929.775899:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1787367929.776534:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367929.776566:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367929.776573:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367929.776579:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367929.776583:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367929.776591:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367929.776938:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c55bc700c00) 00010000:00010000:3.0:1787367929.776942:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367929.776948:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367929.776955:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74c00/0x66f5679bff031032 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367930.200519:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367930.264716:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808525056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367930.264791:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367930.265000:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808525056 00000100:00100000:3.0:1787367930.265009:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808525056 00000100:00100000:3.0:1787367930.265068:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787367930.265078:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808525056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367930.265105:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787367930.265148:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808525056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367930.265156:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787367930.265302:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808525056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367930.265574:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367930.265584:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808525184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367930.265616:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367930.266290:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808525184 00000100:00100000:1.0:1787367930.266296:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808525184 00000100:00100000:0.0:1787367930.266386:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367930.266398:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808525312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787367930.266437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367930.268647:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808525312 00000100:00100000:1.0:1787367930.268660:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808525312 00000100:00100000:0.0:1787367930.268856:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787367930.268884:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808525184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367930.268914:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367930.268991:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808525184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (3373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367930.268999:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787367930.269017:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787367930.269024:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808525312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367930.269044:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787367930.269079:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808525312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367930.269085:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787367930.269126:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808525312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367930.269505:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808525184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367930.776891:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808525440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367930.776966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367930.777223:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808525440 00000100:00100000:2.0:1787367930.777232:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808525440 00000100:00100000:2.0:1787367930.777284:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787367930.777295:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808525440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367930.777317:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000001:00080000:1.0:1787367930.783959:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1787367930.783973:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1787367930.784210:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808525440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6911us (7237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367930.784222:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787367930.793165:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808525440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367931.239676:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367931.800555:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808525568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787367931.800624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367931.800697:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808525568 00000100:00100000:3.0:1787367931.800704:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808525568 00000100:00100000:3.0:1787367931.800751:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787367931.800762:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808525568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367931.800806:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367931.800864:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808525568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367931.800872:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787367931.800930:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808525568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787367932.249891:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367933.288019:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367933.444473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367933.444572:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788531456 00000100:00100000:0.0:1787367933.444582:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788531456 00000100:00100000:0.0:1787367933.444658:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:0.0:1787367933.444678:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+13:11100:x1874190788531456:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787367933.444775:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+13:11100:x1874190788531456:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 99us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367933.444791:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00080000:1.0:1787367933.445007:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367933.449729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367933.451838:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788531584 00000100:00100000:0.0:1787367933.451861:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788531584 00000100:00100000:0.0:1787367933.451942:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 148 00000100:00100000:0.0:1787367933.451955:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:11100:x1874190788531584:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787367933.452067:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:11100:x1874190788531584:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 115us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367933.452074:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 148 00000100:00080000:1.0:1787367933.452141:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367933.456044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367933.456331:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788531840 00000100:00100000:2.0:1787367933.456340:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788531840 00000100:00100000:2.0:1787367933.456436:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1787367933.456446:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+13:11100:x1874190788531840:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787367933.457684:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+14:11100:x1874190788531840:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1232us (1643us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787367933.457696:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:3.0:1787367933.890592:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367933.891877:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788531968 00000100:00100000:0.0:1787367933.891889:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788531968 00000100:00100000:0.0:1787367933.891968:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 149 00000100:00100000:0.0:1787367933.891978:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:11916:x1874190788531968:12345-192.168.203.4@tcp:101:lsof.0 00010000:00010000:0.0:1787367933.891997:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367933.892017:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff0310be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e89b expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367933.892085:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367933.892098:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367933.892124:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367933.892168:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787367933.892172:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367933.892212:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367933.892238:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff0310be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e89b expref: 7 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367933.892256:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e89b expref: 6 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367933.892264:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:0.0:1787367933.892267:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367933.892271:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613ac00, rc 0) 00000100:00080000:1.0:1787367933.892493:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367933.892621:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:11916:x1874190788531968:12345-192.168.203.4@tcp:101:lsof.0 Request processed in 643us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367933.892629:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 149 00000100:00100000:3.0:1787367934.270396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367934.270435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367934.270470:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367934.270502:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367934.270521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367934.270542:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367934.270567:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367934.270593:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788532480 00000100:00100000:3.0:1787367934.270602:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788532480 00000100:00100000:3.0:1787367934.270652:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788532608 00000100:00100000:3.0:1787367934.270656:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788532608 00000100:00100000:3.0:1787367934.270677:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:3.0:1787367934.270688:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788532480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367934.270771:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788532480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.270917:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788532096 00000100:00100000:1.0:1787367934.270922:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788532096 00000100:00100000:1.0:1787367934.270950:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 385 00000100:00100000:1.0:1787367934.270957:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788532096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367934.270997:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788532096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.271003:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 385 00000100:00080000:1.0:1787367934.271044:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367934.271047:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367934.271070:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788532224 00000100:00100000:1.0:1787367934.271074:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788532224 00000100:00100000:1.0:1787367934.271092:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788532736 00000100:00100000:1.0:1787367934.271094:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788532736 00000100:00100000:1.0:1787367934.271102:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788532352 00000100:00100000:1.0:1787367934.271105:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788532352 00000100:00100000:1.0:1787367934.271115:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788532864 00000100:00100000:1.0:1787367934.271117:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788532864 00000100:00100000:1.0:1787367934.271134:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 307 00000100:00100000:1.0:1787367934.271140:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+14:2403:x1874190788532224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367934.271171:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+14:2403:x1874190788532224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.271177:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 307 00000100:00100000:1.0:1787367934.271188:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 308 00000100:00100000:1.0:1787367934.271194:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:2403:x1874190788532736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367934.271216:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:2403:x1874190788532736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.271222:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 308 00000100:00100000:1.0:1787367934.271233:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 309 00000100:00100000:1.0:1787367934.271240:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788532352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367934.271263:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788532352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.271269:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 309 00000100:00100000:1.0:1787367934.271281:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 310 00000100:00100000:1.0:1787367934.271287:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788532864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367934.271320:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788532864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.271326:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 310 00000100:00080000:1.0:1787367934.271344:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367934.271465:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:1.0:1787367934.276628:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:1.0:1787367934.276657:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788532608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367934.276735:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788532608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 94us (6191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.276743:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 145 00010000:00010000:3.0:1787367934.299680:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367934.872739:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808525952:0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.872821:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367934.872890:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808526464:0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.872916:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367934.872943:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808526976:0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.872963:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367934.872985:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787367934.872991:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808526080:0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367934.873034:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808526592:0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873058:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367934.873071:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808527104:0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367934.873120:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808526592 00000100:00100000:3.0:1787367934.873127:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808526592 00000100:00100000:3.0:1787367934.873173:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808527104 00000100:00100000:3.0:1787367934.873176:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808527104 00000100:00100000:3.0:1787367934.873198:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787367934.873206:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808526592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873253:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808526592:12345-0@lo:400:kworker.0 Request processed in 49us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367934.873275:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787367934.873293:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787367934.873299:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808527104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873331:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808527104:12345-0@lo:400:kworker.0 Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367934.873337:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787367934.873388:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808526464 00000100:00100000:3.0:1787367934.873391:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808526464 00000100:00100000:3.0:1787367934.873418:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808526976 00000100:00100000:3.0:1787367934.873421:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808526976 00000100:00100000:3.0:1787367934.873435:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808526080 00000100:00100000:3.0:1787367934.873437:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808526080 00000100:00100000:3.0:1787367934.873448:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787367934.873454:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808526464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873486:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808526464:12345-0@lo:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367934.873492:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787367934.873504:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787367934.873510:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808526976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873534:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808526976:12345-0@lo:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367934.873539:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787367934.873549:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787367934.873554:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808526080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873574:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808526080:12345-0@lo:400:kworker.0 Request processed in 21us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367934.873589:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787367934.873621:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808526080:0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873630:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808526592:0@lo:400:kworker.0 00000100:00100000:3.0:1787367934.873637:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808527104:0@lo:400:kworker.0 00010000:00080000:3.0:1787367934.873647:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483dec380 x1874190808526464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367934.873657:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808526464:0@lo:400:kworker.0 00010000:00080000:3.0:1787367934.873666:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f5880 x1874190808526976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367934.873674:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808526976:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.873895:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808525824:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.873935:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367934.873960:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808526336:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.873980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367934.873997:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808526848:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874016:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367934.874034:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787367934.874040:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808525696:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874065:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367934.874086:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808526208:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874106:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367934.874121:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808526720:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874137:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367934.874153:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808527232:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874183:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367934.874208:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808525696 00000100:00100000:1.0:1787367934.874213:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808525696 00000100:00100000:1.0:1787367934.874242:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787367934.874248:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808525696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874281:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808525696:12345-0@lo:400:kworker.0 Request processed in 33us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.874287:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787367934.874310:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808525952 00000100:00100000:1.0:1787367934.874314:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808525952 00000100:00100000:1.0:1787367934.874335:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808526208 00000100:00100000:1.0:1787367934.874338:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808526208 00000100:00100000:1.0:1787367934.874351:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787367934.874376:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808525952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874411:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808525952:12345-0@lo:400:kworker.0 Request processed in 36us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.874418:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787367934.874429:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787367934.874434:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808526208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874458:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808526208:12345-0@lo:400:kworker.0 Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.874464:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787367934.874482:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808526720 00000100:00100000:1.0:1787367934.874485:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808526720 00000100:00100000:1.0:1787367934.874507:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808527232 00000100:00100000:1.0:1787367934.874510:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808527232 00000100:00100000:1.0:1787367934.874524:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787367934.874529:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808526720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874564:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808526720:12345-0@lo:400:kworker.0 Request processed in 35us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.874571:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787367934.874582:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787367934.874588:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808527232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874613:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808527232:12345-0@lo:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.874619:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787367934.874634:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808525824 00000100:00100000:1.0:1787367934.874637:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808525824 00000100:00100000:1.0:1787367934.874652:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808526336 00000100:00100000:1.0:1787367934.874655:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808526336 00000100:00100000:1.0:1787367934.874666:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808526848 00000100:00100000:1.0:1787367934.874668:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808526848 00000100:00100000:1.0:1787367934.874680:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787367934.874685:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808525824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874713:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808525824:12345-0@lo:400:kworker.0 Request processed in 27us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.874719:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787367934.874730:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787367934.874737:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808526336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874761:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808526336:12345-0@lo:400:kworker.0 Request processed in 26us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.874766:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787367934.874775:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787367934.874780:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808526848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874840:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808526848:12345-0@lo:400:kworker.0 Request processed in 51us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.874846:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:1.0:1787367934.874863:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367934.874866:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367934.874869:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367934.874871:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367934.874900:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808525696:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874911:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808526208:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874920:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808526720:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874927:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1787367934.874931:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1787367934.874948:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808527232:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874957:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808525824:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874965:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808526336:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.874973:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808526848:0@lo:400:kworker.0 00000100:00100000:1.0:1787367934.875010:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808525952:0@lo:400:kworker.0 00000100:00100000:2.0:1787367934.877406:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808527360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367934.877466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367934.879648:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808527360 00000100:00100000:1.0:1787367934.879661:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808527360 00000100:00100000:1.0:1787367934.879728:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787367934.879738:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808527360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787367934.879771:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787367934.879870:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808527360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367934.879890:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787367934.881255:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808527360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787367935.323303:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367935.384782:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808527488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367935.384857:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367935.385004:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808527616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787367935.385037:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367935.385067:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808527488 00000100:00100000:3.0:1787367935.385074:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808527488 00000100:00100000:3.0:1787367935.385112:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808527616 00000100:00100000:3.0:1787367935.385115:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808527616 00000100:00100000:3.0:1787367935.385130:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787367935.385138:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808527488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787367935.385164:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787367935.385214:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787367935.385222:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808527616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367935.385246:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367935.385279:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808527616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367935.385286:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787367935.385328:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808527616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367935.385381:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367935.385389:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808527744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367935.385415:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367935.385439:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808527744 00000100:00100000:1.0:1787367935.385443:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808527744 00000100:00100000:1.0:1787367935.385461:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787367935.385466:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808527744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367935.385476:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787367935.385502:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808527744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367935.385508:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787367935.385533:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808527744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367935.403479:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808527488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 18333us (18614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367935.403494:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787367935.407453:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808527488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367935.897492:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808527872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367935.897567:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367935.897753:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808527872 00000100:00100000:1.0:1787367935.897770:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808527872 00000100:00100000:1.0:1787367935.897821:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787367935.897838:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808527872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367935.897859:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367935.897930:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808527872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367935.897937:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787367935.898027:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808527872:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787367935.900385:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1787367935.900401:0:6517:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787367935.901016:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787367935.901094:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787367936.347280:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367936.925606:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808528000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367936.925679:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367936.926033:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808528000 00000100:00100000:0.0:1787367936.926042:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808528000 00000100:00100000:0.0:1787367936.926098:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787367936.926108:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808528000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787367936.926143:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787367936.926203:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808528000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367936.926224:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787367936.926346:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808528000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787367937.369556:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367937.669746:0:14577:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:05:36 (1787367936) 00000040:00080000:0.0:1787367938.008573:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367938.008595:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367938.008706:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787367938.008714:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787367938.329902:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787367938.394913:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367939.211632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367939.211727:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788533120 00000100:00100000:2.0:1787367939.211737:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788533120 00000100:00100000:2.0:1787367939.211814:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:2.0:1787367939.211826:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+13:12183:x1874190788533120:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367939.211847:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367939.211867:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0310cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8a2 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.211935:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.211949:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.211977:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212001:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212008:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212016:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212099:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff0310e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212108:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff0310e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212115:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff0310e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367939.212125:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787367939.212193:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212201:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212209:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212215:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367939.212225:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212234:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212246:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c5483331b00) 00010000:00010000:2.0:1787367939.212250:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367939.212254:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212261:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0310d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212275:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212282:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212287:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212293:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367939.212296:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212303:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212310:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c55bc700b00) 00010000:00010000:2.0:1787367939.212312:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367939.212319:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212326:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0310da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212623:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0310cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8a2 expref: 16 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212639:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff0310e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8a2 expref: 15 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367939.212647:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:2.0:1787367939.212649:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367939.212652:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c000, rc 0) 00000100:00100000:2.0:1787367939.212705:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+15:12183:x1874190788533120:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 882us (1082us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787367939.212714:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00080000:0.0:1787367939.213597:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367939.218588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367939.218686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367939.219001:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788533376 00000100:00100000:3.0:1787367939.219011:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788533376 00000100:00100000:3.0:1787367939.219070:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:3.0:1787367939.219080:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+15:12183:x1874190788533376:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787367939.219184:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+15:12183:x1874190788533376:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 106us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367939.219192:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:0.0:1787367939.219651:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788533248 00000100:00100000:0.0:1787367939.219656:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788533248 00000100:00100000:0.0:1787367939.219702:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1787367939.219710:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55833d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+15:2403:x1874190788533248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367939.219720:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367939.219743:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff0310e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8a2 expref: 15 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367939.219761:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:0.0:1787367939.219767:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367939.219811:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55833d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+14:2403:x1874190788533248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 94us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367939.219818:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1787367939.226417:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367939.226500:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788533504 00000100:00100000:3.0:1787367939.226510:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788533504 00000100:00100000:3.0:1787367939.226584:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00100000:3.0:1787367939.226594:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:12183:x1874190788533504:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787367939.226694:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:12183:x1874190788533504:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367939.226702:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 152 00000100:00080000:0.0:1787367939.227156:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1787367939.353163:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787367939.379611:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367939.379658:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367939.379766:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788534016 00000100:00100000:2.0:1787367939.379774:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788534016 00000100:00100000:2.0:1787367939.379849:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 317 00000100:00100000:2.0:1787367939.379859:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2403:x1874190788534016:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367939.379943:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2403:x1874190788534016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367939.379951:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 317 00000100:00080000:2.0:1787367939.379983:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367939.380430:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788533760 00000100:00100000:3.0:1787367939.380436:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788533760 00000100:00100000:3.0:1787367939.380486:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:3.0:1787367939.380494:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788533760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367939.380532:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788533760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367939.380539:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00080000:2.0:1787367939.381114:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367939.382536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367939.382574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367939.382620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367939.382701:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788533632 00000100:00100000:2.0:1787367939.382716:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788533632 00000100:00100000:2.0:1787367939.382769:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 387 00000100:00100000:2.0:1787367939.382778:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788533632:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367939.382844:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788533632:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367939.382852:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 387 00000100:00100000:3.0:1787367939.383241:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788533888 00000100:00100000:3.0:1787367939.383245:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788533888 00000100:00100000:3.0:1787367939.383303:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:3.0:1787367939.383310:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788533888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367939.383351:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788533888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367939.383388:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00080000:2.0:1787367939.383641:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367939.383663:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788534144 00000100:00100000:2.0:1787367939.383667:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788534144 00000100:00100000:2.0:1787367939.383709:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 318 00000100:00100000:2.0:1787367939.383716:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788534144:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367939.383753:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788534144:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367939.383760:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 318 00000100:00080000:1.0:1787367939.384113:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787367939.422406:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367939.992618:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367939.992640:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808528128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367939.992712:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367939.992794:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808528128 00000100:00100000:2.0:1787367939.992824:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808528128 00000100:00100000:2.0:1787367939.992880:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787367939.992890:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808528128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787367939.992923:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787367939.992971:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808528128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367939.992978:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787367939.993022:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808528128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367939.993458:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367939.993468:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808528512:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.993503:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367939.993552:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808528640:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.993576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367939.993603:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808528640 00000100:00100000:3.0:1787367939.993608:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808528640 00000100:00100000:3.0:1787367939.993635:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787367939.993641:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808528640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.993677:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808528640:12345-0@lo:400:kworker.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367939.993684:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787367939.993709:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808528640:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.993758:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367939.993764:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808529024:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.993788:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367939.993823:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808529024 00000100:00100000:3.0:1787367939.993827:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808529024 00000100:00100000:3.0:1787367939.993871:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787367939.993877:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808529024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.993911:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808529024:12345-0@lo:400:kworker.0 Request processed in 34us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367939.993927:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1787367939.993945:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367939.993969:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808529024:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.994016:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808529152:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.994040:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367939.994068:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808529152 00000100:00100000:3.0:1787367939.994072:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808529152 00000100:00100000:3.0:1787367939.994102:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787367939.994108:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808529152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.994141:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808529152:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367939.994146:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1787367939.994161:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367939.994174:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808529152:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.994213:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367939.994220:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808529536:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.994610:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367939.994639:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808529536 00000100:00100000:3.0:1787367939.994643:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808529536 00000100:00100000:3.0:1787367939.994671:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787367939.994678:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808529536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.994712:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808529536:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367939.994718:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787367939.994734:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367939.994825:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808529536:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.994873:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808529664:0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.994913:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367939.994942:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808529664 00000100:00100000:3.0:1787367939.994946:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808529664 00000100:00100000:3.0:1787367939.994970:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787367939.994976:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808529664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367939.995008:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808529664:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367939.995014:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1787367939.995029:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367939.995043:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808529664:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995136:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808528256:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367939.995199:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808528768:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995225:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367939.995263:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808529280:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995285:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367939.995312:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787367939.995318:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808528384:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367939.995383:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808528896:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367939.995414:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808529408:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995430:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367939.995447:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808528256 00000100:00100000:0.0:1787367939.995450:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808528256 00000100:00100000:0.0:1787367939.995475:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787367939.995481:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808528256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995510:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808528256:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367939.995516:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787367939.995541:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808528512 00000100:00100000:0.0:1787367939.995545:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808528512 00000100:00100000:0.0:1787367939.995564:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808528768 00000100:00100000:0.0:1787367939.995566:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808528768 00000100:00100000:0.0:1787367939.995585:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808529280 00000100:00100000:0.0:1787367939.995588:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808529280 00000100:00100000:0.0:1787367939.995599:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808528384 00000100:00100000:0.0:1787367939.995601:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808528384 00000100:00100000:0.0:1787367939.995609:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808528896 00000100:00100000:0.0:1787367939.995611:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808528896 00000100:00100000:0.0:1787367939.995621:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808529408 00000100:00100000:0.0:1787367939.995624:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808529408 00000100:00100000:0.0:1787367939.995637:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787367939.995642:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808528512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995678:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808528512:12345-0@lo:400:kworker.0 Request processed in 35us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367939.995692:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787367939.995706:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787367939.995711:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808528768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995740:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808528768:12345-0@lo:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367939.995746:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787367939.995767:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787367939.995773:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808529280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995807:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808529280:12345-0@lo:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367939.995812:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787367939.995824:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787367939.995830:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808528384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995856:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808528384:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367939.995861:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787367939.995872:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787367939.995880:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808528896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995904:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808528896:12345-0@lo:400:kworker.0 Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367939.995909:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787367939.995919:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787367939.995925:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808529408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.995946:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808529408:12345-0@lo:400:kworker.0 Request processed in 22us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367939.995957:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787367939.995988:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808528384:0@lo:400:kworker.0 00010000:00080000:0.0:1787367939.995999:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483dee680 x1874190808528896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367939.996008:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808528896:0@lo:400:kworker.0 00010000:00080000:0.0:1787367939.996016:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483ded500 x1874190808529408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367939.996023:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808529408:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.996031:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808528256:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.996039:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808528768:0@lo:400:kworker.0 00000100:00100000:0.0:1787367939.996046:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808529280:0@lo:400:kworker.0 00000100:00080000:0.0:1787367939.996069:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367939.996072:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367939.996084:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808528512:0@lo:400:kworker.0 00000040:00080000:0.0:1787367940.056674:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367940.056684:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367940.058141:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787367940.058164:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787367940.456557:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367940.506929:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808529792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367940.507026:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367940.507134:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808529792 00000100:00100000:3.0:1787367940.507141:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808529792 00000100:00100000:2.0:1787367940.507636:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367940.507645:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808529920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367940.507677:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367940.507753:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808529920 00000100:00100000:0.0:1787367940.507759:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808529920 00000100:00100000:3.0:1787367940.508072:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787367940.508085:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808529792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787367940.508116:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787367940.508172:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808529792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367940.508180:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787367940.508220:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787367940.508230:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808529920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367940.508259:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367940.508304:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808529920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367940.508310:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787367940.511724:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808530048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367940.511877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367940.512009:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808530048 00000100:00100000:2.0:1787367940.512017:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808530048 00000100:00100000:2.0:1787367940.512062:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787367940.512072:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808530048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367940.512094:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787367940.512136:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808530048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367940.512143:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787367940.514117:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808529920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367940.514140:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808529792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367940.522547:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808530048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367941.016962:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808530176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367941.017040:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367941.017148:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808530176 00000100:00100000:0.0:1787367941.017155:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808530176 00000100:00100000:0.0:1787367941.017216:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787367941.017226:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55adcde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808530176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367941.017247:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367941.017295:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55adcde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808530176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367941.017303:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787367941.017538:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808530176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787367941.017780:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787367941.465908:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367941.949890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367941.952506:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788534272 00000100:00100000:0.0:1787367941.952520:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788534272 00000100:00100000:0.0:1787367941.952605:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 153 00000100:00100000:0.0:1787367941.952616:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+14:12226:x1874190788534272:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367941.952645:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367941.952665:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0310ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8a9 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952725:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952752:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952765:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952799:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952806:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952812:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952850:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952856:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952863:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952869:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367941.952873:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952880:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952890:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:0.0:1787367941.952893:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367941.952897:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952903:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0310f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952919:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952926:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952932:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952937:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367941.952940:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952946:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952954:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c54824f2300) 00010000:00010000:0.0:1787367941.952956:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367941.952959:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952964:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0310fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.952995:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0310ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8a9 expref: 15 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.953005:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:0.0:1787367941.953008:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367941.953018:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0310ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8a9 expref: 15 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.953028:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b400, rc 0) 00000100:00100000:0.0:1787367941.953088:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+14:12226:x1874190788534272:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 474us (3203us total) trans 0 rc 301/301 00000100:00100000:0.0:1787367941.953096:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 153 00000100:00080000:2.0:1787367941.953570:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367941.957528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367941.957742:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788534528 00000100:00100000:1.0:1787367941.957751:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788534528 00000100:00100000:1.0:1787367941.957819:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 154 00000100:00100000:1.0:1787367941.957830:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+14:12226:x1874190788534528:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1787367941.957885:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367941.957920:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa82a00/0x66f5679bff030a43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6cd expref: 14 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.957936:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:1.0:1787367941.957941:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367941.957999:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.958012:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e89b expref: 5 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.958021:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.958053:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e89b expref: 5 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.958066:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e89b expref: 5 pid: 6538 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367941.958080:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548442df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808530304:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367941.958158:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548239c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367941.963010:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548442df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808530304:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367941.963042:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367941.992305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367941.993069:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788534656 00000100:00100000:1.0:1787367941.993080:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788534656 00010000:00010000:1.0:1787367941.993150:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e89b expref: 6 pid: 6538 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367941.993185:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1787367941.993194:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2403:x1874190788534656:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367941.993225:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367941.993232:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e89b expref: 6 pid: 6538 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.993245:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e89b expref: 6 pid: 6538 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.993267:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff0310c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e89b expref: 6 pid: 6538 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.993285:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:1.0:1787367941.993290:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.993301:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.993309:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367941.993335:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1787367941.993500:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367941.993590:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.993599:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.993633:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.993643:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.993650:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994195:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994216:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994224:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367941.994241:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058875936 reply state 0000000096aa7afb transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994252:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994258:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367941.994262:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367941.994265:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787367941.994270:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787367941.994277:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994283:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994289:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994295:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367941.994299:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994307:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994327:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55c21ff800) 00010000:00010000:0.0:1787367941.994329:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367941.994333:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994339:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031104 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367941.994398:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058875936 reply state 0000000096aa7afb transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994416:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367941.994424:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c54824f2300) 00010000:00010000:0.0:1787367941.994426:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367941.994428:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787367941.994750:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788534656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1554us (2450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367941.994761:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:0.0:1787367941.996002:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+15:12226:x1874190788534528:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 38167us (38474us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787367941.996012:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 154 00000100:00100000:2.0:1787367942.040510:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367942.040532:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808530432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787367942.040600:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367942.040664:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808530432 00000100:00100000:2.0:1787367942.040670:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808530432 00000100:00100000:2.0:1787367942.040718:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787367942.040727:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808530432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367942.040774:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367942.040830:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808530432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367942.040838:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787367942.041061:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808530432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787367942.133216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.133321:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788534784 00000100:00100000:0.0:1787367942.133331:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788534784 00000100:00100000:0.0:1787367942.133429:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:0.0:1787367942.133440:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+15:12234:x1874190788534784:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:0.0:1787367942.133463:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367942.133497:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8b0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.133564:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff031120 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.133600:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff031120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.133613:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff031120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367942.133653:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787367942.133656:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367942.133677:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff031120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.133972:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8b0 expref: 17 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.133991:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff031120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8b0 expref: 16 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.133998:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:0.0:1787367942.134001:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367942.134004:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613ac00, rc 0) 00000100:00100000:0.0:1787367942.134063:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+16:12234:x1874190788534784:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 625us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367942.134071:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:2.0:1787367942.238812:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.238976:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788534912 00000100:00100000:0.0:1787367942.238987:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788534912 00000100:00100000:0.0:1787367942.239054:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:0.0:1787367942.239065:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+16:12240:x1874190788534912:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367942.239086:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367942.239119:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8b7 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239183:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239197:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239209:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239220:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239227:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239234:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239304:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03113c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239313:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03113c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239320:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03113c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367942.239400:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787367942.239404:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367942.239425:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03113c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239445:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239451:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239458:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239464:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367942.239469:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239477:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239489:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:0.0:1787367942.239492:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367942.239496:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239503:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03112e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239516:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239523:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239529:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239541:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367942.239544:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239550:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239559:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c54824f2300) 00010000:00010000:0.0:1787367942.239562:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367942.239564:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239571:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031135 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239611:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031127 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8b7 expref: 18 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239625:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03113c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8b7 expref: 17 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.239633:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367942.239635:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787367942.239637:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a000, rc 0) 00000100:00100000:0.0:1787367942.239705:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+17:12240:x1874190788534912:12345-192.168.203.4@tcp:101:bash.0 Request processed in 630us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367942.239713:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:3.0:1787367942.242773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.251158:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788535168 00000100:00100000:0.0:1787367942.251188:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788535168 00000100:00100000:0.0:1787367942.251260:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:0.0:1787367942.251272:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+17:12240:x1874190788535168:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367942.251290:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367942.251308:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031143 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8be expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.251427:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.251442:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.251453:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.251511:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.251529:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.251535:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787367942.252113:0:6540:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787367942.252240:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252250:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252272:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252302:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252307:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252314:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252319:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613be00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367942.252322:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252329:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252340:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367942.252343:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367942.252346:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252352:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03114a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367942.252395:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a32ffaa reply state 0000000032dfe97b transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252406:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252417:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2a00) 00010000:00010000:0.0:1787367942.252420:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367942.252422:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787367942.252450:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031143 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8be expref: 20 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252463:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8be expref: 19 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.252470:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c54824f2800) 00010000:00010000:0.0:1787367942.252472:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367942.252474:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613aa00, rc 0) 00000100:00100000:0.0:1787367942.253925:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+20:12240:x1874190788535168:12345-192.168.203.4@tcp:101:bash.0 Request processed in 2648us (11151us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1787367942.253937:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:1.0:1787367942.261078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367942.261247:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788535296 00000100:00100000:3.0:1787367942.261270:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788535296 00000100:00100000:3.0:1787367942.261347:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1787367942.261396:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2402:x1874190788535296:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787367942.261414:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367942.261433:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8c5 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787367942.261459:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787367942.261478:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1787367942.261483:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367942.261493:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8c5 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.261511:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8c5 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.261522:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74c00, rc 0) 00000100:00100000:3.0:1787367942.261573:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788535296:12345-192.168.203.4@tcp:101:bash.0 Request processed in 218us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367942.261581:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00080000:2.0:1787367942.261778:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367942.282175:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367942.282343:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788535424 00000100:00100000:3.0:1787367942.282377:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788535424 00000100:00100000:3.0:1787367942.282439:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:3.0:1787367942.282458:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:12240:x1874190788535424:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787367942.282475:0:8925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367942.282493:0:8925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8cc expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.282536:0:8925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8c5 expref: 7 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.282554:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367942.282559:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367942.282565:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.282599:0:8925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8c5 expref: 7 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.282846:0:8925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8c5 expref: 7 pid: 8453 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367942.282862:0:8925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ddb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8925:1874190808530560:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367942.283046:0:8925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367942.290515:0:8925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ddb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8925:1874190808530560:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367942.290550:0:8925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 7 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.290572:0:8925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74800, rc 0) 00000100:00100000:3.0:1787367942.290639:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:12240:x1874190788535424:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8191us (8472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367942.290648:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:1.0:1787367942.296423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.296943:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788535552 00000100:00100000:0.0:1787367942.296953:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788535552 00010000:00010000:0.0:1787367942.297006:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8c5 expref: 7 pid: 8453 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367942.297048:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:0.0:1787367942.297058:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:2403:x1874190788535552:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367942.297072:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367942.297095:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8c5 expref: 7 pid: 8453 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.297141:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8c5 expref: 7 pid: 8453 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.297165:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039d6f301/0x66f5679bff031166 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8c5 expref: 7 pid: 8453 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.297183:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367942.297188:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367942.297195:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 6 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.297206:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 6 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.297244:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 6 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367942.297258:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8469:1874190808530688:192.168.203.4@tcp:105: 00000100:00100000:0.0:1787367942.297337:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1787367942.309594:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8469:1874190808530688:192.168.203.4@tcp:105: 00010000:00010000:0.0:1787367942.309620:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367942.309681:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+6:2403:x1874190788535552:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 12623us (13266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367942.309693:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:1.0:1787367942.324515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367942.325296:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788535808 00000100:00100000:2.0:1787367942.325308:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788535808 00000100:00100000:2.0:1787367942.325408:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1787367942.325419:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+20:12240:x1874190788535808:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:2.0:1787367942.325696:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+21:12240:x1874190788535808:12345-192.168.203.4@tcp:35:bash.0 Request processed in 278us (1189us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787367942.325704:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1787367942.422290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.422390:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788536064 00000100:00100000:0.0:1787367942.422400:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788536064 00000100:00100000:0.0:1787367942.422508:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:0.0:1787367942.422520:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+21:12250:x1874190788536064:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367942.422544:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367942.422565:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8d3 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367942.422657:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787367942.422742:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031174 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8d3 expref: 23 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.422757:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:0.0:1787367942.422760:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367942.422765:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8d3 expref: 23 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.422788:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b200, rc 0) 00000100:00100000:0.0:1787367942.422847:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+22:12250:x1874190788536064:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 329us (564us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1787367942.422855:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:1.0:1787367942.427655:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367942.427731:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788536320 00000100:00100000:3.0:1787367942.427740:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788536320 00000100:00100000:3.0:1787367942.427802:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:3.0:1787367942.427813:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+22:12250:x1874190788536320:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1787367942.428037:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+23:12250:x1874190788536320:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 226us (390us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787367942.428046:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:1.0:1787367942.478404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367942.478454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367942.478543:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788536448 00000100:00100000:2.0:1787367942.478553:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788536448 00000100:00100000:3.0:1787367942.478568:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788536576 00000100:00100000:3.0:1787367942.478584:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788536576 00002000:00100000:2.0:1787367942.478601:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c548442c700 x1874190788536448/t0(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:583/0 lens 504/0 e 0 to 0 dl 1787367953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367942.478614:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c548442c700 with x1874190788536448 ext(0->12) 00002000:00010000:2.0:1787367942.478619:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c548442c700 00000100:00100000:3.0:1787367942.478638:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:3.0:1787367942.478648:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788536576:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:2.0:1787367942.478658:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1787367942.478669:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788536448:12345-192.168.203.4@tcp:4:bash.0 00000100:00100000:3.0:1787367942.478753:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788536576:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367942.478762:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1787367942.481910:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788536448:12345-192.168.203.4@tcp:4:bash.0 Request processed in 3234us (3506us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787367942.481925:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00002000:00100000:2.0:1787367942.481937:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c548442c700 x1874190788536448/t4294967306(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:583/0 lens 504/448 e 0 to 0 dl 1787367953 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367942.481947:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c548442c700 with x1874190788536448 ext(0->12) 00002000:00010000:2.0:1787367942.481953:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c548442c700 00010000:00010000:3.0:1787367942.488590:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367942.540833:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.541630:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788536704 00000100:00100000:0.0:1787367942.541640:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788536704 00000100:00100000:1.0:1787367942.541971:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:1.0:1787367942.541983:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+23:12255:x1874190788536704:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367942.542008:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367942.542027:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e000/0x66f5679bff031182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8da expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.542089:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031189 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.542104:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031189 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.542126:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031189 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367942.542168:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787367942.542172:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367942.542189:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031189 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.542214:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e000/0x66f5679bff031182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8da expref: 25 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.542232:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031189 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8da expref: 24 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.542261:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:1.0:1787367942.542264:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367942.542267:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f400, rc 0) 00000100:00100000:1.0:1787367942.542337:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+24:12255:x1874190788536704:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 356us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367942.542345:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:3.0:1787367942.546208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367942.549048:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788536960 00000100:00100000:2.0:1787367942.549061:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788536960 00000100:00100000:2.0:1787367942.549133:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:2.0:1787367942.549143:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+24:12255:x1874190788536960:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367942.549162:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367942.549182:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff031190 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8e1 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.549278:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff031197 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.549292:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff031197 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.549304:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff031197 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367942.549314:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787367942.549446:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff031190 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8e1 expref: 27 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.549483:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff031197 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8e1 expref: 26 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.549491:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c54824f2800) 00010000:00010000:2.0:1787367942.549494:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367942.549497:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241d800, rc 0) 00000100:00100000:2.0:1787367942.549557:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+26:12255:x1874190788536960:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 415us (3357us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1787367942.549565:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:2.0:1787367942.554967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.555035:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788537216 00000100:00100000:0.0:1787367942.555044:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788537216 00000100:00100000:0.0:1787367942.555101:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:0.0:1787367942.555111:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+26:12255:x1874190788537216:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367942.555135:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367942.555172:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0311a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8e8 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.555280:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff0311ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.555294:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff0311ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.555306:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff0311ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367942.555317:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787367942.555437:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff0311a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8e8 expref: 29 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.555453:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff0311ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8e8 expref: 28 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.555461:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c54824f2800) 00010000:00010000:0.0:1787367942.555464:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787367942.555467:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613be00, rc 0) 00000100:00100000:0.0:1787367942.555522:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+28:12255:x1874190788537216:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 413us (564us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1787367942.555530:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:1.0:1787367942.559391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.559475:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788537344 00000100:00100000:0.0:1787367942.559485:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788537344 00000100:00100000:0.0:1787367942.559549:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1787367942.559559:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+28:2403:x1874190788537344:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367942.559591:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367942.559616:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff031197 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8e1 expref: 28 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.559635:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c54824f2800) 00010000:00010000:0.0:1787367942.559639:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367942.559687:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+27:2403:x1874190788537344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 130us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367942.559695:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1787367942.568884:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.570904:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788537472 00000100:00100000:0.0:1787367942.570918:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788537472 00000100:00100000:0.0:1787367942.570980:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:0.0:1787367942.570990:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2405:x1874190788537472:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:0.0:1787367942.571033:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.571053:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.571062:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367942.571067:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367942.571072:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.571106:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.571142:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 8 pid: 8925 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367942.571157:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1874190808530816:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367942.571246:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367942.573422:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1874190808530816:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367942.573449:0:8454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367942.579334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367942.579485:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788537600 00000100:00100000:1.0:1787367942.579495:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788537600 00010000:00010000:1.0:1787367942.579545:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 9 pid: 8925 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367942.579588:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:1.0:1787367942.579598:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+9:2404:x1874190788537600:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367942.579613:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787367942.579629:0:6525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787367942.579632:0:6525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787367942 00002000:00010000:1.0:1787367942.579634:0:6525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787367942 00002000:00010000:1.0:1787367942.579636:0:6525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787367942.579642:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 9 pid: 8925 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.579658:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 9 pid: 8925 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.579699:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000931493a1/0x66f5679bff03116d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8cc expref: 9 pid: 8925 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.579717:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367942.579721:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367942.579728:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.579739:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367942.579770:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367942.579839:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2404:x1874190788537600:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 242us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367942.579852:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00010000:00010000:3.0:1787367942.581055:0:8454:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.581070:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.581096:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.581122:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.581130:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.581137:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367942.581142:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.581151:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.581168:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.581175:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002080e796/0x66f5679bff0311ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367942.581250:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788537472:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 10259us (12373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367942.581259:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:3.0:1787367942.584478:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367942.584622:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788537856 00000100:00100000:2.0:1787367942.584631:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788537856 00000100:00100000:2.0:1787367942.584685:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1787367942.584695:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+27:12255:x1874190788537856:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:2.0:1787367942.584757:0:6542:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff0311ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8e8 expref: 27 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367942.584984:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1787367942.585018:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787367942.585298:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1787367942.585336:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.585350:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8be expref: 31 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.585392:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.585435:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8be expref: 31 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.585450:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8be expref: 31 pid: 6540 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367942.585465:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483e70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6542:1874190808530944:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367942.585539:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367942.588411:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483e70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6542:1874190808530944:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367942.588438:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367942.588945:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.589029:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788537984 00000100:00100000:0.0:1787367942.589037:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788537984 00010000:00010000:0.0:1787367942.589080:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8be expref: 32 pid: 6540 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367942.589121:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:0.0:1787367942.589130:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+32:2403:x1874190788537984:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367942.589143:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367942.589150:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8be expref: 32 pid: 6540 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.589171:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8be expref: 32 pid: 6540 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.589193:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031158 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8be expref: 32 pid: 6540 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.589221:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c54824f2800) 00010000:00010000:0.0:1787367942.589226:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.589235:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.589243:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.589272:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367942.589327:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+31:2403:x1874190788537984:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 197us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367942.589335:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00010000:00010000:2.0:1787367942.589420:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.589429:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367942.589538:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1787367942.589646:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1787367942.589726:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483e70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808531072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787367942.589775:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367942.589921:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367942.590657:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808531072 00000100:00100000:0.0:1787367942.590665:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808531072 00000100:00100000:0.0:1787367942.590742:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787367942.590753:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6542:x1874190808531072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787367942.590933:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6542:x1874190808531072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 175us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367942.590942:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787367942.591003:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483e70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808531072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787367942.591133:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1787367942.591186:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ddad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808531200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787367942.591218:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367942.591382:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5598227e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367942.591633:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808531200 00000100:00100000:2.0:1787367942.591638:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808531200 00000100:00100000:2.0:1787367942.591664:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787367942.591671:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6542:x1874190808531200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787367942.591809:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6542:x1874190808531200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 138us (589us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787367942.591817:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787367942.592738:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ddad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6542:1874190808531200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787367942.592809:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1787367942.592861:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.592872:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.592880:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.592886:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367942.592891:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.592898:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.592913:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c54824f2800) 00010000:00010000:3.0:1787367942.592915:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787367942.592921:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367942.592937:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0311c1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367942.593035:0:6542:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787367942.593104:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787367942.593115:0:6542:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399880759187ns, next at 400880756519ns, rc = 0 00000001:00080000:3.0:1787367942.593122:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1787367942.593141:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c54824f2800) 00010000:00010000:3.0:1787367942.593144:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787367942.593151:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff0311ac lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8e8 expref: 35 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367942.593259:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+34:12255:x1874190788537856:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 8553us (8778us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787367942.593268:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000020:00080000:3.0:1787367942.593273:0:6542:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787367942.595499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367942.595583:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788538112 00000100:00100000:2.0:1787367942.595591:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788538112 00000100:00100000:2.0:1787367942.595647:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:2.0:1787367942.595656:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+34:12255:x1874190788538112:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367942.595677:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367942.595698:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff0311c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8ef expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.595746:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff0311c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8ef expref: 35 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.595760:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff0311c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8ef expref: 35 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367942.595777:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367942.595793:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367942.595796:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241cc00, rc 0) 00000100:00100000:2.0:1787367942.595846:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+35:12255:x1874190788538112:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 191us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367942.595854:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:0.0:1787367942.599288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367942.599407:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788538368 00000100:00100000:1.0:1787367942.599417:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788538368 00000100:00100000:1.0:1787367942.599464:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1787367942.599475:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+35:12255:x1874190788538368:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1787367942.599690:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+36:12255:x1874190788538368:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 216us (409us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787367942.599698:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:3.0:1787367942.689501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.689661:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788538624 00000100:00100000:0.0:1787367942.689671:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788538624 00000100:00100000:0.0:1787367942.689735:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:0.0:1787367942.689745:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+36:12266:x1874190788538624:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367942.689769:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367942.689816:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff0311cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8f6 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367942.689912:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787367942.690029:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff0311cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8f6 expref: 38 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.690044:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:0.0:1787367942.690047:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367942.690052:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff0311cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8f6 expref: 38 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.690066:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613aa00, rc 0) 00000100:00100000:0.0:1787367942.690131:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+37:12266:x1874190788538624:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 388us (639us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1787367942.690138:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:2.0:1787367942.693594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.694873:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788538752 00000100:00100000:0.0:1787367942.694886:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788538752 00000100:00100000:0.0:1787367942.694947:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:0.0:1787367942.694958:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+37:12266:x1874190788538752:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1787367942.695028:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695044:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695056:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695085:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695093:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695100:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695163:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695172:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695179:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367942.695222:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695234:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695240:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695248:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695255:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367942.695258:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695272:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695284:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367942.695286:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367942.695291:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695297:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff0311dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695311:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695318:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695324:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695329:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367942.695331:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695338:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.695345:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2a00) 00010000:00010000:0.0:1787367942.695347:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367942.695350:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.696010:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.696023:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.696030:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.696036:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.696042:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367942.696045:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.696050:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.696059:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367942.696062:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367942.696065:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.696071:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367942.696195:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+37:12266:x1874190788538752:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1237us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367942.696204:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:2.0:1787367942.702656:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367942.702750:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788539008 00000100:00100000:1.0:1787367942.702760:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788539008 00000100:00100000:1.0:1787367942.702833:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1787367942.702857:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+37:12266:x1874190788539008:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1787367942.703091:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+38:12266:x1874190788539008:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 235us (443us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787367942.703100:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:2.0:1787367942.759720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.759815:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788539264 00000100:00100000:0.0:1787367942.759824:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788539264 00000100:00100000:0.0:1787367942.759886:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:0.0:1787367942.759897:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+38:12269:x1874190788539264:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367942.759920:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367942.759948:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e8fd expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760053:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760069:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760082:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760091:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760098:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760104:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760201:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760210:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760227:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367942.760238:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787367942.760319:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760327:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760335:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760341:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367942.760346:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760666:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760682:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367942.760685:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367942.760690:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760696:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0311f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760711:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760718:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760731:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760736:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367942.760739:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760746:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760753:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2a00) 00010000:00010000:0.0:1787367942.760756:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367942.760759:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760765:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031200 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760812:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0311f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8fd expref: 41 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760826:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8fd expref: 40 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.760833:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367942.760835:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367942.760838:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613aa00, rc 0) 00000100:00100000:0.0:1787367942.760899:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+40:12269:x1874190788539264:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1004us (1187us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787367942.760916:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:2.0:1787367942.764688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367942.764789:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788539392 00000100:00100000:0.0:1787367942.764798:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788539392 00000100:00100000:0.0:1787367942.764863:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:0.0:1787367942.764874:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+40:12269:x1874190788539392:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1787367942.764946:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.764964:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.764985:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.765021:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.765029:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.765036:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.765042:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613be00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367942.765047:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.765055:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.765066:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367942.765075:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367942.765080:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367942.765086:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff031215 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367942.765158:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+40:12269:x1874190788539392:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 286us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367942.765167:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:2.0:1787367942.768473:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367942.768621:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788539648 00000100:00100000:1.0:1787367942.768630:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788539648 00000100:00100000:1.0:1787367942.768684:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:1.0:1787367942.768694:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+40:12269:x1874190788539648:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1787367942.768918:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+41:12269:x1874190788539648:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 225us (452us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787367942.768927:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:1.0:1787367943.220620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367943.229525:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788539904 00000100:00100000:2.0:1787367943.229540:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788539904 00000100:00100000:2.0:1787367943.229636:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:2.0:1787367943.229648:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+41:12300:x1874190788539904:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:2.0:1787367943.229672:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367943.229692:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff03121c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e904 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.229799:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff031223 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.229814:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff031223 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.229825:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff031223 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367943.229835:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787367943.229986:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff03121c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e904 expref: 44 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.230004:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff031223 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e904 expref: 43 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.230012:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367943.230014:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367943.230018:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c400, rc 0) 00000100:00100000:2.0:1787367943.230099:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+43:12300:x1874190788539904:12345-192.168.203.4@tcp:101:cat.0 Request processed in 455us (9488us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787367943.230120:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00080000:3.0:1787367943.235826:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367943.236530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367943.236564:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367943.236636:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788540288 00000100:00100000:0.0:1787367943.236645:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788540288 00000100:00100000:0.0:1787367943.236701:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1787367943.236712:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+43:12300:x1874190788540288:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:0.0:1787367943.236977:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+44:12300:x1874190788540288:12345-192.168.203.4@tcp:35:cat.0 Request processed in 266us (410us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787367943.236985:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1787367943.237641:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788540032 00000100:00100000:1.0:1787367943.237647:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788540032 00000100:00100000:1.0:1787367943.237695:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1787367943.237703:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+44:2405:x1874190788540032:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367943.237715:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367943.237736:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c400/0x66f5679bff031223 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e904 expref: 44 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.237754:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367943.237759:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367943.237805:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+43:2405:x1874190788540032:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 103us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367943.237812:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000001:00080000:1.0:1787367943.242040:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:1.0:1787367943.242065:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787367943.242086:0:6517:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c5590f58840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787367943.242091:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55bd609800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c5590f589c0 00000020:00080000:1.0:1787367943.242095:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55bd609300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c5585569c00 00010000:00010000:0.0:1787367943.242228:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242240:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242249:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242255:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367943.242260:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242285:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242300:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c54824f2300) 00010000:00010000:0.0:1787367943.242303:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367943.242308:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242316:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03110b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242336:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242341:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242347:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242388:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367943.242393:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242400:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242408:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367943.242410:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367943.242413:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242429:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031112 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242445:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242451:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242457:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242463:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367943.242466:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242473:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242482:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2a00) 00010000:00010000:0.0:1787367943.242484:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367943.242487:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.242492:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031151 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787367943.242510:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787367943.242565:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787367943.242965:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808531328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787367943.243033:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367943.245392:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808531328 00000100:00100000:3.0:1787367943.245405:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808531328 00000100:00100000:3.0:1787367943.245641:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787367943.245652:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808531328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787367943.245807:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1787367943.245839:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a891206, atime: 0x0, ctime: 0x6a891206, blocks: 0x8 00010000:00010000:3.0:1787367943.245847:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367943.245863:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1787367943.245868:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367943.245875:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367943.245912:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367943.245923:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367943.245931:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367943.245954:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787367943.246230:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808531328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 579us (3196us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787367943.246239:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000004:00080000:3.0:1787367943.246435:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c5483dd8e00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787367943.246443:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808531328:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787367943.246960:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787367943.247340:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367943.247349:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.247373:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74a00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787367943.247377:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.247389:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.247407:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.247415:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006598eed8/0x66f5679bff031231 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.247437:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367943.247439:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367943.247440:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367943.291533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367943.291641:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788540544 00000100:00100000:0.0:1787367943.291664:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788540544 00000100:00100000:0.0:1787367943.291725:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:0.0:1787367943.291736:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+18:12306:x1874190788540544:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1787367943.291760:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367943.291763:0:9404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787367943.291799:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031189 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8da expref: 18 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.291820:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367943.291825:0:9404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367943.291848:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031238 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e90b expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.291962:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.291975:0:9404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8fd expref: 18 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.291984:0:9404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.292012:0:9404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8fd expref: 18 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.292025:0:9404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8fd expref: 18 pid: 6540 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367943.292038:0:9404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808531456:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367943.292139:0:9404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367943.294402:0:9404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808531456:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367943.294430:0:9404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367943.299190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367943.299829:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788540672 00000100:00100000:0.0:1787367943.299839:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788540672 00010000:00010000:0.0:1787367943.300348:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8fd expref: 19 pid: 6540 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367943.300416:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1787367943.300428:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55833d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+19:2403:x1874190788540672:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367943.300445:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367943.300452:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8fd expref: 19 pid: 6540 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.300465:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8fd expref: 19 pid: 6540 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.300488:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff031207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8fd expref: 19 pid: 6540 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.300503:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367943.300508:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.300517:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.300543:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.300578:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367943.300617:0:9404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.300635:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367943.300654:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:0.0:1787367943.300677:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55833d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:2403:x1874190788540672:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 251us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367943.300686:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00010000:00010000:2.0:1787367943.300785:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031238 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e90b expref: 19 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.300802:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e90b expref: 18 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.300811:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367943.300814:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787367943.300816:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b800, rc 0) 00000100:00100000:2.0:1787367943.300853:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+18:12306:x1874190788540544:12345-192.168.203.4@tcp:101:dd.0 Request processed in 9118us (9329us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787367943.300860:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:2.0:1787367943.315042:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367943.315199:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788540800 00000100:00100000:1.0:1787367943.315208:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788540800 00000100:00100000:1.0:1787367943.315274:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:1.0:1787367943.315282:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:12306:x1874190788540800:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1787367943.315305:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367943.315324:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03124d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e912 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.315371:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.315385:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.315396:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.315494:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03124d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e912 expref: 20 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.315512:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e912 expref: 19 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.315521:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367943.315523:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787367943.315526:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e400, rc 0) 00000100:00100000:1.0:1787367943.315578:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+19:12306:x1874190788540800:12345-192.168.203.4@tcp:101:dd.0 Request processed in 296us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367943.315585:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:1.0:1787367943.319454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367943.319811:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788541056 00000100:00100000:2.0:1787367943.319821:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788541056 00000100:00100000:2.0:1787367943.319888:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:2.0:1787367943.319897:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:12306:x1874190788541056:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:2.0:1787367943.320103:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.320119:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.320130:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367943.320165:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1787367943.320183:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e2a661a reply state 0000000057eb8741 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.320195:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.320201:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367943.320204:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787367943.320207:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367943.320282:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+22:12306:x1874190788541056:12345-192.168.203.4@tcp:36:dd.0 Request processed in 386us (835us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1787367943.320290:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 170 00000020:00080000:2.0:1787367943.320294:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787367943.512569:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367943.706185:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367943.706291:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788541184 00000100:00100000:1.0:1787367943.706312:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788541184 00000100:00100000:1.0:1787367943.706392:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:1.0:1787367943.706403:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+22:12320:x1874190788541184:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:1.0:1787367943.706427:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367943.706446:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031262 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e919 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706506:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706519:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706530:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706543:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706550:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706557:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706625:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706635:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e90b expref: 23 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706644:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706703:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e90b expref: 23 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.706720:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e90b expref: 23 pid: 9404 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367943.706733:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548442f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808531584:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367943.706845:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548239c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787367943.711967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367943.713211:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548442f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808531584:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367943.713238:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367943.713732:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788541440 00000100:00100000:0.0:1787367943.713739:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788541440 00000100:00100000:0.0:1787367943.713820:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:0.0:1787367943.713830:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+24:6184:x1874190788541440:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787367943.714497:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+25:6184:x1874190788541440:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 667us (2537us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787367943.714507:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:2.0:1787367943.729472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367943.729630:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788541568 00000100:00100000:1.0:1787367943.729640:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788541568 00010000:00010000:1.0:1787367943.729676:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e90b expref: 25 pid: 9404 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367943.729716:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:1.0:1787367943.729725:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+25:2402:x1874190788541568:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367943.729739:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367943.729745:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e90b expref: 25 pid: 9404 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.729758:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e90b expref: 25 pid: 9404 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.729806:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff03123f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e90b expref: 25 pid: 9404 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.729821:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367943.729827:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.729847:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.729855:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367943.730180:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367943.730237:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+24:2402:x1874190788541568:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 512us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367943.730245:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00010000:00010000:2.0:1787367943.730307:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730315:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367943.730392:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787367943.730396:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367943.730416:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730428:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730438:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730445:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730452:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730459:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367943.730463:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730470:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730480:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:2.0:1787367943.730483:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367943.730486:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730500:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031269 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730512:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730518:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730524:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730530:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367943.730542:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730549:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730556:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c5590ea9800) 00010000:00010000:2.0:1787367943.730559:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367943.730562:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730568:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031270 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730610:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031262 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e919 expref: 24 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730625:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e919 expref: 23 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367943.730638:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367943.730640:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367943.730642:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f600, rc 0) 00000100:00100000:2.0:1787367943.730669:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+23:12320:x1874190788541184:12345-192.168.203.4@tcp:101:stat.0 Request processed in 24268us (24493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367943.730687:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:2.0:1787367943.824341:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367943.824491:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788541824 00000100:00100000:0.0:1787367943.824500:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788541824 00000100:00100000:0.0:1787367943.824554:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00100000:0.0:1787367943.824563:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+23:12326:x1874190788541824:12345-192.168.203.4@tcp:36:truncate.0 00010000:00010000:0.0:1787367943.824611:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367943.824635:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031277 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e919 expref: 23 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.824653:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367943.824658:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367943.824821:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.824869:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.824880:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367943.824930:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787367943.824951:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdd8770c reply state 00000000501e8336 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.824963:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367943.824969:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367943.824972:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367943.824974:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367943.825060:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+25:12326:x1874190788541824:12345-192.168.203.4@tcp:36:truncate.0 Request processed in 497us (725us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787367943.825066:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 172 00000020:00080000:0.0:1787367943.825071:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787367944.091058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367944.091914:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788541952 00000100:00100000:0.0:1787367944.091923:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788541952 00000100:00100000:0.0:1787367944.091983:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:0.0:1787367944.091992:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+25:12340:x1874190788541952:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:0.0:1787367944.092013:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367944.092031:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031285 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e920 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092087:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092113:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092135:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092150:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092157:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092163:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092223:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092231:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092238:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367944.092275:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787367944.092279:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367944.092297:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092308:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092325:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092331:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092338:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092343:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613be00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367944.092348:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092401:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092413:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367944.092416:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367944.092420:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092426:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613be00/0x66f5679bff03128c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092438:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092444:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092450:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092460:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367944.092463:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092470:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092476:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2a00) 00010000:00010000:0.0:1787367944.092479:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367944.092481:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092488:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031293 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092516:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031285 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e920 expref: 27 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092527:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e920 expref: 26 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.092535:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367944.092537:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367944.092539:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a400, rc 0) 00000100:00100000:0.0:1787367944.092603:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+26:12340:x1874190788541952:12345-192.168.203.4@tcp:101:stat.0 Request processed in 612us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367944.092611:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:1.0:1787367944.264034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367944.267430:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788542208 00000100:00100000:0.0:1787367944.267459:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788542208 00000100:00100000:0.0:1787367944.267656:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:0.0:1787367944.267667:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+26:12350:x1874190788542208:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367944.267687:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367944.267708:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0312a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e927 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367944.267819:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787367944.267936:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0312a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e927 expref: 28 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.267951:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:0.0:1787367944.267955:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367944.267960:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0312a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e927 expref: 28 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.267973:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b400, rc 0) 00000100:00100000:0.0:1787367944.268043:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+27:12350:x1874190788542208:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 378us (4015us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1787367944.268051:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:3.0:1787367944.272282:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367944.272384:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788542464 00000100:00100000:1.0:1787367944.272395:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788542464 00000100:00100000:1.0:1787367944.272440:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:1.0:1787367944.272449:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+27:12350:x1874190788542464:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1787367944.272638:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+28:12350:x1874190788542464:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 188us (365us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1787367944.272645:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:3.0:1787367944.382140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367944.382422:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788542720 00000100:00100000:0.0:1787367944.382432:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788542720 00000100:00100000:0.0:1787367944.382492:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 175 00000100:00100000:0.0:1787367944.382503:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+28:12356:x1874190788542720:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367944.382527:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367944.382546:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0312af lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e92e expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.382686:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.382699:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e920 expref: 29 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.382707:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.382735:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e920 expref: 29 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.382747:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e920 expref: 29 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367944.382760:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808531712:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367944.382870:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787367944.387030:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808531712:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367944.387059:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367944.387331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367944.387402:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788542848 00000100:00100000:1.0:1787367944.387410:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788542848 00010000:00010000:1.0:1787367944.387454:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e920 expref: 30 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367944.387499:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:1.0:1787367944.387508:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+30:2402:x1874190788542848:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367944.387521:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367944.387528:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e920 expref: 30 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367944.387540:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e920 expref: 30 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367944.387563:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff03129a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e920 expref: 30 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367944.387588:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367944.387593:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367944.387603:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367944.387610:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367944.387635:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367944.387683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+29:2402:x1874190788542848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 176us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367944.387690:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00010000:00010000:0.0:1787367944.388250:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.388259:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367944.388275:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787367944.388443:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0312af lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e92e expref: 30 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.388458:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e92e expref: 29 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.388466:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367944.388468:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787367944.388471:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a600, rc 0) 00000100:00100000:0.0:1787367944.388514:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+29:12356:x1874190788542720:12345-192.168.203.4@tcp:101:bash.0 Request processed in 6013us (6381us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787367944.388522:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 175 00000100:00100000:3.0:1787367944.392429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367944.392569:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788543104 00000100:00100000:2.0:1787367944.392578:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788543104 00000100:00100000:2.0:1787367944.392628:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 176 00000100:00100000:2.0:1787367944.392637:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+29:12356:x1874190788543104:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:2.0:1787367944.392869:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.392886:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.392897:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367944.392937:0:9404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1787367944.392958:0:9404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033b4b5ff reply state 00000000d91fcf1c transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.393131:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.393139:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367944.393154:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787367944.393158:0:9404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367944.393245:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+32:12356:x1874190788543104:12345-192.168.203.4@tcp:36:bash.0 Request processed in 609us (825us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1787367944.393253:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 176 00000020:00080000:2.0:1787367944.393257:0:9404:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787367944.412849:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367944.413786:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788543232 00000100:00100000:2.0:1787367944.413798:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788543232 00000100:00100000:2.0:1787367944.413863:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:2.0:1787367944.413873:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+32:12356:x1874190788543232:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787367944.413896:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367944.413914:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e935 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.414138:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.414153:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e92e expref: 33 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.414161:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.414194:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e92e expref: 33 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.414207:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e92e expref: 33 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367944.414220:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483e71880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808531840:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367944.414308:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367944.417459:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483e71880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808531840:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367944.417489:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367944.426690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367944.427673:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788543360 00000100:00100000:0.0:1787367944.427686:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788543360 00010000:00010000:0.0:1787367944.427732:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e92e expref: 34 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367944.427787:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:0.0:1787367944.427798:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+34:2403:x1874190788543360:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367944.427814:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367944.427820:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e92e expref: 34 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.427847:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e92e expref: 34 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.427868:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff0312b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e92e expref: 34 pid: 6540 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.427905:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:0.0:1787367944.427910:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.427919:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.427927:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367944.427954:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367944.428251:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+33:2403:x1874190788543360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 453us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367944.428259:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00010000:00010000:2.0:1787367944.429737:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.429750:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367944.429818:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787367944.429823:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787367944.429852:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.429888:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e935 expref: 33 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.429905:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e935 expref: 32 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.429924:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367944.429927:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367944.429931:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241de00, rc 0) 00000100:00100000:2.0:1787367944.430255:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+32:12356:x1874190788543232:12345-192.168.203.4@tcp:101:bash.0 Request processed in 16381us (17411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367944.430264:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:3.0:1787367944.438145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367944.438294:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788543616 00000100:00100000:1.0:1787367944.438303:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788543616 00000100:00100000:1.0:1787367944.438399:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1787367944.438410:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+32:12356:x1874190788543616:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1787367944.438610:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+33:12356:x1874190788543616:12345-192.168.203.4@tcp:35:bash.0 Request processed in 201us (473us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787367944.438618:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:3.0:1787367944.505463:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367944.505507:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367944.505537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367944.507109:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788544256 00000100:00100000:2.0:1787367944.507134:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788544256 00000100:00100000:2.0:1787367944.507219:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 325 00000100:00100000:2.0:1787367944.507230:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788544256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367944.507306:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788544256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367944.507314:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 325 00000100:00100000:1.0:1787367944.507472:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788543744 00000100:00100000:1.0:1787367944.507478:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788543744 00000100:00100000:1.0:1787367944.507516:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 389 00000100:00100000:1.0:1787367944.507524:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788543744:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367944.507551:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788543744:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 29us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367944.507557:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 389 00000100:00080000:3.0:1787367944.509175:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367944.509234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367944.509305:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367944.509390:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367944.509413:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788544000 00000100:00100000:3.0:1787367944.509419:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788544000 00000100:00100000:3.0:1787367944.509463:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788544128 00000100:00100000:3.0:1787367944.509467:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788544128 00000100:00100000:3.0:1787367944.509489:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:3.0:1787367944.509502:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788544000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367944.509551:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788544000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367944.509560:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 156 00000100:00100000:3.0:1787367944.509575:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:3.0:1787367944.509582:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788544128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367944.509607:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+6:2405:x1874190788544128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367944.509613:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00080000:3.0:1787367944.509630:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367944.509633:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367944.510779:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788543872 00000100:00100000:1.0:1787367944.510788:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788543872 00000100:00100000:1.0:1787367944.510850:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788544384 00000100:00100000:1.0:1787367944.510854:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788544384 00000100:00100000:1.0:1787367944.510877:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 326 00000100:00100000:1.0:1787367944.510886:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788543872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367944.510945:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788543872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 60us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367944.510952:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 326 00000100:00100000:1.0:1787367944.511073:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 327 00000100:00100000:1.0:1787367944.511105:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788544384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367944.511133:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788544384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367944.511139:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 327 00000100:00080000:0.0:1787367944.511368:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787367944.538266:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367944.590861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367944.591833:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788544640 00000100:00100000:1.0:1787367944.591844:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788544640 00000100:00100000:1.0:1787367944.591910:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 178 00000100:00100000:1.0:1787367944.591921:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+33:12366:x1874190788544640:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367944.591946:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367944.591967:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff0312d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e93c expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367944.592065:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787367944.593953:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff0312d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e93c expref: 35 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367944.593974:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:1.0:1787367944.593977:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367944.593982:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff0312d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e93c expref: 35 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367944.593997:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e200, rc 0) 00000100:00100000:1.0:1787367944.594068:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+34:12366:x1874190788544640:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2149us (3215us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1787367944.594076:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 178 00000100:00100000:0.0:1787367944.612304:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367944.614075:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788544768 00000100:00100000:2.0:1787367944.614097:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788544768 00000100:00100000:2.0:1787367944.614169:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:2.0:1787367944.614180:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+34:12366:x1874190788544768:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1787367944.614252:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614270:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614281:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614297:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614303:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614309:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614439:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614476:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614483:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367944.614528:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614540:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614546:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614552:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614558:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367944.614562:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614569:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614590:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:2.0:1787367944.614594:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367944.614598:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614604:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff0312e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614633:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614898:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614905:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614911:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367944.614914:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614919:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614929:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c55a0548300) 00010000:00010000:2.0:1787367944.614931:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367944.614934:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614940:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0312ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614956:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614962:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614968:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614981:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367944.614984:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614990:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.614999:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367944.615001:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367944.615004:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.615010:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367944.615094:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+34:12366:x1874190788544768:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 914us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367944.615103:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 179 00000100:00100000:2.0:1787367944.621523:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367944.622160:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788545024 00000100:00100000:1.0:1787367944.622184:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788545024 00000100:00100000:1.0:1787367944.622244:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1787367944.622254:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+34:12366:x1874190788545024:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1787367944.623963:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+35:12366:x1874190788545024:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 1703us (2442us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787367944.623983:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1787367944.720506:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367944.720675:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788545280 00000100:00100000:2.0:1787367944.720684:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788545280 00000100:00100000:2.0:1787367944.720742:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:2.0:1787367944.720752:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+35:12369:x1874190788545280:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367944.720783:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367944.720803:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e943 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.720883:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.720920:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.720934:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.720949:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.720955:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.720960:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721078:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031311 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721087:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721286:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367944.721297:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787367944.721421:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721429:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721435:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721448:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367944.721452:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721461:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721473:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:2.0:1787367944.721476:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367944.721481:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721487:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031303 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721499:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721504:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721509:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721514:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367944.721517:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721523:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721541:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c55a0548300) 00010000:00010000:2.0:1787367944.721543:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367944.721546:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721552:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03130a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721589:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff0312fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e943 expref: 38 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721602:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031311 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e943 expref: 37 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.721608:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367944.721611:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367944.721613:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241dc00, rc 0) 00000100:00100000:2.0:1787367944.721941:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+37:12369:x1874190788545280:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1189us (1441us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787367944.721949:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 180 00000100:00100000:0.0:1787367944.729435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367944.729489:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367944.729599:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788545408 00000100:00100000:2.0:1787367944.729609:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788545408 00000100:00100000:2.0:1787367944.729656:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:1.0:1787367944.729743:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788545536 00000100:00100000:1.0:1787367944.729748:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788545536 00000100:00100000:1.0:1787367944.729798:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:1.0:1787367944.729805:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+38:2404:x1874190788545536:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367944.729821:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367944.729845:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031311 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e943 expref: 38 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367944.729861:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367944.729866:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367944.729916:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+37:2404:x1874190788545536:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 112us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367944.729924:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1787367944.730221:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+36:12369:x1874190788545408:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1787367944.730274:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.730288:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.730311:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.730344:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.730350:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.730394:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.730401:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367944.730405:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.730412:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.730421:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367944.730424:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367944.730427:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367944.730433:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03131f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367944.731319:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+36:12369:x1874190788545408:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 1650us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367944.731329:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 181 00000100:00100000:0.0:1787367944.738477:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367944.740510:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788545792 00000100:00100000:3.0:1787367944.740522:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788545792 00000100:00100000:3.0:1787367944.740600:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:3.0:1787367944.740611:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+36:12369:x1874190788545792:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1787367944.741036:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+37:12369:x1874190788545792:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 425us (2567us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787367944.741044:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:0.0:1787367945.069705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367945.070772:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788546048 00000100:00100000:1.0:1787367945.070784:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788546048 00000100:00100000:1.0:1787367945.070866:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:1.0:1787367945.070877:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+37:12387:x1874190788546048:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:1.0:1787367945.070901:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367945.070920:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031326 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e94a expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787367945.071073:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787367945.071177:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff03132d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.071193:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff03132d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.071205:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff03132d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367945.071216:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787367945.071321:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031326 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e94a expref: 40 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.071339:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff03132d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e94a expref: 39 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.071347:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367945.071350:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787367945.071353:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f200, rc 0) 00000100:00100000:1.0:1787367945.072269:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+39:12387:x1874190788546048:12345-192.168.203.4@tcp:101:cat.0 Request processed in 1391us (2570us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1787367945.072278:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 182 00000100:00100000:2.0:1787367945.102235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367945.104132:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788546176 00000100:00100000:0.0:1787367945.104145:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788546176 00000100:00100000:0.0:1787367945.104218:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 183 00000100:00100000:0.0:1787367945.104229:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+39:12388:x1874190788546176:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367945.104251:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367945.104272:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff03133b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e951 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.104390:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031342 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.104404:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.104416:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367945.104454:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787367945.104457:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367945.104476:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.104502:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff03133b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e951 expref: 41 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.104520:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e951 expref: 40 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.104529:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367945.104532:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367945.104535:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b200, rc 0) 00000100:00100000:0.0:1787367945.104606:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+40:12388:x1874190788546176:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 379us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367945.104613:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 183 00000100:00100000:0.0:1787367945.112585:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.112616:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808532352:0@lo:400:kworker.0 00000100:00100000:0.0:1787367945.112633:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788546560 00000100:00100000:3.0:1787367945.112666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367945.112675:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788546560 00000100:00100000:3.0:1787367945.112717:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808532864:0@lo:400:kworker.0 00000100:00100000:0.0:1787367945.112727:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:0.0:1787367945.112738:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+40:12388:x1874190788546560:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1787367945.112748:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367945.112782:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808533376:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.112803:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367945.112834:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787367945.112840:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808532224:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.112865:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367945.112883:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808532736:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.112903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367945.112940:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808533248:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.112963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367945.112988:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808532864 00000100:00100000:3.0:1787367945.112993:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808532864 00000100:00100000:3.0:1787367945.113031:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808533376 00000100:00100000:3.0:1787367945.113034:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808533376 00000100:00100000:0.0:1787367945.113042:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+41:12388:x1874190788546560:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 304us (461us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787367945.113050:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808532224 00000100:00100000:0.0:1787367945.113051:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:3.0:1787367945.113055:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808532224 00000100:00100000:3.0:1787367945.113071:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808532736 00000100:00100000:3.0:1787367945.113073:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808532736 00000100:00080000:0.0:1787367945.113076:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367945.113081:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367945.113090:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808533248 00000100:00100000:3.0:1787367945.113094:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808533248 00000100:00100000:1.0:1787367945.113199:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808532096:0@lo:400:kworker.0 00000100:00100000:1.0:1787367945.113232:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367945.113253:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808532480:0@lo:400:kworker.0 00000100:00100000:1.0:1787367945.113275:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367945.113294:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808532992:0@lo:400:kworker.0 00000100:00100000:1.0:1787367945.113325:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367945.113343:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808533504:0@lo:400:kworker.0 00000100:00100000:1.0:1787367945.113384:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367945.113522:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808532480 00000100:00100000:3.0:1787367945.113526:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808532480 00000100:00100000:3.0:1787367945.113542:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787367945.113549:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808532864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.113586:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808532864:12345-0@lo:400:kworker.0 Request processed in 39us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.113593:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00080000:3.0:1787367945.113624:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483deea00 x1874190808532864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367945.113637:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808532864:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.113658:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1787367945.113664:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808533376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.113696:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808533376:12345-0@lo:400:kworker.0 Request processed in 32us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.113702:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00080000:3.0:1787367945.113722:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afadbb80 x1874190808533376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367945.113731:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808533376:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.113746:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787367945.113752:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808532224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.113797:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808532224:12345-0@lo:400:kworker.0 Request processed in 45us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.113804:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787367945.113825:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808532224:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.113854:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787367945.113860:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808532736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.113893:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808532736:12345-0@lo:400:kworker.0 Request processed in 34us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.113899:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787367945.113982:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808532736:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.113999:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787367945.114006:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808533248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.114038:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808533248:12345-0@lo:400:kworker.0 Request processed in 33us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.114044:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787367945.114064:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808533248:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.114078:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787367945.114085:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808532480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.117191:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808532480:12345-0@lo:400:kworker.0 Request processed in 3097us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.117205:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787367945.117274:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808532352 00000100:00100000:3.0:1787367945.117282:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808532352 00000100:00100000:3.0:1787367945.117331:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787367945.117339:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808532352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.117419:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808532352:12345-0@lo:400:kworker.0 Request processed in 82us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.117426:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787367945.117482:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808532352:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.117620:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808532096 00000100:00100000:3.0:1787367945.117624:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808532096 00000100:00100000:3.0:1787367945.117651:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787367945.117658:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808532096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.117691:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808532096:12345-0@lo:400:kworker.0 Request processed in 34us (4458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.117696:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787367945.117737:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808531968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367945.117784:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367945.117812:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808532608:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.117835:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367945.117854:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808533120:0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.117879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367945.117887:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808531968 00000100:00100000:2.0:1787367945.117893:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808531968 00000100:00100000:3.0:1787367945.117900:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808533632:0@lo:400:kworker.0 00000100:00100000:2.0:1787367945.117913:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808532608 00000100:00100000:2.0:1787367945.117917:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808532608 00000100:00100000:3.0:1787367945.117935:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367945.117938:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787367945.117949:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808531968:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367945.117970:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808532992 00000004:00000024:2.0:1787367945.117975:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787367945.117976:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808532992 00000100:00100000:2.0:1787367945.118020:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808531968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367945.118027:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787367945.118041:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787367945.118047:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808532608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367945.118091:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808532608:12345-0@lo:400:kworker.0 Request processed in 44us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367945.118107:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808532096:0@lo:400:kworker.0 00000100:00100000:2.0:1787367945.118111:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787367945.118127:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808532480:0@lo:400:kworker.0 00000100:00100000:2.0:1787367945.118158:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808531968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367945.118162:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808533504 00000100:00100000:1.0:1787367945.118169:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808533504 00000100:00100000:2.0:1787367945.118173:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808532608:0@lo:400:kworker.0 00000100:00100000:2.0:1787367945.118219:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808533120 00000100:00100000:2.0:1787367945.118223:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808533120 00000100:00080000:0.0:1787367945.119940:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367945.119972:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808533632 00000100:00100000:1.0:1787367945.120092:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787367945.120106:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808533504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.120142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.120169:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788546688 00000100:00100000:3.0:1787367945.120175:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788546688 00000100:00100000:1.0:1787367945.120184:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808533504:12345-0@lo:400:kworker.0 Request processed in 81us (6797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367945.120194:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787367945.120201:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787367945.120212:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3654:x1874190808533120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367945.120221:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1787367945.120232:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+41:12388:x1874190788546688:12345-192.168.203.4@tcp:103:lfs.0 00000100:00100000:1.0:1787367945.120250:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808533504:0@lo:400:kworker.0 00000100:00080000:1.0:1787367945.120284:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367945.120288:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367945.120325:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787367945.120333:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808532992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367945.120369:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3654:x1874190808533120:12345-0@lo:400:kworker.0 Request processed in 143us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367945.120378:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787367945.120409:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808533120:0@lo:400:kworker.0 00010000:00010000:3.0:1787367945.120454:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787367945.120478:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0312d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e935 expref: 41 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.120587:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff03132d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e94a expref: 40 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.120601:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff0311c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8ef expref: 39 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.120611:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367945.120616:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367945.120845:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+38:12388:x1874190788546688:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 616us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.120853:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1787367945.120884:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808532992:12345-0@lo:400:kworker.0 Request processed in 551us (7556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367945.120892:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787367945.120925:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5481bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808532992:0@lo:400:kworker.0 00000100:00100000:0.0:1787367945.121166:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808533632 00000100:00100000:0.0:1787367945.121208:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787367945.121215:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808533632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367945.121268:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808533632:12345-0@lo:400:kworker.0 Request processed in 53us (3334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367945.121274:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787367945.121468:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808533632:0@lo:400:kworker.0 00000100:00080000:2.0:1787367945.122174:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367945.122441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367945.122551:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788546816 00000100:00100000:0.0:1787367945.122557:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788546816 00000100:00100000:0.0:1787367945.122609:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:0.0:1787367945.122617:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+38:12388:x1874190788546816:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:0.0:1787367945.122715:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.122732:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.122743:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367945.123003:0:9404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787367945.123080:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+38:12388:x1874190788546816:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 462us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367945.123088:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 184 00000100:00100000:2.0:1787367945.133941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.134021:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788546944 00000100:00100000:3.0:1787367945.134030:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788546944 00000100:00100000:3.0:1787367945.134113:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 185 00000100:00100000:3.0:1787367945.134123:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+38:12390:x1874190788546944:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1787367945.134142:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367945.134159:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031350 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e958 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134221:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134234:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134262:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134276:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134283:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134290:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134378:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134387:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134395:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367945.134434:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787367945.134437:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787367945.134453:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134464:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134472:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134488:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134494:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134500:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.134504:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134511:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134522:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:3.0:1787367945.134525:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.134529:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134535:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031357 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134547:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134552:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134558:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134563:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.134570:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134589:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134597:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c5483331a00) 00010000:00010000:3.0:1787367945.134600:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.134603:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134609:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03135e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134637:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031350 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e958 expref: 40 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134649:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e958 expref: 39 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.134656:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367945.134659:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787367945.134661:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75600, rc 0) 00000100:00100000:3.0:1787367945.134707:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+39:12390:x1874190788546944:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 586us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.134714:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 185 00000040:00080000:1.0:1787367945.176555:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367945.176564:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787367945.176614:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787367945.176629:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787367945.176759:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548442f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808533760:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787367945.177072:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548239c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367945.186045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.186196:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788547072 00000100:00100000:3.0:1787367945.186205:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788547072 00000100:00100000:3.0:1787367945.186270:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:3.0:1787367945.186280:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+40:12401:x1874190788547072:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787367945.186317:0:6538:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787367945.186458:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+40:12401:x1874190788547072:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 179us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.186467:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 186 00000100:00100000:1.0:1787367945.186830:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548442f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808533760:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367945.189230:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.189298:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788547200 00000100:00100000:3.0:1787367945.189306:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788547200 00000100:00100000:3.0:1787367945.189385:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:3.0:1787367945.189395:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+39:12401:x1874190788547200:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787367945.189463:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189479:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189490:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189553:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189561:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189568:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189655:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189665:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189682:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367945.189722:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787367945.189725:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787367945.189747:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189758:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189773:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189781:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189846:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.189851:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189858:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189870:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:3.0:1787367945.189873:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.189877:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189884:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff03136c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189906:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189913:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.189918:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190174:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.190177:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190184:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190193:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9c5483331a00) 00010000:00010000:3.0:1787367945.190195:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.190198:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190204:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031373 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190218:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190223:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190228:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190239:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.190242:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190248:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190255:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367945.190257:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.190260:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.190265:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff03137a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.190329:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+39:12401:x1874190788547200:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 935us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.190336:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 187 00000100:00100000:2.0:1787367945.207280:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.207404:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788547456 00000100:00100000:3.0:1787367945.207414:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788547456 00000100:00100000:3.0:1787367945.207475:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:3.0:1787367945.207486:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5481bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+39:12401:x1874190788547456:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367945.207506:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367945.207525:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031381 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e95f expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207630:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207656:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207670:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367945.207682:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787367945.207757:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207782:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207789:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207796:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.207800:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207807:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207820:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367945.207823:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787367945.207828:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207834:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff031388 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207868:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031381 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e95f expref: 41 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207883:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:3.0:1787367945.207886:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787367945.207890:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff031381 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e95f expref: 41 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.207899:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74200, rc 0) 00000100:00100000:3.0:1787367945.207970:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5481bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+40:12401:x1874190788547456:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 486us (698us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1787367945.207978:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 188 00000100:00100000:2.0:1787367945.217911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.218016:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788547584 00000100:00100000:3.0:1787367945.218025:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788547584 00000100:00100000:3.0:1787367945.218095:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:3.0:1787367945.218105:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+40:12401:x1874190788547584:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787367945.218142:0:6539:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787367945.218254:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+40:12401:x1874190788547584:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 150us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.218263:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 189 00000100:00100000:2.0:1787367945.232401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.232898:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788547840 00000100:00100000:3.0:1787367945.232909:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788547840 00000100:00100000:3.0:1787367945.232971:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:3.0:1787367945.233190:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+40:12401:x1874190788547840:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367945.233240:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367945.233244:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787367945.233271:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031342 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e951 expref: 40 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.233289:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:1.0:1787367945.233293:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367945.233306:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031396 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e966 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787367945.245329:0:6538:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787367945.245858:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff03139d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.245875:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff03139d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.245885:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff03139d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.245947:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff031396 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e966 expref: 42 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.245964:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff03139d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e966 expref: 41 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.245973:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c54824f2a00) 00010000:00010000:0.0:1787367945.245975:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367945.245979:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a600, rc 0) 00000100:00100000:0.0:1787367945.246086:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+41:12401:x1874190788547840:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 13106us (13694us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787367945.246095:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 190 00000100:00100000:0.0:1787367945.259994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.261728:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788548096 00000100:00100000:3.0:1787367945.261742:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788548096 00000100:00100000:3.0:1787367945.261833:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:3.0:1787367945.261847:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+41:12401:x1874190788548096:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787367945.261936:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367945.261971:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff03139d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e966 expref: 41 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.261991:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c54824f2a00) 00010000:00010000:3.0:1787367945.262004:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367945.262031:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262047:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262058:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262076:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262085:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262093:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262143:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262152:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262159:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262177:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.262182:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262190:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262201:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:3.0:1787367945.262204:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.262209:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262215:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262227:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262234:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262240:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262245:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.262248:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262255:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262280:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x759452ec (ffff9c5483331a00) 00010000:00010000:3.0:1787367945.262283:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.262287:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.262293:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x759452ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.262527:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+40:12401:x1874190788548096:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 682us (2537us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787367945.262536:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 191 00000100:00100000:3.0:1787367945.274315:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367945.274425:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788548224 00000100:00100000:1.0:1787367945.274434:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788548224 00000100:00100000:1.0:1787367945.274491:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:1.0:1787367945.274501:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+40:12401:x1874190788548224:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367945.274520:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367945.274541:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0313b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e96d expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.274572:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.274584:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.274613:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.274724:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0313b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e96d expref: 42 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.274744:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e96d expref: 41 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.274754:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:1.0:1787367945.274757:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787367945.274770:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67ea00, rc 0) 00000100:00100000:1.0:1787367945.274837:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+41:12401:x1874190788548224:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 338us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367945.274844:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 192 00000100:00100000:3.0:1787367945.284013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367945.284097:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788548480 00000100:00100000:0.0:1787367945.284107:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788548480 00000100:00100000:0.0:1787367945.284163:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:0.0:1787367945.284173:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+41:12401:x1874190788548480:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787367945.284250:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.284267:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.284279:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367945.284497:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787367945.284508:0:6539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402572150826ns, next at 403572147893ns, rc = 0 00000004:00010000:0.0:1787367945.284583:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038434027 reply state 000000007441debd transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.284598:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.284605:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:0.0:1787367945.284608:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787367945.284611:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367945.284709:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+43:12401:x1874190788548480:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 533us (701us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787367945.284718:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 193 00000100:00100000:1.0:1787367945.292207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367945.292309:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788548608 00000100:00100000:0.0:1787367945.292322:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788548608 00000100:00100000:0.0:1787367945.292438:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:0.0:1787367945.292456:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+43:12401:x1874190788548608:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367945.292496:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367945.292518:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e974 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.292583:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e974 expref: 44 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.292627:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e974 expref: 44 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.292652:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:0.0:1787367945.292657:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367945.292661:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a200, rc 0) 00000100:00100000:0.0:1787367945.292732:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+44:12401:x1874190788548608:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 280us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367945.292741:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:3.0:1787367945.297885:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367945.298010:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788548736 00000100:00100000:0.0:1787367945.298019:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788548736 00000100:00100000:0.0:1787367945.298079:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:0.0:1787367945.298089:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+6:2402:x1874190788548736:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787367945.298298:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788548736:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 209us (422us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787367945.298306:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:0.0:1787367945.300466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.300567:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788548992 00000100:00100000:3.0:1787367945.300577:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788548992 00000100:00100000:3.0:1787367945.300667:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:3.0:1787367945.300681:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+44:12401:x1874190788548992:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787367945.300925:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+45:12401:x1874190788548992:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 247us (467us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787367945.300932:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:3.0:1787367945.307450:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367945.307600:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788549248 00000100:00100000:0.0:1787367945.307609:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788549248 00000100:00100000:0.0:1787367945.307668:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:0.0:1787367945.307678:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+45:12401:x1874190788549248:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787367945.307790:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+45:12401:x1874190788549248:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 105us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367945.307799:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 195 00000100:00100000:3.0:1787367945.311729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367945.311944:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788549376 00000100:00100000:1.0:1787367945.311953:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788549376 00000100:00100000:1.0:1787367945.312020:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:1.0:1787367945.312030:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+45:12401:x1874190788549376:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367945.312050:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367945.312069:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0313d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e97b expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.312147:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff0313dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.312170:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff0313dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.312181:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff0313dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367945.312229:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367945.312246:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff0313dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.312269:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0313d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e97b expref: 47 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.312285:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff0313dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e97b expref: 46 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.312294:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:1.0:1787367945.312297:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787367945.312300:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f400, rc 0) 00000100:00100000:1.0:1787367945.312352:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+46:12401:x1874190788549376:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 323us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367945.312388:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:1.0:1787367945.339858:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367945.339990:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788549504 00000100:00100000:2.0:1787367945.339998:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788549504 00000100:00100000:2.0:1787367945.340063:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:2.0:1787367945.340076:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2403:x1874190788549504:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367945.340096:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367945.340118:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e982 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367945.340146:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a891209, blocks: 0x0 00010000:00010000:2.0:1787367945.340170:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=402s v=(0 0) 00010000:00010000:2.0:1787367945.340177:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367945.340189:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e982 expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.340213:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e982 expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.340228:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c400, rc 0) 00000100:00100000:2.0:1787367945.340294:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2403:x1874190788549504:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 219us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367945.340304:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:2.0:1787367945.348565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.348658:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788549760 00000100:00100000:3.0:1787367945.348667:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788549760 00000100:00100000:3.0:1787367945.348824:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00100000:3.0:1787367945.348834:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+46:12401:x1874190788549760:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787367945.349167:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+46:12401:x1874190788549760:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 329us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.349177:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00100000:2.0:1787367945.359864:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367945.359937:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788549888 00000100:00100000:0.0:1787367945.359946:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788549888 00000100:00100000:0.0:1787367945.360002:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:0.0:1787367945.360013:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:12401:x1874190788549888:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367945.360032:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367945.360048:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e989 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.360080:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e982 expref: 9 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.360090:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367945.360094:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367945.360099:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.360133:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e982 expref: 9 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.360147:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e982 expref: 9 pid: 8454 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367945.360178:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1874190808533888:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367945.360280:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367945.374635:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.374779:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788550016 00000100:00100000:3.0:1787367945.374791:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788550016 00010000:00010000:3.0:1787367945.374840:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e982 expref: 10 pid: 8454 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.374906:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:3.0:1787367945.374931:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+10:2402:x1874190788550016:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367945.374951:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367945.374977:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e982 expref: 10 pid: 8454 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.374995:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e982 expref: 10 pid: 8454 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.375025:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367945.375032:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367945.375041:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 10 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.375054:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 10 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.375100:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 10 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.375138:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585102d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6523:1874190808534016:192.168.203.4@tcp:105: 00000100:00100000:3.0:1787367945.375223:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58b40 going to sleep for 11 seconds 00010000:00010000:1.0:1787367945.375439:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000273d068c/0x66f5679bff0313e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e982 expref: 10 pid: 8454 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367945.375455:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1874190808533888:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367945.375491:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.375500:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613be00, rc 0) 00000100:00100000:1.0:1787367945.375527:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+9:12401:x1874190788549888:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 15517us (15673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367945.375535:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:1.0:1787367945.377988:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585102d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6523:1874190808534016:192.168.203.4@tcp:105: 00010000:00010000:1.0:1787367945.378011:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367945.378063:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788550016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3138us (3437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367945.378075:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:3.0:1787367945.380755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367945.380843:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788550144 00000100:00100000:1.0:1787367945.380852:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788550144 00002000:00100000:1.0:1787367945.380901:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c5585101f80 x1874190788550144/t0(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:586/0 lens 504/0 e 0 to 0 dl 1787367956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367945.380922:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5585101f80 with x1874190788550144 ext(0->8) 00002000:00010000:1.0:1787367945.380927:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5585101f80 00000100:00100000:1.0:1787367945.380974:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1787367945.380990:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2403:x1874190788550144:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787367945.382074:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6033427c-dc64-421a-b37f-d4458dbaa527+10:2403:x1874190788550144:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 1084us (1334us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787367945.382085:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00002000:00100000:1.0:1787367945.382095:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c5585101f80 x1874190788550144/t4294967315(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:586/0 lens 504/448 e 0 to 0 dl 1787367956 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367945.382121:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5585101f80 with x1874190788550144 ext(0->8) 00002000:00010000:1.0:1787367945.382126:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5585101f80 00000100:00100000:2.0:1787367945.399182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367945.399863:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788550272 00000100:00100000:1.0:1787367945.399872:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788550272 00000100:00100000:1.0:1787367945.399931:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 198 00000100:00100000:1.0:1787367945.399940:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+46:12401:x1874190788550272:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787367945.403447:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1787367945.403463:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1787367945.403516:0:6517:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1787367945.403562:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787367945.403574:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787367945.403655:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367945.403673:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808534144:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787367945.403723:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403736:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403744:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403752:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d400 already unused, calling callback (ffffffffc175e4f0) 00000100:00100000:0.0:1787367945.403754:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787367945.403769:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403780:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403796:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367945.403800:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.403806:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367945.403811:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808534144 00010000:00010000:3.0:1787367945.403813:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d400/0x66f5679bff03125b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367945.403820:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808534144 00010000:00010000:3.0:1787367945.403841:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403863:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367945.403864:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00010000:00010000:3.0:1787367945.403874:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367945.403878:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b62fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808534144:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787367945.403885:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613aa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.403890:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403897:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403916:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367945.403918:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.403922:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403927:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff03127e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403942:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403949:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403956:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.403960:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.403971:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787367945.403988:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:3.0:1787367945.403991:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787367945.403992:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787367945 00002000:00010000:0.0:1787367945.403999:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787367945.404004:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787367945 -> 1787367945 00002000:00010000:0.0:1787367945.404007:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787367945.404012:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:3.0:1787367945.404017:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367945.404020:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.404026:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff0312c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.404041:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367945.404050:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b62fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808534144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (295us total) trans 4294967316 rc 0/0 00010000:00010000:3.0:1787367945.404051:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367945.404065:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:3.0:1787367945.404068:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.404076:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367945.404079:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.404084:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.404094:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:3.0:1787367945.404097:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787367945.404107:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.404115:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0313c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787367945.404227:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c55afa76d80/2, rc 0, transno 4294967316 00000100:00100000:0.0:1787367945.404233:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808534144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787367945.405172:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+19:12401:x1874190788550272:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 5228us (5997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367945.405183:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 198 00000100:00100000:1.0:1787367945.409351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367945.409682:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788550400 00000100:00100000:2.0:1787367945.409692:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788550400 00000100:00100000:2.0:1787367945.409854:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1787367945.409868:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+10:2402:x1874190788550400:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787367945.414274:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1787367945.414290:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1787367945.415141:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788550400:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 5267us (5788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367945.415154:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1787367945.435464:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.436956:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788550656 00000100:00100000:3.0:1787367945.436969:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788550656 00000100:00100000:3.0:1787367945.437044:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:3.0:1787367945.437054:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+19:12401:x1874190788550656:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787367945.437116:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367945.437150:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff0313dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e97b expref: 19 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.437176:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:3.0:1787367945.437182:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367945.437219:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.437235:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.437247:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367945.437457:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000523c9df3 reply state 00000000d1c8dd35 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.437473:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.437498:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:3.0:1787367945.437500:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787367945.437520:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367945.437628:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+20:12401:x1874190788550656:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 575us (2175us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787367945.437636:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:3.0:1787367945.440609:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367945.441531:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788550784 00000100:00100000:2.0:1787367945.441542:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788550784 00000100:00100000:2.0:1787367945.441598:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1787367945.441608:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788550784:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787367945.441748:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787367945.441752:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787367945 -> 1787367944 00002000:00010000:2.0:1787367945.441754:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787367942 00002000:00010000:2.0:1787367945.441757:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787367945 -> 1787367944 00002000:00010000:2.0:1787367945.441772:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787367945.441839:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788550784:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 231us (1237us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787367945.441847:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1787367945.445119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.445175:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788551040 00000100:00100000:3.0:1787367945.445186:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788551040 00000100:00100000:3.0:1787367945.445251:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 200 00000100:00100000:3.0:1787367945.445266:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+20:12401:x1874190788551040:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787367945.445346:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.445401:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e96d expref: 20 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.445413:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.445457:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e96d expref: 20 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.445473:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e96d expref: 20 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.445489:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585102d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808534272:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367945.445610:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367945.449222:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585102d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808534272:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367945.449250:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367945.449395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.449642:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788551168 00000100:00100000:3.0:1787367945.449648:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788551168 00010000:00010000:3.0:1787367945.449681:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e96d expref: 21 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.449718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:3.0:1787367945.449727:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5598cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+21:2403:x1874190788551168:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367945.449856:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367945.449865:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e96d expref: 21 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.449878:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e96d expref: 21 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.449900:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0313c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e96d expref: 21 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.449969:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:3.0:1787367945.450163:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.450175:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.450205:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.450317:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367945.450411:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5598cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+20:2403:x1874190788551168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 681us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.450421:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00010000:00010000:2.0:1787367945.459645:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.459662:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.459704:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.459711:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.459717:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.459723:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367945.459727:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.459734:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.459751:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:2.0:1787367945.459754:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787367945.459768:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.459775:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74200/0x66f5679bff0313f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367945.459891:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:12401:x1874190788551040:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 14623us (14777us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787367945.459903:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 200 00000100:00100000:3.0:1787367945.466190:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.466238:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788551296 00000100:00100000:3.0:1787367945.466251:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788551296 00000100:00100000:3.0:1787367945.466309:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1787367945.466323:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788551296:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787367945.466398:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.466422:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.466431:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367945.466436:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367945.466440:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.466483:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.466498:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 8 pid: 8453 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.466545:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1874190808534400:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367945.466624:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5598227e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367945.470967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367945.471474:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1874190808534400:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367945.471499:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.471545:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788551424 00000100:00100000:3.0:1787367945.471551:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788551424 00010000:00010000:3.0:1787367945.471591:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 9 pid: 8453 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.471624:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:3.0:1787367945.471634:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+9:2402:x1874190788551424:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367945.471648:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367945.471668:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 9 pid: 8453 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.471682:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 9 pid: 8453 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.471703:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0313ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e989 expref: 9 pid: 8453 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.471735:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367945.471739:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367945.471745:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.471756:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.471788:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367945.471843:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788551424:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 210us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.471852:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00010000:00010000:3.0:1787367945.471876:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.471885:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.471902:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.472488:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.472497:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.472523:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367945.472527:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.472538:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.472551:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.472559:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff0313ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.472610:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788551296:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 6291us (6431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367945.472618:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1787367945.477280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367945.477417:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788551680 00000100:00100000:2.0:1787367945.477426:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788551680 00000100:00100000:2.0:1787367945.477481:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 201 00000100:00100000:2.0:1787367945.477490:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+19:12401:x1874190788551680:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787367945.477572:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.477590:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e912 expref: 19 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.477600:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.477632:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e912 expref: 19 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.477646:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e912 expref: 19 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367945.477660:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483790e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808534528:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367945.477733:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367945.482879:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483790e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808534528:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367945.482916:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367945.496291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367945.496515:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788551808 00000100:00100000:1.0:1787367945.496525:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788551808 00010000:00010000:1.0:1787367945.496566:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e912 expref: 20 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367945.496603:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1787367945.496613:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+20:2402:x1874190788551808:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367945.496628:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367945.496635:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e912 expref: 20 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.496649:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e912 expref: 20 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.496669:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031254 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e912 expref: 20 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.496704:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367945.496709:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.496719:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.496726:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.496746:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367945.496808:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+19:2402:x1874190788551808:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 196us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367945.496816:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00010000:00010000:2.0:1787367945.497343:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.497375:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.498122:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.498139:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e974 expref: 19 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.498148:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.498179:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e974 expref: 19 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.498191:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e974 expref: 19 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367945.498206:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483790700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808534656:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367945.498275:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367945.508070:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483790700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808534656:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367945.508099:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.518703:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367945.520090:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788551936 00000100:00100000:2.0:1787367945.520103:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788551936 00010000:00010000:2.0:1787367945.520151:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e974 expref: 20 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367945.520210:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:2.0:1787367945.520220:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+20:2403:x1874190788551936:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367945.520236:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367945.520243:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e974 expref: 20 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.520256:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e974 expref: 20 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.520276:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0313ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e974 expref: 20 pid: 9404 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.520292:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:2.0:1787367945.520298:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.520306:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.520313:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.520347:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367945.520447:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+19:2403:x1874190788551936:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 227us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367945.520454:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00010000:00010000:0.0:1787367945.520590:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367945.520599:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367945.520703:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1787367945.520826:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1787367945.520868:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1787367945.520969:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6540:1874190808534784:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787367945.521028:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367945.521066:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367945.521942:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808534784 00000100:00100000:2.0:1787367945.521963:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808534784 00000100:00100000:2.0:1787367945.522007:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787367945.522016:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6540:x1874190808534784:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787367945.522133:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6540:x1874190808534784:12345-0@lo:1000:mdt00_002.0 Request processed in 117us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367945.522140:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787367945.522185:0:6540:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1787367945.522191:0:6540:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c55afa76d80, transno 4294967316 00000100:00100000:1.0:1787367945.522210:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6540:1874190808534784:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787367945.522331:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1787367945.522405:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548442c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6540:1874190808534912:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787367945.522440:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367945.522471:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367945.522699:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808534912 00000100:00100000:0.0:1787367945.522704:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808534912 00000100:00100000:0.0:1787367945.522738:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787367945.522745:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6540:x1874190808534912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787367945.522850:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6540:x1874190808534912:12345-0@lo:1000:mdt00_002.0 Request processed in 105us (410us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787367945.522857:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787367945.522928:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548442c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6540:1874190808534912:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787367945.522959:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.522969:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.522999:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523005:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367945.523010:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523018:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523032:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:1.0:1787367945.523035:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787367945.523039:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523045:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03140d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523065:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523072:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523076:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523081:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367945.523083:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523097:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523106:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:1.0:1787367945.523108:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787367945.523110:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523116:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031349 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523134:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523146:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e958 expref: 22 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523154:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523174:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e958 expref: 22 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.523188:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e958 expref: 22 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367945.523198:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548442e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808535040:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367945.523243:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367945.543657:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548442e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808535040:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367945.543700:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367945.544933:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367945.545120:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788552064 00000100:00100000:2.0:1787367945.545128:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788552064 00010000:00010000:2.0:1787367945.545167:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e958 expref: 23 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367945.545205:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:2.0:1787367945.545215:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+23:2402:x1874190788552064:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367945.545229:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367945.545235:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e958 expref: 23 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545247:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e958 expref: 23 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545268:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff031365 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e958 expref: 23 pid: 6539 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545283:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367945.545288:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545296:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545309:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545335:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367945.545427:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+22:2402:x1874190788552064:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 213us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367945.545434:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00010000:00010000:2.0:1787367945.545457:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545463:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545475:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545481:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545487:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545492:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367945.545497:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545516:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545525:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367945.545528:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367945.545538:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545544:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031414 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545555:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545560:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545565:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545569:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367945.545571:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545577:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545585:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55a0548e00) 00010000:00010000:2.0:1787367945.545587:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787367945.545590:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367945.545595:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d000/0x66f5679bff031406 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367945.545714:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+21:12401:x1874190788551680:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 68224us (68442us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787367945.545723:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 201 00000020:00080000:2.0:1787367945.545733:0:6540:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787367945.545831:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367945.545836:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367945.546384:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787367945.546393:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367945.551838:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367945.551903:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788552320 00000100:00100000:1.0:1787367945.551913:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788552320 00000100:00100000:1.0:1787367945.551968:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1787367945.551983:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+21:12401:x1874190788552320:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787367945.552228:0:6541:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787367945.552258:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1787367945.552289:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.552304:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.552315:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.552323:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.552329:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.552335:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367945.552387:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787367945.552462:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+23:12401:x1874190788552320:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 485us (642us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787367945.552471:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000020:00080000:1.0:1787367945.552488:0:6541:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787367945.552712:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367945.552719:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.552726:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ec00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367945.552730:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.552756:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.552775:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:3.0:1787367945.552779:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787367945.552784:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.552790:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03141b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367945.552804:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367945.552805:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367945.552807:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367945.561531:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367945.624625:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808535168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367945.624705:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367945.624775:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808535168 00000100:00100000:0.0:1787367945.624783:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808535168 00000100:00100000:0.0:1787367945.624836:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787367945.624846:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808535168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367945.624872:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367945.624939:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808535168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367945.624947:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787367945.624990:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808535168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787367945.626088:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808535296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367945.626131:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367945.626171:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367945.626179:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808535296 00000100:00100000:3.0:1787367945.626180:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808535424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367945.626186:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808535296 00000100:00100000:3.0:1787367945.626213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367945.626234:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808535424 00000100:00100000:0.0:1787367945.626239:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808535424 00000100:00100000:0.0:1787367945.626259:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787367945.626267:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808535296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367945.626283:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1787367945.626335:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808535296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367945.626342:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787367945.626386:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787367945.626393:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808535424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367945.626404:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1787367945.626427:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808535424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367945.626432:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787367945.626692:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808535424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367945.626705:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808535296:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1787367945.999693:0:14724:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367945.999701:0:14724:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367945.999718:0:14724:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787367945.999724:0:14724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367946.088371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367946.088412:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788552576 00000100:00100000:2.0:1787367946.088422:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788552576 00000100:00100000:2.0:1787367946.088488:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:2.0:1787367946.088499:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+23:12412:x1874190788552576:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367946.088521:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367946.088542:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff031422 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e990 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.088655:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff031429 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.088670:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff031429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.088683:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff031429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367946.088694:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787367946.088812:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff031422 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e990 expref: 26 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.088839:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff031429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e990 expref: 25 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.088847:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:2.0:1787367946.088856:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787367946.088860:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241cc00, rc 0) 00000100:00100000:2.0:1787367946.090342:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+25:12412:x1874190788552576:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1841us (1990us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787367946.090662:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:3.0:1787367946.092884:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.093595:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788552704 00000100:00100000:1.0:1787367946.093605:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788552704 00000100:00100000:1.0:1787367946.093851:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 203 00000100:00100000:1.0:1787367946.093864:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+25:12412:x1874190788552704:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1787367946.093943:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.093962:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.093973:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.093989:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.093997:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094004:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094075:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094083:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094090:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367946.094133:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094157:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094164:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094171:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094177:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367946.094181:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094189:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094201:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:1.0:1787367946.094204:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367946.094209:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094216:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031437 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094229:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094236:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094242:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094253:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367946.094257:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094263:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094271:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c5590ea9b00) 00010000:00010000:1.0:1787367946.094273:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367946.094276:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094282:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03143e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094296:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094303:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094309:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094313:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367946.094316:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094321:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094338:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c5590ea9000) 00010000:00010000:1.0:1787367946.094340:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367946.094343:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.094349:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031445 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367946.095560:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+25:12412:x1874190788552704:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1692us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367946.095573:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 203 00000100:00100000:3.0:1787367946.126511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367946.127530:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788552960 00000100:00100000:2.0:1787367946.127540:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788552960 00000100:00100000:2.0:1787367946.127605:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:2.0:1787367946.127622:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+25:12415:x1874190788552960:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367946.127644:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367946.127663:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03144c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e997 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.127730:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.127745:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.129581:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.129612:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.129623:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.129631:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131532:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131565:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131587:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367946.131610:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787367946.131725:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131733:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131741:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131747:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241de00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367946.131753:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131776:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131790:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:2.0:1787367946.131793:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367946.131804:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131938:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031453 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131951:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131958:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131970:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131976:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367946.131980:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131986:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.131995:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c55867a2200) 00010000:00010000:2.0:1787367946.131998:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367946.132001:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.132024:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03145a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.132390:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d200/0x66f5679bff03144c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e997 expref: 28 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.132415:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e997 expref: 27 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.132431:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:2.0:1787367946.132433:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367946.132436:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241dc00, rc 0) 00000100:00100000:2.0:1787367946.132569:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+27:12415:x1874190788552960:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 4954us (6066us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787367946.132579:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:3.0:1787367946.135843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367946.136038:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788553088 00000100:00100000:2.0:1787367946.136048:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788553088 00000100:00100000:2.0:1787367946.136113:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:2.0:1787367946.136123:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+27:12415:x1874190788553088:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1787367946.136186:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.136203:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.136214:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.136250:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.136257:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.136264:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.136270:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787367946.136283:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.136292:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.136305:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:2.0:1787367946.136309:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367946.136313:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.136320:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03146f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367946.137652:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+27:12415:x1874190788553088:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 1524us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367946.137665:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 205 00000100:00100000:3.0:1787367946.140614:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367946.140768:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788553344 00000100:00100000:2.0:1787367946.140778:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788553344 00000100:00100000:2.0:1787367946.140834:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:2.0:1787367946.140845:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+27:12415:x1874190788553344:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787367946.141040:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+28:12415:x1874190788553344:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 196us (433us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1787367946.141049:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:2.0:1787367946.146491:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808535552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367946.146560:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367946.146924:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808535552 00000100:00100000:0.0:1787367946.146932:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808535552 00000100:00100000:0.0:1787367946.146987:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787367946.146997:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874190808535552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367946.147018:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367946.147070:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874190808535552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367946.147088:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787367946.147204:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808535552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367946.174002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.174472:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788553600 00000100:00100000:1.0:1787367946.174493:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788553600 00000100:00100000:1.0:1787367946.174552:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:1.0:1787367946.174563:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+28:11947:x1874190788553600:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1787367946.174587:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367946.174608:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031476 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e99e expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.174733:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.174749:0:9404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e997 expref: 29 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.174772:0:9404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.174807:0:9404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e997 expref: 29 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.174830:0:9404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e997 expref: 29 pid: 6538 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367946.174844:0:9404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548442e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808535680:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367946.174928:0:9404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624780 going to sleep for 11 seconds 00000100:00100000:0.0:1787367946.183096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367946.183129:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788553728 00000100:00100000:0.0:1787367946.183137:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788553728 00010000:00010000:0.0:1787367946.183177:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e997 expref: 30 pid: 6538 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367946.183213:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:0.0:1787367946.183223:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+30:2403:x1874190788553728:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367946.183238:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367946.183245:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e997 expref: 30 pid: 6538 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.183260:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e997 expref: 30 pid: 6538 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.183282:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:0.0:1787367946.183288:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.183297:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.183305:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.183324:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367946.183404:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+30:2403:x1874190788553728:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 181us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367946.183424:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00010000:00010000:3.0:1787367946.184049:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff031461 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e997 expref: 29 pid: 6538 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367946.184068:0:9404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548442e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808535680:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367946.184088:0:9404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.184097:0:9404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.184104:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367946.184123:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787367946.184248:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff031476 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e99e expref: 30 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.184264:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e99e expref: 29 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.184273:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:3.0:1787367946.184276:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787367946.184278:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e600, rc 0) 00000100:00100000:3.0:1787367946.184329:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+29:11947:x1874190788553600:12345-192.168.203.4@tcp:101:bash.0 Request processed in 9768us (10337us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1787367946.184351:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:0.0:1787367946.191855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.191944:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788553856 00000100:00100000:1.0:1787367946.191954:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788553856 00000100:00100000:1.0:1787367946.192013:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 207 00000100:00100000:1.0:1787367946.192023:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+29:11947:x1874190788553856:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1787367946.192046:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367946.192065:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03148b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9a5 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.192098:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031492 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.192113:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.192124:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.192225:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff03148b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9a5 expref: 31 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.192241:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031492 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9a5 expref: 30 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.192261:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:1.0:1787367946.192264:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787367946.192268:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e200, rc 0) 00000100:00100000:1.0:1787367946.192319:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+30:11947:x1874190788553856:12345-192.168.203.4@tcp:101:bash.0 Request processed in 297us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367946.192326:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 207 00000100:00100000:0.0:1787367946.202174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367946.219247:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788554112 00000100:00100000:3.0:1787367946.219261:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788554112 00000100:00100000:3.0:1787367946.219329:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 208 00000100:00100000:3.0:1787367946.219340:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+30:11947:x1874190788554112:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:3.0:1787367946.220219:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.220237:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.220248:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367946.220291:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1787367946.220313:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee855acb reply state 000000002f4715a9 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.220325:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.220332:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:3.0:1787367946.220335:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787367946.220338:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787367946.222267:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1787367946.225605:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+34:11947:x1874190788554112:12345-192.168.203.4@tcp:36:bash.0 Request processed in 6256us (23429us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787367946.225620:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 208 00000020:00080000:3.0:1787367946.225628:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787367946.253955:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367946.254042:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788554240 00000100:00100000:3.0:1787367946.254051:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788554240 00000100:00100000:3.0:1787367946.254114:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:3.0:1787367946.254124:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+34:11947:x1874190788554240:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787367946.254148:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367946.254166:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75e00/0x66f5679bff0314a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9ac expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.254220:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75e00/0x66f5679bff0314a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9ac expref: 35 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.254234:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75e00/0x66f5679bff0314a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9ac expref: 35 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.254250:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:3.0:1787367946.254253:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367946.254257:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75e00, rc 0) 00000100:00100000:3.0:1787367946.254318:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+35:11947:x1874190788554240:12345-192.168.203.4@tcp:101:bash.0 Request processed in 195us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367946.254326:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:2.0:1787367946.262351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367946.262533:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788554368 00000100:00100000:0.0:1787367946.262541:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788554368 00000100:00100000:0.0:1787367946.262643:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:0.0:1787367946.262654:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:11947:x1874190788554368:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367946.262671:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367946.262691:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9b3 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787367946.262713:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a891208, atime: 0x6a891206, ctime: 0x6a891208, blocks: 0x8 00010000:00010000:0.0:1787367946.262744:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1787367946.262749:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367946.266517:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9b3 expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.266553:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9b3 expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.266568:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613be00, rc 0) 00000100:00100000:0.0:1787367946.266649:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:11947:x1874190788554368:12345-192.168.203.4@tcp:101:bash.0 Request processed in 3996us (4304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367946.266658:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00080000:2.0:1787367946.267607:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367946.272035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367946.272127:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788554496 00000100:00100000:2.0:1787367946.272160:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788554496 00002000:00010000:2.0:1787367946.272199:0:8459:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1787367946.272203:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c548442df80 with x1874190788554496 ext(0->18446744073709551615) 00002000:00010000:2.0:1787367946.272216:0:8459:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c548442df80. 00000100:00100000:2.0:1787367946.272249:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1787367946.272259:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788554496:12345-192.168.203.4@tcp:10:bash.0 00002000:00010000:2.0:1787367946.272673:0:8459:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787367946.272677:0:8459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787367944 -> 1787367946 00002000:00010000:2.0:1787367946.272680:0:8459:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787367942 -> 1787367942 00002000:00010000:2.0:1787367946.272682:0:8459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787367944 -> 1787367946 00002000:00010000:2.0:1787367946.272684:0:8459:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787367946.273023:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+9:2402:x1874190788554496:12345-192.168.203.4@tcp:10:bash.0 Request processed in 763us (995us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787367946.273033:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00002000:00010000:2.0:1787367946.273037:0:8459:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1787367946.273041:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c548442df80 with x1874190788554496 ext(0->18446744073709551615) 00002000:00010000:2.0:1787367946.273047:0:8459:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c548442df80. 00000100:00100000:1.0:1787367946.364432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367946.364514:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788554624 00000100:00100000:3.0:1787367946.364523:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788554624 00000100:00100000:3.0:1787367946.364590:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:3.0:1787367946.364611:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+35:12429:x1874190788554624:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1787367946.364689:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364708:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364743:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364771:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364780:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364786:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364863:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364872:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364878:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367946.364936:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364948:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364955:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364960:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364977:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367946.364981:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.364989:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365002:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:3.0:1787367946.365005:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367946.365009:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365015:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff0314ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365028:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365034:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365040:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365045:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367946.365048:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365053:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365072:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c5483331300) 00010000:00010000:3.0:1787367946.365074:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367946.365077:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365082:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff0314b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365097:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365103:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365109:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365115:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367946.365118:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365123:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365130:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:3.0:1787367946.365132:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367946.365135:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.365140:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367946.365218:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+35:12429:x1874190788554624:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 619us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367946.365226:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:3.0:1787367946.419415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.419573:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788554880 00000100:00100000:1.0:1787367946.419590:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788554880 00000100:00100000:1.0:1787367946.419649:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:1.0:1787367946.419659:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+35:12432:x1874190788554880:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367946.419678:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367946.419697:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff0314c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9ba expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.419783:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.419799:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.419811:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.419825:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.419845:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.419853:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.419953:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff0314d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.419963:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff0314d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.419969:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff0314d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367946.419977:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787367946.420052:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420060:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420066:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420072:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367946.420076:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420083:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420107:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:1.0:1787367946.420110:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367946.420115:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420121:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420135:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420141:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420146:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420151:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367946.420153:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420158:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420164:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c5590ea9000) 00010000:00010000:1.0:1787367946.420166:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367946.420169:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420174:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420222:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff0314c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9ba expref: 38 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420235:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff0314d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9ba expref: 37 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.420242:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:1.0:1787367946.420244:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787367946.420247:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fc00, rc 0) 00000100:00100000:1.0:1787367946.420310:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+37:12432:x1874190788554880:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 653us (913us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787367946.420317:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:1.0:1787367946.432867:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367946.432984:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788555008 00000100:00100000:3.0:1787367946.432994:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788555008 00000100:00100000:3.0:1787367946.433049:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:3.0:1787367946.433059:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+37:12432:x1874190788555008:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1787367946.433123:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.433139:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e99e expref: 37 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.433149:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.433181:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e99e expref: 37 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.433194:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e99e expref: 37 pid: 9404 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367946.433207:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808535808:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367946.433312:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367946.435428:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6538:1874190808535808:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367946.435468:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367946.436727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367946.436999:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788555264 00000100:00100000:2.0:1787367946.437008:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788555264 00000100:00100000:2.0:1787367946.437065:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:2.0:1787367946.437076:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+38:6184:x1874190788555264:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787367946.437383:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+39:6184:x1874190788555264:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 278us (629us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787367946.437392:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:1.0:1787367946.440232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367946.440325:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788555392 00000100:00100000:2.0:1787367946.440333:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788555392 00010000:00010000:2.0:1787367946.440408:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e99e expref: 39 pid: 9404 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367946.440450:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:2.0:1787367946.440460:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+39:2402:x1874190788555392:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367946.440473:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367946.440479:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e99e expref: 39 pid: 9404 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.440493:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e99e expref: 39 pid: 9404 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.440515:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff03147d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e99e expref: 39 pid: 9404 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.440532:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:2.0:1787367946.440537:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.440546:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.440554:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.440593:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367946.440648:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+38:2402:x1874190788555392:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 190us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367946.440656:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00010000:00010000:1.0:1787367946.440721:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.440730:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.440785:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.440793:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.440800:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.440813:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367946.440818:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.440825:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.440836:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:1.0:1787367946.440838:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367946.440842:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.440848:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0314e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367946.440886:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+37:12432:x1874190788555008:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 7829us (8029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367946.440894:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:3.0:1787367946.446946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.447028:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788555648 00000100:00100000:1.0:1787367946.447038:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788555648 00000100:00100000:1.0:1787367946.447092:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:1.0:1787367946.447102:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+37:12432:x1874190788555648:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1787367946.447306:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+38:12432:x1874190788555648:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 204us (368us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787367946.447313:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:0.0:1787367946.575236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.575331:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788555904 00000100:00100000:1.0:1787367946.575340:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788555904 00000100:00100000:1.0:1787367946.575449:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 213 00000100:00100000:1.0:1787367946.575476:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+38:12443:x1874190788555904:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:1.0:1787367946.575499:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367946.575519:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff0314ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9c1 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.575596:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.575610:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.575621:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.575634:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.575641:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.575647:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.575747:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e000/0x66f5679bff031502 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.575766:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e000/0x66f5679bff031502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.575773:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e000/0x66f5679bff031502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367946.575794:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787367946.576062:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576070:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576077:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576083:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367946.576087:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576095:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576106:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:1.0:1787367946.576109:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367946.576113:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576119:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0314f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576131:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576137:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576153:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576158:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367946.576161:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576167:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576173:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c5590ea9000) 00010000:00010000:1.0:1787367946.576175:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367946.576178:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576183:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0314fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576228:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff0314ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c1 expref: 41 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576241:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e000/0x66f5679bff031502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c1 expref: 40 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.576248:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:1.0:1787367946.576250:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367946.576253:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e000, rc 0) 00000100:00100000:1.0:1787367946.577819:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+40:12443:x1874190788555904:12345-192.168.203.4@tcp:101:cat.0 Request processed in 2329us (2585us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787367946.577849:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 213 00010000:00010000:0.0:1787367946.584599:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367946.591229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.591523:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788556160 00000100:00100000:1.0:1787367946.591533:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788556160 00000100:00100000:1.0:1787367946.591597:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1787367946.591608:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+40:12443:x1874190788556160:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:1.0:1787367946.592033:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+41:12443:x1874190788556160:12345-192.168.203.4@tcp:35:cat.0 Request processed in 426us (812us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787367946.592044:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:3.0:1787367946.623863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367946.623939:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788556416 00000100:00100000:0.0:1787367946.623949:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788556416 00000100:00100000:0.0:1787367946.624093:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:0.0:1787367946.624105:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+41:12444:x1874190788556416:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:0.0:1787367946.624160:0:9404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787367946.624185:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75e00/0x66f5679bff0314a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9ac expref: 41 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624210:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e000/0x66f5679bff031502 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c1 expref: 40 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624224:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff0314d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9ba expref: 39 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624238:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031492 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9a5 expref: 38 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624248:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:0.0:1787367946.624253:0:9404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367946.624275:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624289:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624299:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624328:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624336:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624530:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624621:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624630:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624636:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367946.624841:0:9404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787367946.624853:0:9404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403912496619ns, next at 404912494051ns, rc = 0 00010000:00010000:0.0:1787367946.624895:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624904:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624912:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624919:0:9404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624940:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.624946:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626081:0:9404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787367946.626109:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626117:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626123:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626129:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367946.626133:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626141:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626153:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:0.0:1787367946.626156:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787367946.626160:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626165:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff03151e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626184:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626203:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626209:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626214:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367946.626217:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626223:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626231:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367946.626233:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367946.626236:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626241:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031510 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367946.626251:0:9404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de29b7f4 reply state 00000000c06b4507 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626261:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.626267:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2900) 00010000:00010000:0.0:1787367946.626269:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787367946.626272:0:9404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367946.626494:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+39:12444:x1874190788556416:12345-192.168.203.4@tcp:36:rm.0 Request processed in 2388us (2635us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787367946.626509:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 214 00010000:00010000:3.0:1787367946.627915:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367946.627978:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.627989:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787367946.627993:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.628003:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.628019:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:3.0:1787367946.628022:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787367946.628027:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.628034:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031525 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.631043:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367946.631051:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367946.631054:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367946.712247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367946.712392:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788556672 00000100:00100000:2.0:1787367946.712402:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788556672 00000100:00100000:2.0:1787367946.712467:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:2.0:1787367946.712477:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+39:12450:x1874190788556672:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787367946.712503:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367946.712524:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03152c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9c8 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.714774:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.714798:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.714810:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.714821:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.714828:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.714835:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367946.717203:0:6540:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787367946.717376:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717392:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717402:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717452:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717459:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717466:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717472:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241de00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367946.717476:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717483:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717495:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:3.0:1787367946.717498:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367946.717503:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717509:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff031533 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367946.717522:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067266000 reply state 00000000d3f10805 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717534:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717562:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2900) 00010000:00010000:3.0:1787367946.717571:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787367946.717575:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787367946.717609:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c800/0x66f5679bff03152c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c8 expref: 42 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717624:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c8 expref: 41 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.717632:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c5483331300) 00010000:00010000:3.0:1787367946.717634:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367946.717636:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75800, rc 0) 00000100:00100000:3.0:1787367946.717715:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+42:12450:x1874190788556672:12345-192.168.203.4@tcp:101:bash.0 Request processed in 5239us (5476us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787367946.717739:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:1.0:1787367946.722910:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367946.722982:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788556800 00000100:00100000:3.0:1787367946.722991:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788556800 00000100:00100000:3.0:1787367946.723054:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:3.0:1787367946.723064:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788556800:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787367946.723080:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367946.723098:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9cf expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787367946.723121:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787367946.723138:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1787367946.723142:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367946.723151:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9cf expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.723187:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9cf expref: 8 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.723199:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74400, rc 0) 00000100:00100000:3.0:1787367946.723258:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2405:x1874190788556800:12345-192.168.203.4@tcp:101:bash.0 Request processed in 195us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367946.723265:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00080000:1.0:1787367946.723620:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367946.728930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367946.729016:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788556928 00000100:00100000:3.0:1787367946.729026:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788556928 00000100:00100000:3.0:1787367946.729075:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1787367946.729085:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+8:12450:x1874190788556928:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787367946.729104:0:8925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367946.729122:0:8925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9d6 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.729152:0:8925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9cf expref: 9 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.729158:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367946.729161:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367946.729165:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 9 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.729189:0:8925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9cf expref: 9 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.729214:0:8925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9cf expref: 9 pid: 8451 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367946.729224:0:8925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8925:1874190808535936:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367946.729303:0:8925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367946.735247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367946.736485:0:8925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8925:1874190808535936:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367946.736520:0:8925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 9 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.736540:0:8925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75a00, rc 0) 00000100:00100000:0.0:1787367946.736790:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+9:12450:x1874190788556928:12345-192.168.203.4@tcp:101:bash.0 Request processed in 7705us (7868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367946.736800:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:2.0:1787367946.737019:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788557056 00000100:00100000:2.0:1787367946.737038:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788557056 00010000:00010000:2.0:1787367946.737070:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9cf expref: 9 pid: 8451 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367946.737108:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:2.0:1787367946.737118:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5598cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+9:2402:x1874190788557056:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367946.737132:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367946.737151:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9cf expref: 9 pid: 8451 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.737164:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9cf expref: 9 pid: 8451 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.737186:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006664ca40/0x66f5679bff03154f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9cf expref: 9 pid: 8451 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.737200:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367946.737204:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367946.737212:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.737223:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.737254:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367946.737279:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483790700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6524:1874190808536064:192.168.203.4@tcp:105: 00000100:00100000:2.0:1787367946.737333:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1787367946.742664:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483790700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6524:1874190808536064:192.168.203.4@tcp:105: 00010000:00010000:3.0:1787367946.742692:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367946.742745:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5598cc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2402:x1874190788557056:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 5627us (7506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367946.742765:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:3.0:1787367946.743969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.744558:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788557312 00000100:00100000:1.0:1787367946.744567:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788557312 00000100:00100000:1.0:1787367946.744643:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1787367946.744655:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+42:12450:x1874190788557312:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1787367946.744963:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+43:12450:x1874190788557312:12345-192.168.203.4@tcp:35:bash.0 Request processed in 309us (996us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787367946.744970:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:2.0:1787367946.861911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.862021:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788557440 00000100:00100000:1.0:1787367946.862032:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788557440 00000100:00100000:1.0:1787367946.862097:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:1.0:1787367946.862108:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+43:12466:x1874190788557440:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367946.862132:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367946.862151:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03155d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9dd expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.862233:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031564 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.862247:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.862258:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367946.862295:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787367946.862299:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367946.862317:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.862341:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03155d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9dd expref: 45 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.862389:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031564 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9dd expref: 44 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.862397:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:1.0:1787367946.862400:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367946.862415:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fa00, rc 0) 00000100:00100000:1.0:1787367946.862478:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+44:12466:x1874190788557440:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 372us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367946.862486:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:3.0:1787367946.870871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.871068:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788557696 00000100:00100000:1.0:1787367946.871077:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788557696 00000100:00100000:1.0:1787367946.871146:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:1.0:1787367946.871155:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+44:12466:x1874190788557696:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367946.871175:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367946.871194:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03156b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9e4 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.871305:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031572 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.871321:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.871332:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367946.871342:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787367946.872215:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03156b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9e4 expref: 47 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.872235:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9e4 expref: 46 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.872244:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c5483331300) 00010000:00010000:1.0:1787367946.872247:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367946.872250:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67ec00, rc 0) 00000100:00100000:1.0:1787367946.872417:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+46:12466:x1874190788557696:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1262us (1554us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1787367946.872426:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:3.0:1787367946.891082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367946.891129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.891915:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788557952 00000100:00100000:1.0:1787367946.891938:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788557952 00000100:00100000:1.0:1787367946.892003:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:1.0:1787367946.892012:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+46:12466:x1874190788557952:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367946.892034:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367946.892052:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031580 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9eb expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.892143:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031587 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.892157:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031587 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.892168:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031587 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367946.892179:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787367946.892272:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031580 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9eb expref: 49 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.892291:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031587 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9eb expref: 48 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.892299:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c5483331300) 00010000:00010000:1.0:1787367946.892302:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787367946.892305:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e400, rc 0) 00000100:00100000:2.0:1787367946.892718:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788558080 00000100:00100000:2.0:1787367946.892724:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788558080 00000100:00100000:2.0:1787367946.892783:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1787367946.892791:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+49:2403:x1874190788558080:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367946.892802:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367946.892818:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031572 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9e4 expref: 49 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.892831:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c5483331300) 00010000:00010000:2.0:1787367946.892835:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367946.892858:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+48:2403:x1874190788558080:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 67us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367946.892865:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1787367946.893238:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+47:12466:x1874190788557952:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1225us (2162us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1787367946.893247:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:2.0:1787367946.908336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367946.910429:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788558208 00000100:00100000:3.0:1787367946.910444:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788558208 00000100:00100000:3.0:1787367946.910508:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:3.0:1787367946.910518:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2403:x1874190788558208:12345-192.168.203.4@tcp:1:lfs.0 00010000:00010000:3.0:1787367946.911645:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.911665:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.911687:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367946.911690:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367946.911693:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.911723:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 8 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367946.911735:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 8 pid: 8925 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367946.911746:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483646a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8451:1874190808536192:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367946.911862:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd6cf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367946.920810:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483646a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8451:1874190808536192:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367946.920844:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367946.921431:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367946.921797:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788558336 00000100:00100000:3.0:1787367946.921808:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788558336 00002000:00100000:2.0:1787367946.921932:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c55afa76d80 x1874190788558336/t0(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:587/0 lens 504/0 e 0 to 0 dl 1787367957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367946.921960:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c55afa76d80 with x1874190788558336 ext(0->8) 00010000:00010000:2.0:1787367946.922066:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 9 pid: 8925 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.922082:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 9 pid: 8925 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367946.922089:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c55afa76d80 00000100:00100000:2.0:1787367946.922171:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1787367946.922180:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+9:2403:x1874190788558336:12345-192.168.203.4@tcp:4:lfs.0 00000100:00100000:2.0:1787367946.923268:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+11:2403:x1874190788558336:12345-192.168.203.4@tcp:4:lfs.0 Request processed in 1084us (1834us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787367946.923278:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00002000:00100000:2.0:1787367946.923288:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c55afa76d80 x1874190788558336/t4294967309(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:587/0 lens 504/448 e 0 to 0 dl 1787367957 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367946.923296:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c55afa76d80 with x1874190788558336 ext(0->8) 00010000:00010000:2.0:1787367946.923303:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 11 pid: 8925 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.923318:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 11 pid: 8925 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367946.923325:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c55afa76d80 00000100:00100000:3.0:1787367946.925744:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.925849:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788558464 00000100:00100000:1.0:1787367946.925858:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788558464 00010000:00010000:1.0:1787367946.925895:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 11 pid: 8925 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367946.925946:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:1.0:1787367946.925955:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+11:2404:x1874190788558464:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367946.925977:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787367946.925992:0:6523:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787367946.925995:0:6523:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787367947 00002000:00010000:1.0:1787367946.925997:0:6523:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787367947 00002000:00010000:1.0:1787367946.926000:0:6523:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787367947 00002000:00010000:1.0:1787367946.926002:0:6523:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787367946.926007:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 11 pid: 8925 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.926020:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 11 pid: 8925 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.926042:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a563ada0/0x66f5679bff031556 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9d6 expref: 11 pid: 8925 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.926059:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367946.926063:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367946.926069:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.926095:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.926127:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367946.926259:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+10:2404:x1874190788558464:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 304us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367946.926268:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00010000:00010000:2.0:1787367946.926891:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.926909:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.926929:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.926936:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.926943:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.926948:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787367946.926952:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.926960:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.926982:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.926989:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002efd15c5/0x66f5679bff031595 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367946.927049:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+9:2403:x1874190788558208:12345-192.168.203.4@tcp:1:lfs.0 Request processed in 16533us (18724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367946.927057:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:0.0:1787367946.940132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.940199:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788558720 00000100:00100000:1.0:1787367946.940209:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788558720 00000100:00100000:1.0:1787367946.940328:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:1.0:1787367946.940339:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+47:12466:x1874190788558720:12345-192.168.203.4@tcp:35:lfs.0 00000004:00010000:1.0:1787367946.940435:0:6541:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031587 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9eb expref: 47 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367946.940641:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1787367946.940670:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787367946.940991:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1787367946.941024:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.941040:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c8 expref: 51 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.941048:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.941077:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c8 expref: 51 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.941109:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c8 expref: 51 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367946.941124:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6541:1874190808536320:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367946.941202:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624480 going to sleep for 11 seconds 00000100:00100000:0.0:1787367946.943893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367946.944061:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788558848 00000100:00100000:1.0:1787367946.944592:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6541:1874190808536320:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367946.944704:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788558848 00010000:00010000:2.0:1787367946.944743:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c8 expref: 52 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367946.944784:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:2.0:1787367946.944794:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+52:2402:x1874190788558848:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367946.944811:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367946.944818:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c8 expref: 52 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.944830:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c8 expref: 52 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.944850:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75800/0x66f5679bff031541 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9c8 expref: 52 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.944865:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c5483331300) 00010000:00010000:2.0:1787367946.944871:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.944879:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.944903:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367946.944920:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367946.945036:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+51:2402:x1874190788558848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 243us (1149us total) trans 0 rc 0/0 00010000:00010000:1.0:1787367946.945728:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.945742:0:6541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.945759:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367946.945862:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1787367946.945968:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1787367946.946062:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6541:1874190808536448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787367946.946117:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367946.946151:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54826240c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367946.946197:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808536448 00000100:00100000:1.0:1787367946.946203:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808536448 00000100:00100000:1.0:1787367946.946236:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787367946.946245:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6541:x1874190808536448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787367946.946322:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6541:x1874190808536448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367946.946338:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787367946.946419:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6541:1874190808536448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787367946.946515:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1787367946.946550:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6541:1874190808536576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787367946.946581:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367946.946606:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808536576 00000100:00100000:1.0:1787367946.946624:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808536576 00000100:00100000:1.0:1787367946.946648:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787367946.946655:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6541:x1874190808536576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787367946.946740:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6541:x1874190808536576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (158us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787367946.946747:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787367946.946776:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624300 going to sleep for 11 seconds 00000100:00100000:1.0:1787367946.946792:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6541:1874190808536576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787367946.946824:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1787367946.946851:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.946860:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.946866:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.946872:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367946.946876:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.946894:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.946909:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c5483331300) 00010000:00010000:1.0:1787367946.946912:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787367946.946916:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367946.946922:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03159c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787367946.947001:0:6541:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787367946.947060:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787367946.947072:0:6541:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404234715573ns, next at 405234713418ns, rc = 0 00000001:00080000:1.0:1787367946.947078:0:6541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1787367946.947101:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c5483331300) 00010000:00010000:1.0:1787367946.947104:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787367946.947110:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff031587 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9eb expref: 56 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367946.947180:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+55:12466:x1874190788558720:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 6843us (7058us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787367946.947188:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000020:00080000:1.0:1787367946.947192:0:6541:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787367946.947318:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:3.0:1787367946.954057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367946.954165:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788558976 00000100:00100000:0.0:1787367946.954174:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788558976 00000100:00100000:0.0:1787367946.954233:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:0.0:1787367946.954243:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+54:12466:x1874190788558976:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367946.954267:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367946.954289:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff0315a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9f2 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.954345:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff0315a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f2 expref: 55 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.954399:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff0315a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f2 expref: 55 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.954448:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367946.954452:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367946.954456:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613aa00, rc 0) 00000100:00100000:0.0:1787367946.954511:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+55:12466:x1874190788558976:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 270us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367946.954518:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:2.0:1787367946.957221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367946.957584:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788559232 00000100:00100000:1.0:1787367946.957593:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788559232 00000100:00100000:1.0:1787367946.957783:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:1.0:1787367946.957793:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+55:12466:x1874190788559232:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1787367946.958043:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+56:12466:x1874190788559232:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 252us (828us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787367946.958052:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1787367946.999089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367946.999205:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788559360 00000100:00100000:0.0:1787367946.999214:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788559360 00000100:00100000:0.0:1787367946.999263:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:0.0:1787367946.999269:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+56:12476:x1874190788559360:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1787367946.999329:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999342:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999351:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999381:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999387:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999391:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999452:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999469:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999473:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367946.999518:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999527:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999531:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999535:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999539:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367946.999542:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999546:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999553:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367946.999555:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367946.999558:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999562:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999576:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999591:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999597:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999602:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367946.999605:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999611:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999620:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2900) 00010000:00010000:0.0:1787367946.999622:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367946.999625:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999630:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999639:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999644:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999649:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999660:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367946.999663:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999669:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999678:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367946.999680:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367946.999682:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367946.999686:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367946.999743:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+56:12476:x1874190788559360:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 473us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367946.999765:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:3.0:1787367947.021763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.021870:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788559616 00000100:00100000:0.0:1787367947.021880:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788559616 00000100:00100000:0.0:1787367947.022026:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:0.0:1787367947.022038:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+56:12479:x1874190788559616:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367947.022060:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367947.022082:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2e9f9 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022155:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022188:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022200:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022213:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022220:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022227:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022329:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022338:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022346:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367947.022615:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787367947.022694:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022703:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022709:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022722:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.022726:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022733:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022746:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367947.022760:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367947.022764:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022771:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022785:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022791:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022796:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022802:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.022804:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022810:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022841:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2900) 00010000:00010000:0.0:1787367947.022843:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367947.022847:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022852:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.022888:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f9 expref: 59 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.023034:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f9 expref: 58 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.023042:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367947.023045:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367947.023047:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a800, rc 0) 00000100:00100000:0.0:1787367947.023105:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+58:12479:x1874190788559616:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1070us (1362us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787367947.023113:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00080000:1.0:1787367947.023476:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367947.025219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.025288:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788559744 00000100:00100000:1.0:1787367947.025295:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788559744 00000100:00100000:1.0:1787367947.025340:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:1.0:1787367947.025350:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+58:12479:x1874190788559744:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:1.0:1787367947.025484:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.025496:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.025503:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.025530:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.025534:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.025539:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.025542:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367947.025545:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.025563:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.025571:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:1.0:1787367947.025573:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367947.025577:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.025583:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff0315e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367947.025645:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+58:12479:x1874190788559744:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 296us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.025652:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:2.0:1787367947.026772:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.026814:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788560000 00000100:00100000:1.0:1787367947.026821:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788560000 00000100:00100000:1.0:1787367947.026856:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:1.0:1787367947.026865:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+58:12479:x1874190788560000:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1787367947.027026:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+59:12479:x1874190788560000:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 162us (255us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1787367947.027034:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:3.0:1787367947.084915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.085027:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788560256 00000100:00100000:0.0:1787367947.085038:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788560256 00000100:00100000:0.0:1787367947.085196:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:0.0:1787367947.085207:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+59:12489:x1874190788560256:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367947.085232:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367947.085235:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787367947.085262:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031564 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9dd expref: 59 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.085297:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367947.085302:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367947.085315:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea00 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.085463:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.085476:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f9 expref: 59 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.085484:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.085516:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f9 expref: 59 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.085529:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f9 expref: 59 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367947.085541:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808536704:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367947.085637:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1787367947.088211:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808536704:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367947.088244:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367947.089035:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367947.089090:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788560384 00000100:00100000:2.0:1787367947.089097:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788560384 00010000:00010000:2.0:1787367947.089132:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f9 expref: 60 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367947.089448:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:2.0:1787367947.089459:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+60:2403:x1874190788560384:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367947.089474:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367947.089481:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f9 expref: 60 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.089494:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f9 expref: 60 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.089515:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff0315d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f9 expref: 60 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.089550:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:2.0:1787367947.089555:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.089564:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.089571:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.089655:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367947.089709:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+59:2403:x1874190788560384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 252us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367947.089717:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00010000:00010000:0.0:1787367947.089797:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.089822:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367947.089840:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787367947.089958:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff0315e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea00 expref: 60 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.089974:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea00 expref: 59 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.089981:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367947.089984:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787367947.089986:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b800, rc 0) 00000100:00100000:0.0:1787367947.090031:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+59:12489:x1874190788560256:12345-192.168.203.4@tcp:101:bash.0 Request processed in 4827us (5127us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787367947.090039:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:3.0:1787367947.092555:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.092864:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788560512 00000100:00100000:0.0:1787367947.092874:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788560512 00000100:00100000:0.0:1787367947.092922:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:0.0:1787367947.092933:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+59:12489:x1874190788560512:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367947.092956:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367947.092977:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea07 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.093014:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.093048:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.093060:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.093168:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0315fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea07 expref: 61 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.093188:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea07 expref: 60 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.093197:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367947.093200:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787367947.093203:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b200, rc 0) 00000100:00100000:0.0:1787367947.093269:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+60:12489:x1874190788560512:12345-192.168.203.4@tcp:101:bash.0 Request processed in 337us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.093276:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:3.0:1787367947.097350:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.097432:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788560768 00000100:00100000:1.0:1787367947.097441:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788560768 00000100:00100000:1.0:1787367947.097679:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:1.0:1787367947.097690:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+60:12489:x1874190788560768:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:1.0:1787367947.097915:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.097947:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.097959:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367947.097999:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1787367947.098020:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b159f563 reply state 000000008b3b76b3 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.098032:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.098040:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:1.0:1787367947.098043:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787367947.098046:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367947.098126:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+63:12489:x1874190788560768:12345-192.168.203.4@tcp:36:bash.0 Request processed in 437us (784us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787367947.098134:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 225 00000020:00080000:1.0:1787367947.098140:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787367947.099503:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.099540:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788560896 00000100:00100000:0.0:1787367947.099547:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788560896 00000100:00100000:0.0:1787367947.099597:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:0.0:1787367947.099611:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+63:12489:x1874190788560896:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787367947.099631:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367947.099646:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031613 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea0e expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.099707:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.099727:0:9404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea00 expref: 64 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.099733:0:9404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.100315:0:9404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea00 expref: 64 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.100329:0:9404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea00 expref: 64 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367947.100341:0:9404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808536832:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367947.100586:0:9404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1787367947.103219:0:9404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808536832:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367947.103248:0:9404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367947.104057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367947.106418:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788561024 00000100:00100000:2.0:1787367947.106432:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788561024 00010000:00010000:2.0:1787367947.106478:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea00 expref: 65 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367947.106521:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:2.0:1787367947.106530:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+65:2403:x1874190788561024:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367947.106545:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367947.106551:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea00 expref: 65 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.106565:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea00 expref: 65 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.106605:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff0315f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea00 expref: 65 pid: 6540 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.106621:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:2.0:1787367947.106625:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.106634:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.107536:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.107571:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367947.107622:0:9404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.107631:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367947.107731:0:9404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:2.0:1787367947.107733:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+64:2403:x1874190788561024:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1202us (3677us total) trans 0 rc 0/0 00000004:00200000:0.0:1787367947.107735:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1787367947.107742:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000004:00010000:0.0:1787367947.107765:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.107810:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031613 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea0e expref: 64 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.107825:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea0e expref: 63 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.107832:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367947.107835:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367947.107837:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b400, rc 0) 00000100:00100000:0.0:1787367947.107863:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+63:12489:x1874190788560896:12345-192.168.203.4@tcp:101:bash.0 Request processed in 8258us (8363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.107870:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:3.0:1787367947.111328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367947.111453:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788561280 00000100:00100000:2.0:1787367947.111462:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788561280 00000100:00100000:2.0:1787367947.111514:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:2.0:1787367947.111521:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+63:12489:x1874190788561280:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:2.0:1787367947.111800:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+64:12489:x1874190788561280:12345-192.168.203.4@tcp:35:bash.0 Request processed in 277us (478us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787367947.111808:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1787367947.154246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.154481:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788561408 00000100:00100000:0.0:1787367947.154489:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788561408 00000100:00100000:0.0:1787367947.154547:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:0.0:1787367947.154557:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bb645c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+64:12495:x1874190788561408:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367947.154578:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367947.154597:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea15 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.154656:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031628 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.154670:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.154680:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367947.154741:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787367947.154745:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367947.154773:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.154799:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea15 expref: 66 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.154817:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea15 expref: 65 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.154825:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367947.154828:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367947.154831:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a200, rc 0) 00000100:00100000:0.0:1787367947.155027:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bb645c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+65:12495:x1874190788561408:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 472us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.155033:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:3.0:1787367947.159219:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.159285:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788561536 00000100:00100000:1.0:1787367947.159295:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788561536 00000100:00100000:1.0:1787367947.159761:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:1.0:1787367947.159776:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+65:12495:x1874190788561536:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787367947.159802:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367947.159821:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03162f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea1c expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.159882:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.159908:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.160291:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.160309:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.160317:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.160323:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367947.160563:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367947.160583:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808536960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787367947.160647:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367947.160736:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808536960 00000100:00100000:0.0:1787367947.160743:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808536960 00000100:00100000:0.0:1787367947.160806:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787367947.160816:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808536960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787367947.160839:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787367947.160883:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808536960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.160890:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787367947.160996:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808536960:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787367947.161157:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031644 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161169:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161178:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367947.161221:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787367947.161225:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367947.161243:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161256:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161283:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161291:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161299:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161306:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367947.161311:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161318:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161330:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:1.0:1787367947.161333:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367947.161337:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161343:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f400/0x66f5679bff031636 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161376:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161382:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161387:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161398:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367947.161401:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161408:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161416:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2900) 00010000:00010000:1.0:1787367947.161418:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367947.161421:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161425:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03163d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161456:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff03162f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea1c expref: 67 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161469:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031644 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea1c expref: 66 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.161477:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:1.0:1787367947.161479:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367947.161482:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fa00, rc 0) 00000100:00100000:1.0:1787367947.161532:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+66:12495:x1874190788561536:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1761us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.161539:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:3.0:1787367947.166593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367947.166653:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367947.167008:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788561920 00000100:00100000:2.0:1787367947.167019:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788561920 00000100:00100000:2.0:1787367947.167081:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:2.0:1787367947.167106:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+66:12495:x1874190788561920:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787367947.167129:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367947.167147:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03164b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea23 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367947.167301:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788561664 00000100:00100000:1.0:1787367947.167313:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788561664 00000100:00100000:1.0:1787367947.167380:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1787367947.167388:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+68:2402:x1874190788561664:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367947.167400:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367947.167422:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031644 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea1c expref: 68 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.167438:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:1.0:1787367947.167443:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367947.167495:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+67:2402:x1874190788561664:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 108us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.167502:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00010000:00010000:2.0:1787367947.168229:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.168246:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea0e expref: 66 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.168254:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.168288:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea0e expref: 66 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.168302:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea0e expref: 66 pid: 9404 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367947.168315:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808537088:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367947.168398:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367947.173213:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808537088:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367947.173244:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367947.174015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.174214:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788562048 00000100:00100000:0.0:1787367947.174222:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788562048 00010000:00010000:0.0:1787367947.174321:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea0e expref: 67 pid: 9404 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367947.174445:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:0.0:1787367947.174455:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5598cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+67:2403:x1874190788562048:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367947.174471:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367947.174478:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea0e expref: 67 pid: 9404 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.174490:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea0e expref: 67 pid: 9404 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.174511:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff03161a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea0e expref: 67 pid: 9404 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.174525:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367947.174530:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.174539:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.174547:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.174604:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.174614:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367947.174634:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787367947.174691:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367947.174760:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5598cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+67:2403:x1874190788562048:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 305us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.174767:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00010000:00010000:1.0:1787367947.175350:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03164b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea23 expref: 67 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.175401:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea23 expref: 66 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.175410:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:1.0:1787367947.175413:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787367947.175417:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241d600, rc 0) 00000100:00100000:1.0:1787367947.175460:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+66:12495:x1874190788561920:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 8356us (8814us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787367947.175548:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:3.0:1787367947.177700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.177970:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788562304 00000100:00100000:1.0:1787367947.177980:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788562304 00000100:00100000:1.0:1787367947.178048:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1787367947.178058:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+66:12495:x1874190788562304:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:1.0:1787367947.178072:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367947.178094:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613aa00/0x66f5679bff0315a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9f2 expref: 66 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.178113:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:1.0:1787367947.178117:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367947.178589:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+65:12495:x1874190788562304:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 530us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.178597:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1787367947.181125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.181337:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788562432 00000100:00100000:0.0:1787367947.181346:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788562432 00000100:00100000:0.0:1787367947.181522:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:0.0:1787367947.181530:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+65:12495:x1874190788562432:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:0.0:1787367947.181622:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.181638:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.181647:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367947.181721:0:9404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787367947.181795:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+65:12495:x1874190788562432:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 266us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.181800:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:2.0:1787367947.183209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.183277:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788562560 00000100:00100000:0.0:1787367947.183287:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788562560 00000100:00100000:0.0:1787367947.183341:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:0.0:1787367947.183350:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+65:12495:x1874190788562560:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787367947.183385:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367947.183403:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea2a expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.183451:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.183462:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea2a expref: 66 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.183503:0:6540:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.183518:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea2a expref: 66 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.183530:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367947.183533:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367947.183537:0:6540:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea2a expref: 66 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.183545:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b600, rc 0) 00000100:00100000:0.0:1787367947.184066:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+66:12495:x1874190788562560:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 716us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.184075:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 231 00000040:00080000:2.0:1787367947.608587:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367947.608610:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367947.608649:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787367947.608659:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787367947.608804:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808537216:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367947.608919:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed540 going to sleep for 11 seconds 00010000:00010000:0.0:1787367947.610723:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367947.618799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367947.619103:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788562688 00000100:00100000:3.0:1787367947.619113:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788562688 00000100:00100000:3.0:1787367947.619166:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:3.0:1787367947.619176:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+67:12496:x1874190788562688:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787367947.619206:0:6538:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787367947.619313:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+67:12496:x1874190788562688:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 138us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367947.619321:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:1.0:1787367947.619874:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808537216:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787367947.626451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.626789:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788562816 00000100:00100000:1.0:1787367947.626803:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788562816 00000100:00100000:1.0:1787367947.626971:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 233 00000100:00100000:1.0:1787367947.626984:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+66:12496:x1874190788562816:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787367947.627092:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627114:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627128:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627165:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627173:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627179:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627205:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627213:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627219:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367947.627277:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787367947.627282:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367947.627297:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627308:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627315:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627322:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627340:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367947.627345:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627384:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627400:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:1.0:1787367947.627403:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367947.627409:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627415:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03166e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627431:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627438:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627444:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627449:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367947.627452:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627457:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627477:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9c5590ea9000) 00010000:00010000:1.0:1787367947.627480:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367947.627483:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627489:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031675 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627508:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627514:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627520:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627524:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367947.627527:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627531:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627537:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:1.0:1787367947.627539:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367947.627542:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.627547:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff03167c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367947.627648:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+66:12496:x1874190788562816:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 666us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.627662:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 233 00000100:00100000:2.0:1787367947.643576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367947.643739:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788563072 00000100:00100000:3.0:1787367947.643760:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788563072 00000100:00100000:3.0:1787367947.643816:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:3.0:1787367947.643827:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+66:12496:x1874190788563072:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367947.643849:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367947.643869:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff031683 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea31 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644014:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644030:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644041:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367947.644051:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787367947.644822:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644832:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644838:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644844:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367947.644848:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644854:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644868:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:3.0:1787367947.644871:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787367947.644876:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644896:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03168a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644941:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff031683 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea31 expref: 68 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.644952:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:3.0:1787367947.644954:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787367947.645023:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff031683 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea31 expref: 68 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.645034:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75400, rc 0) 00000100:00100000:3.0:1787367947.645159:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+67:12496:x1874190788563072:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1333us (1592us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1787367947.645168:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:1.0:1787367947.649318:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.650009:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788563200 00000100:00100000:0.0:1787367947.650033:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788563200 00000100:00100000:0.0:1787367947.650108:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:0.0:1787367947.650121:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+67:12496:x1874190788563200:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787367947.650167:0:6540:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787367947.650309:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+67:12496:x1874190788563200:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 190us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.650318:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:0.0:1787367947.664426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367947.664542:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788563456 00000100:00100000:3.0:1787367947.664556:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788563456 00000100:00100000:3.0:1787367947.664616:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 236 00000100:00100000:3.0:1787367947.664627:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+67:12496:x1874190788563456:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367947.664648:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367947.664651:0:9404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787367947.664676:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea15 expref: 67 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.664696:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:3.0:1787367947.664701:0:9404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367947.664731:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff031698 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea38 expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367947.665103:0:9404:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:3.0:1787367947.665235:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03169f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.665249:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03169f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.665260:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03169f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.665306:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff031698 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea38 expref: 69 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.665320:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03169f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea38 expref: 68 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.665329:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331300) 00010000:00010000:3.0:1787367947.665331:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367947.665333:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74600, rc 0) 00000100:00100000:3.0:1787367947.665627:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+68:12496:x1874190788563456:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1001us (1214us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787367947.665635:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 236 00000100:00100000:2.0:1787367947.686459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.686565:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788563712 00000100:00100000:0.0:1787367947.686587:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788563712 00000100:00100000:0.0:1787367947.686647:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 237 00000100:00100000:0.0:1787367947.686656:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+68:12496:x1874190788563712:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787367947.686710:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367947.686737:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03169f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea38 expref: 68 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686768:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331300) 00010000:00010000:0.0:1787367947.686778:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367947.686800:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686824:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686834:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686848:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686856:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686862:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686904:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686911:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686924:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686930:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.686934:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686941:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686949:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:0.0:1787367947.686952:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367947.686966:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686973:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff0316ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686983:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686990:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.686995:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.687000:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.687003:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.687017:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.687025:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xbf0fcd52 (ffff9c54824f2100) 00010000:00010000:0.0:1787367947.687027:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367947.687030:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.687036:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316b4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbf0fcd52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367947.687225:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+67:12496:x1874190788563712:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 569us (773us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787367947.687233:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 237 00000100:00100000:1.0:1787367947.689209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367947.690432:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788563840 00000100:00100000:3.0:1787367947.690441:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788563840 00000100:00100000:3.0:1787367947.690497:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:3.0:1787367947.690506:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+67:12496:x1874190788563840:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367947.690536:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367947.690557:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea3f expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.690591:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.690603:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.690614:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.690712:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea3f expref: 69 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.690728:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea3f expref: 68 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.690735:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:3.0:1787367947.690738:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787367947.690740:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75c00, rc 0) 00000100:00100000:3.0:1787367947.690797:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+68:12496:x1874190788563840:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 292us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367947.690804:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:3.0:1787367947.696924:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.697056:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788564096 00000100:00100000:0.0:1787367947.697065:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788564096 00000100:00100000:0.0:1787367947.697136:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00100000:0.0:1787367947.697147:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+68:12496:x1874190788564096:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787367947.697223:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.697241:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.697252:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367947.697437:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1787367947.697446:0:6540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404985090376ns, next at 405985087811ns, rc = 0 00000004:00010000:0.0:1787367947.697508:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5379081 reply state 000000004518cb0f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.697522:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.697530:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:0.0:1787367947.697532:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787367947.697536:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367947.697621:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+70:12496:x1874190788564096:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 475us (705us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787367947.697629:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00100000:2.0:1787367947.703606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367947.703695:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788564224 00000100:00100000:3.0:1787367947.703704:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788564224 00000100:00100000:3.0:1787367947.703771:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:3.0:1787367947.703796:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+70:12496:x1874190788564224:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367947.703829:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367947.703849:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea46 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.703913:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea46 expref: 71 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.703928:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea46 expref: 71 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.703946:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:3.0:1787367947.703950:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367947.703954:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75400, rc 0) 00000100:00100000:2.0:1787367947.713212:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+71:12496:x1874190788564224:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 9408us (9604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367947.713226:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:2.0:1787367947.717431:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.717572:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788564352 00000100:00100000:0.0:1787367947.717582:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788564352 00000100:00100000:0.0:1787367947.717640:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1787367947.717649:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+9:2403:x1874190788564352:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787367947.717854:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+10:2403:x1874190788564352:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 204us (431us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787367947.717862:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:3.0:1787367947.738798:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.739002:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788564608 00000100:00100000:1.0:1787367947.739013:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788564608 00000100:00100000:1.0:1787367947.739070:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:1.0:1787367947.739089:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+71:12496:x1874190788564608:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787367947.739304:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+72:12496:x1874190788564608:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 217us (524us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1787367947.739312:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1787367947.752975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.753283:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788564864 00000100:00100000:1.0:1787367947.753292:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788564864 00000100:00100000:1.0:1787367947.753385:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:1.0:1787367947.753396:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+72:12496:x1874190788564864:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787367947.753501:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+72:12496:x1874190788564864:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 107us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.753509:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:3.0:1787367947.762060:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.766399:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788564992 00000100:00100000:0.0:1787367947.766414:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788564992 00000100:00100000:1.0:1787367947.766562:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:1.0:1787367947.766573:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+72:12496:x1874190788564992:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367947.766594:0:9404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367947.766612:0:9404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0316d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea4d expref: -99 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.766707:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0316de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.766723:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0316de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.766735:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0316de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367947.766793:0:9404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787367947.766819:0:9404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0316de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.766843:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff0316d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea4d expref: 74 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.766862:0:9404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0316de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea4d expref: 73 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.766871:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:1.0:1787367947.766874:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787367947.766878:0:9404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fa00, rc 0) 00000100:00100000:1.0:1787367947.767199:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+73:12496:x1874190788564992:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 627us (5148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.767207:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:3.0:1787367947.771462:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.771590:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788565120 00000100:00100000:1.0:1787367947.771599:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788565120 00000100:00100000:1.0:1787367947.771661:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:1.0:1787367947.771684:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+10:2403:x1874190788565120:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367947.771702:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367947.771722:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea54 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367947.771753:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89120c, blocks: 0x0 00010000:00010000:1.0:1787367947.771771:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1787367947.771776:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367947.771784:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea54 expref: 11 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.771802:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea54 expref: 11 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.771814:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f400, rc 0) 00000100:00100000:1.0:1787367947.771875:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+11:2403:x1874190788565120:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 193us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.771882:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:3.0:1787367947.792739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.795583:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788565376 00000100:00100000:1.0:1787367947.795597:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788565376 00000100:00100000:1.0:1787367947.795804:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:1.0:1787367947.795884:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+73:12496:x1874190788565376:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787367947.796246:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+73:12496:x1874190788565376:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 366us (3514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.796254:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:3.0:1787367947.804549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.806112:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788565504 00000100:00100000:0.0:1787367947.806123:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788565504 00000100:00100000:0.0:1787367947.806188:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:0.0:1787367947.806198:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+11:12496:x1874190788565504:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367947.806214:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367947.806231:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea5b expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.806282:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea54 expref: 12 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.806291:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367947.806295:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367947.806301:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 12 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.806334:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea54 expref: 12 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.806347:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea54 expref: 12 pid: 8453 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367947.806402:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8454:1874190808537344:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787367947.806499:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787367947.809604:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8454:1874190808537344:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367947.809640:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 12 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.809661:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a200, rc 0) 00000100:00100000:0.0:1787367947.809760:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+12:12496:x1874190788565504:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 3562us (5220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.809770:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:2.0:1787367947.821156:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.827343:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788565632 00000100:00100000:1.0:1787367947.827409:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788565632 00010000:00010000:1.0:1787367947.827458:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea54 expref: 12 pid: 8453 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367947.827547:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:1.0:1787367947.827557:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+12:2402:x1874190788565632:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367947.827570:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367947.827589:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea54 expref: 12 pid: 8453 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.827603:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea54 expref: 12 pid: 8453 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.827626:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000603c30ad/0x66f5679bff0316e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea54 expref: 12 pid: 8453 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.827643:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367947.827648:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367947.827656:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 11 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.827666:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 11 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.827702:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 11 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367947.827732:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ded880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874190808537472:192.168.203.4@tcp:105: 00000100:00100000:1.0:1787367947.827840:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624600 going to sleep for 11 seconds 00000100:00100000:2.0:1787367947.842786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.843154:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ded880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874190808537472:192.168.203.4@tcp:105: 00010000:00010000:1.0:1787367947.843175:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367947.843276:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6033427c-dc64-421a-b37f-d4458dbaa527+11:2402:x1874190788565632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 15720us (22128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.843288:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:0.0:1787367947.843382:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788565760 00000100:00100000:0.0:1787367947.843389:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788565760 00002000:00100000:0.0:1787367947.843436:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9c5483da6300 x1874190788565760/t0(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:588/0 lens 504/0 e 0 to 0 dl 1787367958 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787367947.843446:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483da6300 with x1874190788565760 ext(0->12) 00002000:00010000:0.0:1787367947.843451:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483da6300 00000100:00100000:0.0:1787367947.843469:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1787367947.843478:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+11:2403:x1874190788565760:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787367947.850014:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6033427c-dc64-421a-b37f-d4458dbaa527+13:2403:x1874190788565760:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 6526us (7227us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787367947.850030:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00002000:00100000:0.0:1787367947.850044:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9c5483da6300 x1874190788565760/t4294967321(0) o4->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:588/0 lens 504/448 e 0 to 0 dl 1787367958 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787367947.850055:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483da6300 with x1874190788565760 ext(0->12) 00002000:00010000:0.0:1787367947.850061:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483da6300 00000100:00100000:2.0:1787367947.867451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.867526:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788565888 00000100:00100000:1.0:1787367947.867536:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788565888 00000100:00100000:1.0:1787367947.867603:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:1.0:1787367947.867612:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+73:12496:x1874190788565888:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787367947.875727:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1787367947.875755:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00010000:00010000:0.0:1787367947.875857:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.875869:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.875877:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.875883:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.875898:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.875921:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.875936:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:0.0:1787367947.875939:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367947.875953:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.875959:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0313f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.875990:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.875998:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876004:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876010:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.876012:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876018:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876026:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c55867a2300) 00010000:00010000:0.0:1787367947.876029:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367947.876032:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876048:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff031499 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876066:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876084:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876091:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876096:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.876099:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876105:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876113:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2900) 00010000:00010000:0.0:1787367947.876116:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367947.876118:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876124:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a600/0x66f5679bff031517 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876136:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876142:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876154:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876160:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.876162:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876169:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876178:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c54824f2900) 00010000:00010000:0.0:1787367947.876180:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367947.876182:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876189:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c000/0x66f5679bff03153a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876219:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876227:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876233:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876239:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.876242:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876259:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876268:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367947.876271:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367947.876274:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876280:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e400/0x66f5679bff03160c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876293:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876299:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876306:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876312:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367947.876314:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876321:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876328:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:0.0:1787367947.876330:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787367947.876333:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.876348:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff0316c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787367947.877914:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787367947.877949:0:6517:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c54826240c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787367947.877954:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c5590ee2000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c5482624180 00000020:00080000:1.0:1787367947.877957:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c5590ee2100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c55bd6e1800 00000004:00080000:1.0:1787367947.877983:0:6517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1787367947.878128:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808537600:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787367947.878187:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367947.878252:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808537600 00000100:00100000:3.0:1787367947.878259:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808537600 00000100:00100000:3.0:1787367947.878310:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787367947.878319:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3653:x1874190808537600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787367947.878343:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1787367947.878391:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a89120b, atime: 0x6a89120b, ctime: 0x6a89120b, blocks: 0x8 00010000:00010000:3.0:1787367947.878408:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.878422:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=405s v=(0 0) 00010000:00010000:3.0:1787367947.878427:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367947.878433:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.878447:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.878456:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.878464:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.878479:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787367947.878625:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3653:x1874190808537600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 306us (436us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787367947.878633:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787367947.878653:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787367947.878863:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c55bc692a00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1787367947.878870:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808537600:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1787367947.879103:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1787367947.879123:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367947.879130:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.879139:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787367947.879144:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.879153:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.879171:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.879179:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052ff01cd/0x66f5679bff0316f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.879208:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367947.879210:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367947.879212:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787367947.884589:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1787367947.884606:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1787367947.887032:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367947.887053:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808537728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787367947.887118:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367947.887207:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808537728 00000100:00100000:3.0:1787367947.887226:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808537728 00000100:00100000:2.0:1787367947.887315:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808537856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787367947.887342:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367947.889516:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808537856 00000100:00100000:2.0:1787367947.889527:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808537856 00000100:00100000:2.0:1787367947.889561:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787367947.889571:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3653:x1874190808537728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787367947.889601:0:8925:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1787367947.889638:0:8925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.889660:0:8925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9b3 expref: 12 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.889669:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787367947.889674:0:8925:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367947.889679:0:8925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.889712:0:8925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9b3 expref: 12 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.889728:0:8925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9b3 expref: 12 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367947.889741:0:8925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8925:1874190808537984:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367947.889902:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787367947.889913:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1874190808537856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787367947.890028:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787367947.890033:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787367948 00002000:00010000:3.0:1787367947.890035:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787367947.890037:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787367948 -> 1787367948 00002000:00010000:3.0:1787367947.890040:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:1.0:1787367947.890149:0:6517:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c559803bb40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787367947.890154:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c5590ee2d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c559803b300 00000020:00080000:1.0:1787367947.890157:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c5590ee2800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c5584c0c800 00000100:00100000:2.0:1787367947.893981:0:8925:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787367947.894102:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1787367947.894124:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787367947.894187:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787367947.907349:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3651:x1874190808537856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 17431us (19997us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787367947.907378:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:3.0:1787367947.907449:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c5483da5f80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787367947.907457:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808537856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787367947.907515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367947.907629:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+21:12496:x1874190788565888:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 40016us (40184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367947.907639:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:2.0:1787367947.907904:0:8925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8925:1874190808537984:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367947.907919:0:8925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367947.908145:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788566016 00000100:00100000:3.0:1787367947.908152:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788566016 00010000:00010000:3.0:1787367947.908185:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9b3 expref: 13 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367947.908213:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:3.0:1787367947.908222:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+13:2403:x1874190788566016:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367947.908236:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367947.908241:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9b3 expref: 13 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.908255:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9b3 expref: 13 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.908290:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb1b33c5/0x66f5679bff0314a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e9b3 expref: 13 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.908306:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367947.908311:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367947.908316:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.908325:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.908350:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367947.908379:0:8925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.908390:0:8925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.908400:0:8925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.908408:0:8925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.908429:0:8925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367947.908628:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367947.908636:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.908652:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241dc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787367947.908656:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.908664:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.908677:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.908685:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c182aceb/0x66f5679bff0316fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.908704:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367947.908705:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367947.908707:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367947.908846:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3653:x1874190808537728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19276us (21726us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787367947.908855:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1787367947.908924:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c5483da7480/2, rc 0, transno 4294967323 00000100:00100000:0.0:1787367947.908930:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808537728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787367947.916507:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+12:2403:x1874190788566016:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 8273us (8981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367947.916522:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:2.0:1787367947.924515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.924613:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788566144 00000100:00100000:1.0:1787367947.924623:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788566144 00000100:00100000:1.0:1787367947.924682:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1787367947.924693:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+12:2402:x1874190788566144:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787367947.930496:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1787367947.930514:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1787367947.942940:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+7:2402:x1874190788566144:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 18238us (18423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367947.943154:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:3.0:1787367947.948873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.949095:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788566400 00000100:00100000:1.0:1787367947.949104:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788566400 00000100:00100000:1.0:1787367947.949176:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:1.0:1787367947.949186:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+21:12496:x1874190788566400:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787367947.949239:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367947.949264:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0316de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea4d expref: 21 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.949282:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:1.0:1787367947.949286:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367947.949311:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.949324:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.949333:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367947.949450:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015454c7b reply state 00000000b38f8c1d transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.949462:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.949468:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:1.0:1787367947.949471:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787367947.949473:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367947.949565:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+22:12496:x1874190788566400:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 380us (700us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1787367947.949572:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:3.0:1787367947.952230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.952402:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788566528 00000100:00100000:1.0:1787367947.952421:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788566528 00000100:00100000:1.0:1787367947.952465:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1787367947.952474:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788566528:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787367947.952696:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787367947.952700:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787367948 -> 1787367947 00002000:00010000:1.0:1787367947.952702:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787367947 00002000:00010000:1.0:1787367947.952704:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787367948 -> 1787367947 00002000:00010000:1.0:1787367947.952707:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787367947.952759:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2405:x1874190788566528:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 286us (534us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787367947.952767:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1787367947.955448:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367947.955517:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788566784 00000100:00100000:3.0:1787367947.955525:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788566784 00000100:00100000:3.0:1787367947.958161:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:3.0:1787367947.958186:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+22:12496:x1874190788566784:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787367947.958255:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.958272:0:9404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea3f expref: 22 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.958293:0:9404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.958328:0:9404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea3f expref: 22 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.958343:0:9404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea3f expref: 22 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367947.958372:0:9404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808538112:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367947.958464:0:9404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5598227e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367947.961612:0:9404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9404:1874190808538112:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787367947.961640:0:9404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367947.968310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.968793:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788566912 00000100:00100000:0.0:1787367947.968811:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788566912 00010000:00010000:0.0:1787367947.968855:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea3f expref: 23 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367947.968891:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:0.0:1787367947.968900:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+23:2402:x1874190788566912:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367947.968915:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367947.968921:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea3f expref: 23 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.968934:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea3f expref: 23 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.968966:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75c00/0x66f5679bff0316c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea3f expref: 23 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.968982:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:0.0:1787367947.968987:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.968996:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.969019:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.969059:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367947.969115:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+22:2402:x1874190788566912:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 216us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.969123:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 102 00010000:00010000:3.0:1787367947.969633:0:9404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.969643:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.969684:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.969691:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.969697:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.969703:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367947.969707:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.969722:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.969732:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:3.0:1787367947.969734:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787367947.969738:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367947.969755:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031708 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367947.969811:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+21:12496:x1874190788566784:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 11636us (14369us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787367947.969820:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:1.0:1787367947.978339:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367947.978531:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788567040 00000100:00100000:2.0:1787367947.978541:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788567040 00000100:00100000:2.0:1787367947.978596:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:2.0:1787367947.978606:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2403:x1874190788567040:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787367947.978646:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.978665:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.978685:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367947.978688:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367947.978693:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.978727:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.978740:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 8 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367947.978761:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8451:1874190808538240:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367947.978851:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1787367947.980931:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8451:1874190808538240:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787367947.980971:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367947.983472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367947.983558:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788567168 00000100:00100000:0.0:1787367947.983568:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788567168 00010000:00010000:0.0:1787367947.983618:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 9 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367947.983658:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:0.0:1787367947.983669:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+9:2403:x1874190788567168:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367947.983683:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367947.983703:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 9 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.983716:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 9 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.983737:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff0316ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea5b expref: 9 pid: 8454 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.983763:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367947.983768:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367947.983787:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.983797:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367947.983840:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367947.983897:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2403:x1874190788567168:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 229us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367947.983905:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 103 00010000:00010000:2.0:1787367947.984240:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.984250:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.984269:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.984277:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.984296:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.984303:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787367947.984308:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.984316:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.984329:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367947.984337:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03170f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367947.984421:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+7:2403:x1874190788567040:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 5816us (6089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367947.984429:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:2.0:1787367947.990992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367947.991279:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788567424 00000100:00100000:1.0:1787367947.991288:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788567424 00000100:00100000:1.0:1787367947.991345:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:1.0:1787367947.991388:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+21:12496:x1874190788567424:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787367947.991461:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.991480:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea07 expref: 21 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.991503:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.991537:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea07 expref: 21 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367947.991550:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea07 expref: 21 pid: 9404 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367947.991564:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808538368:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787367947.991659:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624780 going to sleep for 11 seconds 00000100:00100000:1.0:1787367948.001255:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367948.001350:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788567552 00000100:00100000:0.0:1787367948.001394:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788567552 00010000:00010000:0.0:1787367948.001433:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea07 expref: 22 pid: 9404 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367948.001465:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:0.0:1787367948.001475:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+22:2402:x1874190788567552:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367948.001489:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367948.001495:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea07 expref: 22 pid: 9404 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.001508:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea07 expref: 22 pid: 9404 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.001531:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367948.001537:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea2a expref: 22 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.001567:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.001586:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.001593:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.001612:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367948.001669:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+22:2402:x1874190788567552:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 194us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367948.001676:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00010000:00010000:2.0:1787367948.002164:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b200/0x66f5679bff031605 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea07 expref: 21 pid: 9404 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367948.002183:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808538368:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367948.002214:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.002223:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.002229:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.002422:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.002435:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea46 expref: 21 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.002444:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.002471:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea46 expref: 21 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.002484:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea46 expref: 21 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367948.002496:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808538496:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787367948.002557:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367948.006799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367948.006890:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788567680 00000100:00100000:0.0:1787367948.006900:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788567680 00010000:00010000:0.0:1787367948.006934:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea46 expref: 22 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367948.006981:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:0.0:1787367948.006990:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5598cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+22:2403:x1874190788567680:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367948.007003:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367948.007009:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea46 expref: 22 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.007022:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea46 expref: 22 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.007203:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:0.0:1787367948.007208:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.007217:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.007224:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.007242:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367948.007290:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5598cc3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6033427c-dc64-421a-b37f-d4458dbaa527+22:2403:x1874190788567680:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 301us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367948.007298:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00010000:00010000:2.0:1787367948.007503:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff0316d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea46 expref: 21 pid: 6538 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367948.007521:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808538496:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787367948.007548:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.007557:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.007562:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367948.007662:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1787367948.007775:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1787367948.007808:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1787367948.007875:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6539:1874190808538624:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787367948.007916:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367948.007938:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c558510eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367948.008503:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808538624 00000100:00100000:0.0:1787367948.008509:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808538624 00000100:00100000:0.0:1787367948.008546:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787367948.008554:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6539:x1874190808538624:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787367948.008642:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6539:x1874190808538624:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367948.008649:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787367948.008763:0:6539:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1787367948.008769:0:6539:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:3.0:1787367948.008782:0:6539:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c5483da5f80, transno 4294967322 00000004:00080000:3.0:1787367948.008796:0:6539:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c5483da7480, transno 4294967323 00000100:00100000:3.0:1787367948.008802:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6539:1874190808538624:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787367948.008913:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1787367948.008969:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6539:1874190808538752:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787367948.008998:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367948.009023:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58840 going to sleep for 11 seconds 00000100:00100000:0.0:1787367948.009244:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808538752 00000100:00100000:0.0:1787367948.009249:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808538752 00000100:00100000:0.0:1787367948.009281:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787367948.009287:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6539:x1874190808538752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787367948.009391:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6539:x1874190808538752:12345-0@lo:1000:mdt00_001.0 Request processed in 103us (391us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787367948.009406:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787367948.009436:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6539:1874190808538752:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787367948.009463:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009472:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009479:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009485:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367948.009488:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009495:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009508:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:0.0:1787367948.009511:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367948.009516:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009523:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff03171d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009542:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009548:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009564:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.009570:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367948.009573:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.010631:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.010642:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367948.010645:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367948.010651:0:6539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea2a expref: 24 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.010662:0:6539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea2a expref: 24 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.010670:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea2a expref: 24 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.010701:0:6539:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea2a expref: 24 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367948.010713:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808538880:192.168.203.4@tcp:105: 00000100:00100000:0.0:1787367948.010799:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367948.022134:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367948.022216:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788567808 00000100:00100000:2.0:1787367948.022223:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788567808 00000100:00100000:2.0:1787367948.022279:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:2.0:1787367948.022288:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+25:12495:x1874190788567808:12345-192.168.203.4@tcp:49:lfs.0 00000100:00100000:2.0:1787367948.022428:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+25:12495:x1874190788567808:12345-192.168.203.4@tcp:49:lfs.0 Request processed in 141us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367948.022437:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:0.0:1787367948.022909:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6539:1874190808538880:192.168.203.4@tcp:105: 00010000:00010000:0.0:1787367948.023012:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023023:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031660 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023116:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023130:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023141:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023150:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023155:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023161:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023167:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367948.023170:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023178:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023188:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367948.023191:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367948.023201:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023207:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a200/0x66f5679bff031724 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023218:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023224:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023230:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023235:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787367948.023237:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023243:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023251:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367948.023253:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787367948.023255:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.023261:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff031716 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367948.023685:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367948.023690:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367948.023705:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787367948.023711:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367948.023833:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+24:12496:x1874190788567424:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 32478us (32847us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787367948.023843:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 247 00000020:00080000:0.0:1787367948.023856:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787367948.041973:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367948.042273:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788568064 00000100:00100000:2.0:1787367948.042282:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788568064 00000100:00100000:2.0:1787367948.042334:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 248 00000100:00100000:2.0:1787367948.042376:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+24:12495:x1874190788568064:12345-192.168.203.4@tcp:58:lfs.0 00000040:00080000:2.0:1787367948.042529:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787367948.042608:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+24:12495:x1874190788568064:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 253us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367948.042616:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 248 00000100:00100000:3.0:1787367948.056808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367948.056878:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788568320 00000100:00100000:2.0:1787367948.056888:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788568320 00000100:00100000:2.0:1787367948.056946:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:2.0:1787367948.056965:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+24:12496:x1874190788568320:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787367948.057211:0:6542:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787367948.057239:0:6542:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1787367948.057268:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.057282:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.057293:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.057300:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.057306:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.057312:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367948.057333:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787367948.057458:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+26:12496:x1874190788568320:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 495us (668us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787367948.057466:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000020:00080000:2.0:1787367948.057471:0:6542:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787367948.057868:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367948.057875:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.057883:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787367948.057887:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.057895:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.057907:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:0.0:1787367948.057910:0:8468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787367948.057915:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.057921:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d800/0x66f5679bff03172b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.057932:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367948.057934:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367948.057935:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367948.092294:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367948.092443:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788568448 00000100:00100000:3.0:1787367948.092452:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788568448 00000100:00100000:3.0:1787367948.092515:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:3.0:1787367948.092525:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+26:12498:x1874190788568448:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1787367948.092548:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367948.092567:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031732 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea62 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092626:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092639:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092651:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092673:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092681:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092687:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092765:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092777:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea23 expref: 27 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092812:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092845:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea23 expref: 27 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.092858:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea23 expref: 27 pid: 6539 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367948.092871:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808539008:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787367948.093202:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367948.095393:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6540:1874190808539008:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787367948.095420:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367948.097862:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367948.098179:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788568704 00000100:00100000:1.0:1787367948.098189:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788568704 00000100:00100000:1.0:1787367948.098260:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:1.0:1787367948.098270:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+28:6183:x1874190788568704:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787367948.098497:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+29:6183:x1874190788568704:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 228us (643us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787367948.098505:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1787367948.109210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367948.109347:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788568832 00000100:00100000:0.0:1787367948.109396:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788568832 00010000:00010000:0.0:1787367948.109436:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea23 expref: 29 pid: 6539 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367948.109488:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:0.0:1787367948.109498:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+29:2403:x1874190788568832:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367948.109512:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367948.109519:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea23 expref: 29 pid: 6539 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.109532:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea23 expref: 29 pid: 6539 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.109552:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241d600/0x66f5679bff031652 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea23 expref: 29 pid: 6539 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.109568:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367948.109573:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.109594:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.109601:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367948.109627:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367948.109691:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6033427c-dc64-421a-b37f-d4458dbaa527+28:2403:x1874190788568832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 195us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367948.109698:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 106 00010000:00010000:3.0:1787367948.110638:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110650:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367948.110709:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787367948.110714:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787367948.110733:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110757:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110766:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110788:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110796:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110811:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367948.110815:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110822:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110833:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:3.0:1787367948.110836:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367948.110840:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110846:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff031739 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110858:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110864:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110870:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110875:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367948.110885:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110903:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110912:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c5483331300) 00010000:00010000:3.0:1787367948.110915:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367948.110918:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110923:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031740 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110959:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff031732 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea62 expref: 28 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110973:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea62 expref: 27 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367948.110980:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:3.0:1787367948.110983:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367948.110985:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74400, rc 0) 00000100:00100000:3.0:1787367948.111025:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+27:12498:x1874190788568448:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 18501us (18739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367948.111033:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 249 00000040:00080000:1.0:1787367948.578294:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787367948.635903:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787367949.082976:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367949.082986:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367949.083009:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787367949.083017:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787367949.083141:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808539136:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367949.083230:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6153f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367949.094657:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1874190808539136:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367949.100328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367949.100425:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788568960 00000100:00100000:0.0:1787367949.100435:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788568960 00000100:00100000:0.0:1787367949.100494:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:0.0:1787367949.100503:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+27:12509:x1874190788568960:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787367949.100545:0:6538:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787367949.100661:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+27:12509:x1874190788568960:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 157us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367949.100668:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00080000:1.0:1787367949.111498:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367949.124079:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367949.124147:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788569216 00000100:00100000:0.0:1787367949.124156:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788569216 00000100:00100000:0.0:1787367949.124213:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:0.0:1787367949.124224:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+27:12509:x1874190788569216:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367949.124243:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367949.124265:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03174e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea69 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367949.124392:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031755 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367949.124408:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367949.124421:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367949.124432:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787367949.124529:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03174e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea69 expref: 30 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367949.124555:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031755 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea69 expref: 29 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367949.124563:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:0.0:1787367949.124566:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367949.124569:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b800, rc 0) 00000100:00100000:0.0:1787367949.124620:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+29:12509:x1874190788569216:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 399us (551us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787367949.124628:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:0.0:1787367949.132763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367949.132864:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367949.132941:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788569472 00000100:00100000:1.0:1787367949.132966:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788569472 00000100:00100000:1.0:1787367949.133032:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00100000:1.0:1787367949.133042:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+29:12509:x1874190788569472:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787367949.133117:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367949.133132:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367949.133141:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367949.133286:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367949.133293:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788569600 00010000:00010000:1.0:1787367949.133293:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367949.133297:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788569600 00010000:00010000:1.0:1787367949.133300:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367949.133306:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787367949.133310:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367949.133317:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367949.133329:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00010000:00010000:1.0:1787367949.133329:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:1.0:1787367949.133332:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1787367949.133335:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+31:2403:x1874190788569600:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367949.133337:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367949.133350:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f000/0x66f5679bff031763 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.133351:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367949.133393:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031755 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea69 expref: 31 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.133403:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:3.0:1787367949.133407:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367949.133457:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6033427c-dc64-421a-b37f-d4458dbaa527+30:2403:x1874190788569600:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 117us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367949.133466:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1787367949.134704:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+29:12509:x1874190788569472:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 1658us (1945us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787367949.134717:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 252 00000040:00080000:1.0:1787367949.134842:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367949.134847:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787367949.135503:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787367949.135515:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367949.150651:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367949.150686:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788569856 00000100:00100000:3.0:1787367949.150694:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788569856 00000100:00100000:2.0:1787367949.151887:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1787367949.151904:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+29:12509:x1874190788569856:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787367949.152194:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+30:12509:x1874190788569856:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 294us (1548us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787367949.152204:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000040:00080000:0.0:1787367949.172922:0:14776:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367949.172933:0:14776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367949.172974:0:14776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787367949.172980:0:14776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367949.291881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367949.291960:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788570112 00000100:00100000:3.0:1787367949.291968:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788570112 00000100:00100000:3.0:1787367949.292029:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 253 00000100:00100000:3.0:1787367949.292040:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+30:12522:x1874190788570112:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1787367949.292064:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367949.292083:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03176a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea70 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.292180:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031771 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.292195:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031771 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.292206:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031771 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367949.292234:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787367949.292334:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74600/0x66f5679bff03176a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea70 expref: 33 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.292349:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031771 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea70 expref: 32 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.292438:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:3.0:1787367949.292442:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787367949.292445:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75a00, rc 0) 00000100:00100000:2.0:1787367949.295156:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+32:12522:x1874190788570112:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 3109us (3273us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787367949.295169:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 253 00000100:00100000:3.0:1787367949.300820:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367949.300855:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788570240 00000100:00100000:3.0:1787367949.300864:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788570240 00000100:00100000:3.0:1787367949.300932:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:3.0:1787367949.300942:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+32:12522:x1874190788570240:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1787367949.301015:0:9404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.301032:0:9404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.301044:0:9404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.301079:0:9404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.301086:0:9404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.301102:0:9404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.301109:0:9404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367949.301113:0:9404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.301121:0:9404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.301132:0:9404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:3.0:1787367949.301135:0:9404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787367949.301139:0:9404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367949.301144:0:9404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74000/0x66f5679bff03177f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367949.301214:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6033427c-dc64-421a-b37f-d4458dbaa527+32:12522:x1874190788570240:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 273us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367949.301222:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:3.0:1787367949.380335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367949.380858:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788570368 00000100:00100000:1.0:1787367949.380868:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788570368 00000100:00080000:2.0:1787367949.380939:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367949.380990:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:1.0:1787367949.381001:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788570368:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:1.0:1787367949.381018:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367949.381039:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c72c7fa/0x66f5679bff031786 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea77 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367949.381063:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a89120b, atime: 0x6a89120b, ctime: 0x6a89120b, blocks: 0x8 00010000:00010000:1.0:1787367949.381082:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1787367949.381087:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367949.381097:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c72c7fa/0x66f5679bff031786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea77 expref: 8 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367949.381114:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c72c7fa/0x66f5679bff031786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea77 expref: 8 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367949.381146:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e400, rc 0) 00000100:00100000:1.0:1787367949.381205:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+8:2405:x1874190788570368:12345-192.168.203.4@tcp:101:cat.0 Request processed in 206us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367949.381213:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:3.0:1787367949.388468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367949.388571:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788570496 00000100:00100000:2.0:1787367949.388590:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788570496 00002000:00100000:2.0:1787367949.388637:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9c55bd627100 x1874190788570496/t0(0) o3->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:590/0 lens 488/0 e 0 to 0 dl 1787367960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367949.388667:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c55bd627100 with x1874190788570496 ext(0->4095) 00002000:00010000:2.0:1787367949.388672:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c55bd627100 00000100:00100000:2.0:1787367949.388704:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1787367949.388714:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2404:x1874190788570496:12345-192.168.203.4@tcp:3:cat.0 00000100:00100000:2.0:1787367949.388876:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6033427c-dc64-421a-b37f-d4458dbaa527+8:2404:x1874190788570496:12345-192.168.203.4@tcp:3:cat.0 Request processed in 163us (416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787367949.388884:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00002000:00100000:2.0:1787367949.388891:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9c55bd627100 x1874190788570496/t0(0) o3->6033427c-dc64-421a-b37f-d4458dbaa527@192.168.203.4@tcp:590/0 lens 488/4536 e 0 to 0 dl 1787367960 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367949.388898:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c55bd627100 with x1874190788570496 ext(0->4095) 00002000:00010000:2.0:1787367949.388901:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c55bd627100 00000100:00100000:2.0:1787367949.628754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367949.628845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367949.628889:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367949.628916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367949.628942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367949.628968:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788571136 00000100:00100000:2.0:1787367949.628977:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788571136 00000100:00100000:2.0:1787367949.629041:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788570752 00000100:00100000:2.0:1787367949.629045:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788570752 00000100:00100000:2.0:1787367949.629061:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788571008 00000100:00100000:2.0:1787367949.629064:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788571008 00000100:00100000:2.0:1787367949.629081:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 334 00000100:00100000:2.0:1787367949.629090:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788571136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367949.629156:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788571136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367949.629176:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 334 00000100:00100000:2.0:1787367949.629193:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 335 00000100:00100000:2.0:1787367949.629200:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788570752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367949.629226:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788570752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367949.629232:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 335 00000100:00100000:2.0:1787367949.629243:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 336 00000100:00100000:2.0:1787367949.629249:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788571008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367949.629286:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2403:x1874190788571008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367949.629291:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 336 00000100:00080000:2.0:1787367949.629306:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367949.629310:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787367949.630528:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788570880 00000100:00100000:1.0:1787367949.630537:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788570880 00000100:00100000:1.0:1787367949.630601:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:1.0:1787367949.630610:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788570880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367949.630657:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2403:x1874190788570880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367949.630665:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00080000:2.0:1787367949.632124:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367949.633872:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788570624 00000100:00100000:0.0:1787367949.633946:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788570624 00000100:00100000:0.0:1787367949.634068:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 391 00000100:00100000:0.0:1787367949.634079:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788570624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367949.634155:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2403:x1874190788570624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (5410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367949.634163:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 391 00010000:00010000:1.0:1787367949.656534:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367950.233397:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808539392:0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.233523:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808539648:0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.233592:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808539264:0@lo:400:kworker.0 00000100:00100000:1.0:1787367950.234155:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808539520:0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.239311:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367950.239399:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808540160:0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.239507:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367950.239529:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808540672:0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.239567:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367950.239631:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808540160 00000100:00100000:3.0:1787367950.239638:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808540160 00000100:00100000:3.0:1787367950.239687:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808540672 00000100:00100000:3.0:1787367950.239690:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808540672 00000100:00100000:3.0:1787367950.239713:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787367950.239722:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808540160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.239788:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808540160:12345-0@lo:400:kworker.0 Request processed in 67us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367950.239795:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787367950.239812:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787367950.239819:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808540672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.239847:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808540672:12345-0@lo:400:kworker.0 Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367950.239853:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787367950.240217:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808539648 00000100:00100000:2.0:1787367950.240221:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808539648 00000100:00100000:2.0:1787367950.240255:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787367950.240262:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808539648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.240300:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808539648:12345-0@lo:400:kworker.0 Request processed in 39us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367950.240307:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:2.0:1787367950.240368:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367950.240373:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367950.240492:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367950.240525:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808539264 00000100:00100000:2.0:1787367950.240528:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808539264 00000100:00100000:2.0:1787367950.240556:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787367950.240562:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808539264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.240605:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808539264:12345-0@lo:400:kworker.0 Request processed in 43us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367950.240611:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787367950.240655:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808539264:0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.240664:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808539776:0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.240691:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367950.240710:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808540288:0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.240742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367950.240762:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808540288 00000100:00100000:2.0:1787367950.240766:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808540288 00000100:00100000:2.0:1787367950.240795:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787367950.240801:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808540288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.240831:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808540288:12345-0@lo:400:kworker.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367950.240837:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1787367950.240849:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367950.240865:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787367950.240870:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000100:00100000:3.0:1787367950.241154:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808540160:0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.241171:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808540672:0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.241210:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808539648:0@lo:400:kworker.0 00000004:00080000:2.0:1787367950.242162:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c5483dd8e00, transno 4294967308 00000004:00080000:2.0:1787367950.242175:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1787367950.242184:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c55bc692a00, transno 4294967311 00000100:00100000:2.0:1787367950.242191:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808540288:0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.242323:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808540800:0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.242387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367950.242419:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808540800 00000100:00100000:2.0:1787367950.242504:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808540800 00000100:00100000:2.0:1787367950.242554:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787367950.242562:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808540800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.242606:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808540800:12345-0@lo:400:kworker.0 Request processed in 45us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367950.242613:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1787367950.242632:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367950.242658:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808540800:0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.245809:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367950.245866:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808539904:0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.245919:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367950.245941:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808540416:0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.245963:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367950.245992:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808540928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367950.246020:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367950.246218:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808539776 00000100:00100000:0.0:1787367950.246227:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808539776 00000100:00100000:0.0:1787367950.246270:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808540928 00000100:00100000:0.0:1787367950.246274:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808540928 00000100:00100000:0.0:1787367950.246291:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787367950.246300:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808539776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.246371:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808539776:12345-0@lo:400:kworker.0 Request processed in 57us (5663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367950.246379:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787367950.246395:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787367950.246401:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808540928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787367950.246492:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787367950.246532:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808540928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367950.246539:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787367950.246560:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808539392 00000100:00100000:0.0:1787367950.246564:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808539392 00000100:00100000:0.0:1787367950.246692:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808539904 00000100:00100000:0.0:1787367950.246695:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808539904 00000100:00100000:0.0:1787367950.246716:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808540416 00000100:00100000:0.0:1787367950.246719:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808540416 00000100:00100000:0.0:1787367950.246756:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787367950.246762:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808539392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.246798:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808539392:12345-0@lo:400:kworker.0 Request processed in 36us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367950.246804:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787367950.246816:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787367950.246821:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808539904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.246846:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808539904:12345-0@lo:400:kworker.0 Request processed in 25us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367950.246852:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787367950.246861:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787367950.246867:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808540416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367950.247090:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808539776:0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.247225:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808540416:12345-0@lo:400:kworker.0 Request processed in 358us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367950.247232:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:0.0:1787367950.247252:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367950.247276:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808540928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367950.247289:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808539392:0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.247299:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808539904:0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.247307:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808540416:0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.250454:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367950.250499:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808540032:0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.250530:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367950.250556:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808540544:0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.250582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367950.250613:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808540032 00000100:00100000:3.0:1787367950.250622:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808540032 00000100:00100000:3.0:1787367950.250678:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808540544 00000100:00100000:3.0:1787367950.250682:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808540544 00000100:00100000:3.0:1787367950.250702:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787367950.250710:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808540032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.250768:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808540032:12345-0@lo:400:kworker.0 Request processed in 58us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367950.250775:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787367950.250792:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787367950.250798:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808540544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367950.250824:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808540544:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367950.250830:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00080000:3.0:1787367950.250861:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc690700 x1874190808540544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367950.250886:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808540544:0@lo:400:kworker.0 00000100:00080000:0.0:1787367950.251259:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367950.251275:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808539520 00000100:00100000:0.0:1787367950.251279:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808539520 00000100:00100000:0.0:1787367950.251308:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787367950.251313:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808539520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367950.251372:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808539520:12345-0@lo:400:kworker.0 Request processed in 41us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367950.251379:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787367950.251475:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808539520:0@lo:400:kworker.0 00010000:00080000:3.0:1787367950.251487:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483ceca80 x1874190808540032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367950.251496:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808540032:0@lo:400:kworker.0 00010000:00010000:2.0:1787367950.682585:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367950.745840:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367950.745866:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808541056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367950.746094:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367950.746133:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808541056 00000100:00100000:0.0:1787367950.746141:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808541056 00000100:00100000:0.0:1787367950.746196:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787367950.746206:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808541056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787367950.746235:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367950.746284:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808541056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367950.746291:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787367950.746339:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808541056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367950.746674:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808541184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367950.746719:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367950.746786:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367950.746794:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808541312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367950.746819:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367950.747136:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808541184 00000100:00100000:0.0:1787367950.747143:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808541184 00000100:00100000:0.0:1787367950.747170:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808541312 00000100:00100000:0.0:1787367950.747173:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808541312 00000100:00100000:0.0:1787367950.747188:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787367950.747205:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787367950.747209:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808541184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367950.747219:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808541312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367950.747230:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00002000:00000024:2.0:1787367950.747235:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787367950.747283:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808541184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367950.747285:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808541312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367950.747298:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787367950.747422:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787367950.748414:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808541312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367950.748431:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808541184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367951.260744:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808541440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367951.260818:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367951.261048:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808541440 00000100:00100000:1.0:1787367951.261055:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808541440 00000100:00100000:1.0:1787367951.261106:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787367951.261116:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808541440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367951.261138:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367951.261179:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808541440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367951.261186:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787367951.261322:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808541440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367951.704754:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367952.281625:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367952.281648:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808541568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367952.281711:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367952.281819:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808541568 00000100:00100000:2.0:1787367952.281826:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808541568 00000100:00100000:2.0:1787367952.281868:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787367952.281877:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808541568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787367952.281905:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787367952.281964:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808541568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367952.281972:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787367952.282010:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808541568:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787367952.729012:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367953.753374:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787367953.821646:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1787367953.821679:0:6517:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c55812ed780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787367953.821684:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55bd6f9a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c5598227e40 00000020:00080000:2.0:1787367953.821688:0:6517:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55bd6f9800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c5482532400 00000020:00080000:2.0:1787367953.821719:0:6517:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1787367953.821814:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367953.821826:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367953.821834:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367953.821848:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787367953.821853:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367953.821860:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367953.821875:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c5483331d00) 00010000:00010000:3.0:1787367953.821878:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367953.821883:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367953.821890:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e200/0x66f5679bff031701 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787367953.824278:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787367953.824351:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787367953.824597:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1787367953.824606:0:9534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:3.0:1787367954.750529:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367954.750622:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788571264 00000100:00100000:0.0:1787367954.750656:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788571264 00000100:00080000:2.0:1787367954.750736:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367954.750751:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 255 00000100:00100000:0.0:1787367954.750763:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:12183:x1874190788571264:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787367954.750877:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:12183:x1874190788571264:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367954.750886:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 255 00000100:00100000:1.0:1787367954.755680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367954.755728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367954.755761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367954.755792:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367954.755814:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367954.755824:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788571648 00000100:00100000:2.0:1787367954.755833:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788571648 00000100:00100000:1.0:1787367954.755835:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367954.755853:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788571904 00000100:00100000:1.0:1787367954.755856:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788571904 00000100:00100000:2.0:1787367954.755892:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788571776 00000100:00100000:1.0:1787367954.755892:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788571520 00000100:00100000:2.0:1787367954.755895:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788571776 00000100:00100000:1.0:1787367954.755895:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788571520 00000100:00100000:1.0:1787367954.755907:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788572032 00000100:00100000:1.0:1787367954.755909:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788572032 00000100:00100000:2.0:1787367954.755915:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:2.0:1787367954.755923:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788571648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367954.755936:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 343 00000100:00100000:1.0:1787367954.755941:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788571904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787367954.755986:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788571648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367954.755994:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:0.0:1787367954.756007:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788571392 00000100:00100000:2.0:1787367954.756009:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:0.0:1787367954.756011:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788571392 00000100:00100000:2.0:1787367954.756015:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788571776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367954.756049:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 393 00000100:00100000:0.0:1787367954.756057:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788571392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367954.756076:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 344 00000100:00100000:3.0:1787367954.756084:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788571520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367954.756115:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788571904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 173us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367954.756122:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 343 00000100:00100000:1.0:1787367954.756136:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 345 00000100:00100000:1.0:1787367954.756143:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788572032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367954.756166:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+5:2405:x1874190788572032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367954.756172:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 345 00000100:00080000:1.0:1787367954.756292:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367954.756297:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367954.756299:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367954.756301:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367954.760529:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6033427c-dc64-421a-b37f-d4458dbaa527+7:2405:x1874190788571776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 4501us (4701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367954.760545:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:0.0:1787367954.761324:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55912d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788571392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 5264us (5655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367954.761336:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 393 00000100:00100000:3.0:1787367954.772269:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+5:2405:x1874190788571520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 16174us (16464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367954.772285:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 344 00000100:00100000:0.0:1787367954.779765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367954.781932:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788572160 00000100:00100000:2.0:1787367954.781947:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788572160 00000100:00100000:2.0:1787367954.782030:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 256 00000100:00100000:2.0:1787367954.782040:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:12183:x1874190788572160:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787367954.782154:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:12183:x1874190788572160:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 116us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367954.782162:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 256 00010000:00010000:2.0:1787367954.788432:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367954.789433:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367954.790599:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788572416 00000100:00100000:2.0:1787367954.790610:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788572416 00000100:00100000:2.0:1787367954.790673:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1787367954.790682:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+18:12183:x1874190788572416:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787367954.790927:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+19:12183:x1874190788572416:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 244us (1503us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787367954.790934:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:1.0:1787367955.139563:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367955.141553:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788572544 00000100:00100000:0.0:1787367955.141567:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788572544 00000100:00100000:0.0:1787367955.141713:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 257 00000100:00100000:0.0:1787367955.141725:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:12979:x1874190788572544:12345-192.168.203.4@tcp:101:lsof.0 00010000:00010000:0.0:1787367955.141746:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367955.141882:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03178d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea7e expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367955.141946:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031794 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367955.141960:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367955.141986:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367955.142096:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787367955.142101:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787367955.142124:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367955.142148:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a800/0x66f5679bff03178d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea7e expref: 7 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367955.142166:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031794 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea7e expref: 6 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367955.142173:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:0.0:1787367955.142176:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367955.142180:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b800, rc 0) 00000100:00100000:0.0:1787367955.142251:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+6:12979:x1874190788572544:12345-192.168.203.4@tcp:101:lsof.0 Request processed in 528us (2697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367955.142258:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 257 00000100:00100000:0.0:1787367955.352915:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808541696:0@lo:400:kworker.0 00000100:00100000:1.0:1787367955.352959:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808541824:0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.352982:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367955.352986:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367955.353035:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808542208:0@lo:400:kworker.0 00000100:00100000:2.0:1787367955.353057:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808541952:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.353133:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808541824 00000100:00100000:3.0:1787367955.353141:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808541824 00000100:00100000:3.0:1787367955.353182:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787367955.353191:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808541824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367955.353223:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808542336:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.353238:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808541824:12345-0@lo:400:kworker.0 Request processed in 49us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367955.353243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367955.353259:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808542848:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.353261:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787367955.353276:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808542336 00000100:00100000:1.0:1787367955.353277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367955.353279:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808542336 00000100:00100000:1.0:1787367955.353296:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808543360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367955.353299:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808542848 00000100:00100000:3.0:1787367955.353302:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808542848 00000100:00100000:3.0:1787367955.353317:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787367955.353317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367955.353322:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808542336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.353348:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808542336:12345-0@lo:400:kworker.0 Request processed in 26us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367955.353348:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808541824:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.353370:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787367955.353383:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787367955.353387:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808542336:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.353389:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808542848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.353414:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808542848:12345-0@lo:400:kworker.0 Request processed in 26us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367955.353415:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808542848:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.353420:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787367955.353433:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808543360 00000100:00100000:3.0:1787367955.353436:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808541696 00000100:00100000:1.0:1787367955.353436:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808543360 00000100:00100000:3.0:1787367955.353438:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808541696 00000100:00100000:3.0:1787367955.353459:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787367955.353459:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787367955.353466:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808541696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367955.353466:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808543360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787367955.353488:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787367955.353493:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3651:x1874190808541696:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367955.353497:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787367955.353520:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808543360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367955.353526:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1787367955.353541:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367955.353550:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808543360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367955.353560:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808542080:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.354828:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367955.354862:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808542592:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.355072:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367955.355093:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808543104:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.355115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367955.355155:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808542080 00000100:00100000:3.0:1787367955.355162:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808542080 00000100:00100000:3.0:1787367955.355198:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787367955.355207:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808542080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.355249:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808542080:12345-0@lo:400:kworker.0 Request processed in 43us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367955.355257:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787367955.355290:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808542080:0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.355718:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367955.355742:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808542720:0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.355780:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367955.355811:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808543232:0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.355835:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367955.355859:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808541696:0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.355887:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808542592 00000100:00100000:0.0:1787367955.355891:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808542592 00000100:00100000:0.0:1787367955.355920:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808543104 00000100:00100000:0.0:1787367955.355923:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808543104 00000100:00100000:0.0:1787367955.355935:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808542720 00000100:00100000:0.0:1787367955.355937:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808542720 00000100:00100000:0.0:1787367955.355951:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808543232 00000100:00100000:0.0:1787367955.355954:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808543232 00000100:00100000:0.0:1787367955.355967:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787367955.355972:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808542592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.356010:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808542592:12345-0@lo:400:kworker.0 Request processed in 37us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367955.356016:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787367955.356029:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787367955.356035:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808543104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.356062:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808543104:12345-0@lo:400:kworker.0 Request processed in 29us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367955.356069:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787367955.356078:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787367955.356084:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808542720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.356114:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808542720:12345-0@lo:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367955.356119:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787367955.356129:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787367955.356255:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367955.356276:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808542208 00000100:00100000:2.0:1787367955.356279:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808542464:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.356280:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808542208 00000100:00100000:2.0:1787367955.356302:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367955.356304:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808541952 00000100:00100000:3.0:1787367955.356307:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808541952 00000100:00100000:2.0:1787367955.356318:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808542976:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.356319:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787367955.356325:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808542208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367955.356337:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367955.356372:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808542208:12345-0@lo:400:kworker.0 Request processed in 31us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367955.356378:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787367955.356392:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787367955.356398:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808541952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.356426:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808541952:12345-0@lo:400:kworker.0 Request processed in 28us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367955.356429:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808541952:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.356432:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787367955.356451:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808542464 00000100:00100000:3.0:1787367955.356454:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808542976 00000100:00100000:2.0:1787367955.356454:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808542464 00000100:00100000:3.0:1787367955.356463:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808542976 00000100:00100000:2.0:1787367955.356480:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787367955.356492:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808542464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.356523:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808543232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367955.356525:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808542464:12345-0@lo:400:kworker.0 Request processed in 35us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367955.356550:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808543232:12345-0@lo:400:kworker.0 Request processed in 29us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367955.356562:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1787367955.356586:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787367955.356589:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367955.356591:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367955.356614:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808542592:0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.356624:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808543104:0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.356651:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808542208:0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.356660:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808542720:0@lo:400:kworker.0 00000100:00100000:0.0:1787367955.356668:0:3651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1787367955.356672:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1787367955.356689:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808543232:0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.356917:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787367955.356948:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808542976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367955.356982:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808542976:12345-0@lo:400:kworker.0 Request processed in 58us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367955.356988:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00080000:3.0:1787367955.357030:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4d180 x1874190808542464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367955.357041:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808542464:0@lo:400:kworker.0 00010000:00080000:3.0:1787367955.357050:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4fb80 x1874190808542976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367955.357057:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808542976:0@lo:400:kworker.0 00000100:00100000:2.0:1787367955.361132:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:1.0:1787367955.805328:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367955.864536:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367955.864558:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808543488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787367955.864627:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367955.864920:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808543488 00000100:00100000:2.0:1787367955.864928:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808543488 00000100:00100000:2.0:1787367955.864980:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787367955.864989:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808543488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787367955.865016:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367955.865082:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808543488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367955.865090:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787367955.865178:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808543488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787367955.865761:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367955.865772:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808543616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367955.865809:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367955.866122:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367955.866211:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808543616 00000100:00100000:0.0:1787367955.866217:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808543616 00000100:00100000:0.0:1787367955.866249:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787367955.866256:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808543616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787367955.866274:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787367955.866311:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808543616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367955.866317:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787367955.866406:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808543616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787367955.868008:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808543744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367955.868055:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367955.886976:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808543744 00000100:00100000:0.0:1787367955.886988:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808543744 00000100:00100000:0.0:1787367955.887269:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787367955.887281:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808543744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367955.887307:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787367955.889333:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808543744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2049us (21271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367955.889346:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787367955.889508:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808543744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367956.376915:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367956.376939:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808543872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367956.377001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367956.377311:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808543872 00000100:00100000:0.0:1787367956.377319:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808543872 00000100:00100000:0.0:1787367956.377379:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787367956.377387:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808543872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367956.377408:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787367956.377457:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808543872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367956.377464:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787367956.378107:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808543872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367956.824749:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367957.405101:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367957.405132:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808544000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367957.405223:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367957.405897:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808544000 00000100:00100000:3.0:1787367957.405906:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808544000 00000100:00100000:3.0:1787367957.405974:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787367957.405985:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808544000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367957.406038:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367957.406100:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808544000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367957.406107:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787367957.406575:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808544000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787367957.848657:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787367958.360615:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367958.360623:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367958.360705:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1787367958.360878:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787367958.810381:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787367958.885846:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787367958.928235:0:14975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:05:57 (1787367957) 00000001:00080000:2.0:1787367959.456935:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787367959.456950:0:6517:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787367959.457008:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787367959.457018:0:6570:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787367959.866046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367959.866086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367959.866117:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367959.866143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367959.866162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367959.866182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367959.866205:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367959.866233:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788572672 00000100:00100000:0.0:1787367959.866241:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788572672 00000100:00100000:1.0:1787367959.866250:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788573056 00000100:00100000:1.0:1787367959.866257:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788573056 00000100:00100000:0.0:1787367959.866306:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 395 00000100:00100000:1.0:1787367959.866307:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788573184 00000100:00100000:1.0:1787367959.866312:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788573184 00000100:00100000:0.0:1787367959.866329:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788572672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367959.866347:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:1.0:1787367959.866376:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788573056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367959.866422:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:926ebb72-6750-4035-807e-0762300bea95+13:2404:x1874190788572672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 96us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367959.866430:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 395 00000100:00100000:0.0:1787367959.866477:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788572800 00000100:00100000:0.0:1787367959.866481:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788572800 00000100:00100000:1.0:1787367959.866488:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788573056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 131us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367959.866496:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:0.0:1787367959.866509:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788573312 00000100:00100000:0.0:1787367959.866513:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788573312 00000100:00100000:1.0:1787367959.866518:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:1.0:1787367959.866528:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2404:x1874190788573184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787367959.866537:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788572928 00000100:00100000:0.0:1787367959.866542:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788572928 00000100:00100000:1.0:1787367959.866559:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2404:x1874190788573184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367959.866562:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788573440 00000100:00100000:1.0:1787367959.866567:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:0.0:1787367959.866567:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788573440 00000100:00100000:0.0:1787367959.866596:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 352 00000100:00100000:1.0:1787367959.866604:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 353 00000100:00100000:0.0:1787367959.866610:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+18:2404:x1874190788572800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367959.866618:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2404:x1874190788573312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367959.866647:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:376539eb-750a-402c-b2b9-1c135ada549f+6:2404:x1874190788573312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367959.866654:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 353 00000100:00100000:0.0:1787367959.866685:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6033427c-dc64-421a-b37f-d4458dbaa527+18:2404:x1874190788572800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 80us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367959.866693:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 354 00000100:00100000:1.0:1787367959.866712:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788572928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787367959.866739:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2404:x1874190788572928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367959.866848:0:6539:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787367959.866857:0:6539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787367959.866877:0:9404:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787367959.866886:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 352 00000100:00100000:3.0:1787367959.866899:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 355 00000100:00100000:0.0:1787367959.866904:0:6540:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787367959.866912:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788573440:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787367959.866947:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2404:x1874190788573440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367959.866955:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 355 00000100:00100000:1.0:1787367959.867030:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 354 00000100:00080000:1.0:1787367959.867050:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367959.867054:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367959.867057:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367959.867059:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787367959.897714:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367960.477861:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367960.477884:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808544128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367960.477954:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367960.478036:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808544128 00000100:00100000:2.0:1787367960.478043:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808544128 00000100:00100000:2.0:1787367960.478086:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787367960.478094:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808544128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787367960.478126:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787367960.478172:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808544128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367960.478178:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787367960.478223:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808544128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787367960.478432:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808544384:0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.478462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367960.478480:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808544896:0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.478499:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367960.478515:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808545408:0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.478533:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367960.478565:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787367960.478571:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808544256:0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.478610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367960.478632:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808544768:0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.478650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367960.478677:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808545280:0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.478696:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367960.478722:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808544384 00000100:00100000:0.0:1787367960.478726:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808544384 00000100:00100000:0.0:1787367960.478750:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808544896 00000100:00100000:0.0:1787367960.478753:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808544896 00000100:00100000:0.0:1787367960.478776:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808545408 00000100:00100000:0.0:1787367960.478778:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808545408 00000100:00100000:0.0:1787367960.478788:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808544768 00000100:00100000:0.0:1787367960.478791:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808544768 00000100:00100000:0.0:1787367960.478801:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808545280 00000100:00100000:0.0:1787367960.478803:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808545280 00000100:00100000:0.0:1787367960.478816:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787367960.478823:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808544384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.478860:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808544384:12345-0@lo:400:kworker.0 Request processed in 38us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367960.478867:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787367960.478881:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787367960.478888:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808544896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.478915:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808544896:12345-0@lo:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367960.478921:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787367960.478934:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787367960.478941:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808545408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.478977:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808545408:12345-0@lo:400:kworker.0 Request processed in 38us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367960.478983:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787367960.478994:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787367960.479000:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808544768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.479025:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808544768:12345-0@lo:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367960.479030:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787367960.479041:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787367960.479047:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808545280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.479072:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808545280:12345-0@lo:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367960.479078:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787367960.479103:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808544256 00000100:00100000:0.0:1787367960.479107:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808544256 00000100:00100000:0.0:1787367960.479130:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1787367960.479136:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808544256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.479163:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3652:x1874190808544256:12345-0@lo:400:kworker.0 Request processed in 27us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367960.479169:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00080000:0.0:1787367960.479197:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367960.479202:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787367960.479248:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3652:1874190808544256:0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.479258:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808544768:0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.479266:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808545280:0@lo:400:kworker.0 00000100:00100000:0.0:1787367960.479283:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808544384:0@lo:400:kworker.0 00010000:00080000:0.0:1787367960.479295:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6042300 x1874190808544896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367960.479305:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808544896:0@lo:400:kworker.0 00010000:00080000:0.0:1787367960.479313:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6043100 x1874190808545408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367960.479321:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808545408:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485094:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808544512:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485159:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367960.485189:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808545024:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485208:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367960.485226:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808545536:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485245:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367960.485268:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787367960.485274:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808544640:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485297:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367960.485314:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808545152:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485335:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367960.485350:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808545664:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485389:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367960.485416:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808545024 00000100:00100000:2.0:1787367960.485421:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808545024 00000100:00100000:2.0:1787367960.485458:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808545536 00000100:00100000:2.0:1787367960.485461:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808545536 00000100:00100000:2.0:1787367960.485481:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808545152 00000100:00100000:2.0:1787367960.485483:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808545152 00000100:00100000:2.0:1787367960.485494:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808545664 00000100:00100000:2.0:1787367960.485497:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808545664 00000100:00100000:2.0:1787367960.485510:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787367960.485518:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808545024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485566:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808545024:12345-0@lo:400:kworker.0 Request processed in 47us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367960.485573:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787367960.485588:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787367960.485593:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808545536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485614:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808545536:12345-0@lo:400:kworker.0 Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367960.485619:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787367960.485627:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787367960.485631:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808545152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485650:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808545152:12345-0@lo:400:kworker.0 Request processed in 18us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367960.485655:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787367960.485678:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787367960.485684:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808545664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485707:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808545664:12345-0@lo:400:kworker.0 Request processed in 24us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367960.485713:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787367960.485733:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808544640 00000100:00100000:2.0:1787367960.485736:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808544640 00000100:00100000:2.0:1787367960.485759:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787367960.485772:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808544640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485806:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808544640:12345-0@lo:400:kworker.0 Request processed in 36us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367960.485811:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:2.0:1787367960.485832:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367960.485835:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367960.485843:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808544512 00000100:00100000:2.0:1787367960.485846:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808544512 00000100:00100000:2.0:1787367960.485871:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787367960.485877:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808544512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485906:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808544512:12345-0@lo:400:kworker.0 Request processed in 30us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367960.485912:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787367960.485950:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808544640:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485962:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808545152:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485970:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808545664:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485977:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808544512:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485985:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808545024:0@lo:400:kworker.0 00000100:00100000:2.0:1787367960.485992:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808545536:0@lo:400:kworker.0 00010000:00010000:2.0:1787367960.925636:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367960.984969:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367960.984992:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808545792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367960.985058:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367960.985157:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808545792 00000100:00100000:3.0:1787367960.985166:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808545792 00000100:00100000:3.0:1787367960.985229:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787367960.985240:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808545792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787367960.985269:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787367960.985310:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808545792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367960.985317:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787367960.985461:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808545792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367960.985668:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367960.985677:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808546048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367960.985706:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367960.985733:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808546048 00000100:00100000:1.0:1787367960.985738:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808546048 00000100:00100000:1.0:1787367960.985765:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787367960.985771:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808546048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787367960.985787:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367960.985834:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808546048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367960.985840:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787367960.985869:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808546048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787367960.985892:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808545920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367960.985914:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367960.985937:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808545920 00000100:00100000:1.0:1787367960.985940:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808545920 00000100:00100000:1.0:1787367960.985959:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787367960.985965:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808545920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367960.985975:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787367960.986003:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808545920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367960.986008:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787367960.986051:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808545920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367961.496592:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367961.496617:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808546176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367961.496718:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367961.497345:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808546176 00000100:00100000:1.0:1787367961.497371:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808546176 00000100:00100000:1.0:1787367961.497463:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787367961.497473:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808546176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367961.497493:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787367961.497552:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808546176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367961.497559:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787367961.497658:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808546176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367961.945655:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367962.524063:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808546304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367962.524156:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367962.524934:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808546304 00000100:00100000:3.0:1787367962.524943:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808546304 00000100:00100000:3.0:1787367962.525006:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787367962.525015:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808546304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787367962.525049:0:6543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787367962.525119:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808546304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367962.525126:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787367962.525162:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808546304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787367962.638937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367962.639044:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788573696 00000100:00100000:2.0:1787367962.639054:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788573696 00000100:00100000:2.0:1787367962.639139:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:2.0:1787367962.639152:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+18:13202:x1874190788573696:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:2.0:1787367962.639466:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+19:13202:x1874190788573696:12345-192.168.203.4@tcp:35:umount.0 Request processed in 316us (537us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787367962.639474:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00080000:0.0:1787367962.639562:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367962.641822:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367962.641922:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788573952 00000100:00100000:2.0:1787367962.641931:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788573952 00000100:00100000:2.0:1787367962.641987:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1787367962.641997:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+19:13202:x1874190788573952:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:2.0:1787367962.642292:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6033427c-dc64-421a-b37f-d4458dbaa527+20:13202:x1874190788573952:12345-192.168.203.4@tcp:35:umount.0 Request processed in 296us (477us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787367962.642300:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1787367962.644995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367962.645084:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788574208 00000100:00100000:3.0:1787367962.645094:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788574208 00000100:00100000:3.0:1787367962.645153:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:3.0:1787367962.645164:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b10a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+20:13202:x1874190788574208:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:3.0:1787367962.645414:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b10a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+21:13202:x1874190788574208:12345-192.168.203.4@tcp:35:umount.0 Request processed in 251us (424us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787367962.645422:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:1.0:1787367962.649141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367962.649337:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788574464 00000100:00100000:3.0:1787367962.649347:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788574464 00000100:00100000:3.0:1787367962.649436:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1787367962.649447:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+21:13202:x1874190788574464:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:3.0:1787367962.649973:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6033427c-dc64-421a-b37f-d4458dbaa527+22:13202:x1874190788574464:12345-192.168.203.4@tcp:35:umount.0 Request processed in 527us (837us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787367962.649982:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:1.0:1787367962.658852:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367962.658966:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367962.659390:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788574720 00000100:00100000:2.0:1787367962.659399:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788574720 00000100:00100000:2.0:1787367962.659480:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788574592 00000100:00100000:2.0:1787367962.659484:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788574592 00000100:00100000:2.0:1787367962.659564:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1787367962.659586:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+14:2405:x1874190788574720:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367962.659603:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367962.659623:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673800/0x66f5679bff0306ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e592 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.659652:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367962.659717:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+13:2405:x1874190788574720:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 144us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367962.659725:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1787367962.659744:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1787367962.659752:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+12:2404:x1874190788574592:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367962.659774:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367962.659783:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68b600/0x66f5679bff03076b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5d1 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.659805:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367962.659825:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:926ebb72-6750-4035-807e-0762300bea95+11:2404:x1874190788574592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 74us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367962.659832:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1787367962.663768:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367962.664114:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788574848 00000100:00100000:0.0:1787367962.664134:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788574848 00000100:00100000:0.0:1787367962.664298:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1787367962.664309:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:926ebb72-6750-4035-807e-0762300bea95+11:2402:x1874190788574848:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367962.664326:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367962.664347:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2175800/0x66f5679bff030986 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6aa expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367962.664383:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367962.664450:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:926ebb72-6750-4035-807e-0762300bea95+10:2402:x1874190788574848:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 143us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367962.664459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1787367962.666885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367962.667708:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788575232 00000100:00100000:2.0:1787367962.667719:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788575232 00000100:00100000:2.0:1787367962.667781:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:2.0:1787367962.667935:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+7:2401:x1874190788575232:12345-192.168.203.4@tcp:9:umount.0 00000020:00000080:2.0:1787367962.667964:0:8453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030cff 00000020:00010000:2.0:1787367962.667973:0:8453:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c5483744800: total 0 00000100:00080000:2.0:1787367962.667978:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c5483746000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787367962.668038:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:3.0:1787367962.668388:0:8468:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c5483744800: total 0 00010000:00010000:3.0:1787367962.668442:0:8468:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c5483744800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787367962.668493:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c72c7fa/0x66f5679bff031786 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea77 expref: 5 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367962.668541:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a75d8b6/0x66f5679bff0310b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e894 expref: 4 pid: 8925 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367962.668572:0:8468:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c5483744800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787367962.668587:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367962.668589:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367962.668591:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367962.668814:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6033427c-dc64-421a-b37f-d4458dbaa527+2:2401:x1874190788575232:12345-192.168.203.4@tcp:9:umount.0 Request processed in 1023us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367962.668824:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00080000:1.0:1787367962.668957:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367962.676193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367962.676618:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788575360 00000100:00100000:2.0:1787367962.676628:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788575360 00000100:00100000:2.0:1787367962.676803:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:2.0:1787367962.676814:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+5:2401:x1874190788575360:12345-192.168.203.4@tcp:9:umount.0 00000020:00000080:2.0:1787367962.676845:0:8451:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030a89 00000100:00080000:2.0:1787367962.676855:0:8451:0:(import.c:65:import_set_state_nolock()) ffff9c5483db7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787367962.676904:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787367962.677065:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6033427c-dc64-421a-b37f-d4458dbaa527+2:2401:x1874190788575360:12345-192.168.203.4@tcp:9:umount.0 Request processed in 253us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367962.677099:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00010000:00010000:0.0:1787367962.677149:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787367962.677913:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367962.686614:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367962.686769:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788576384 00000100:00100000:0.0:1787367962.686778:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788576384 00000100:00100000:0.0:1787367962.686849:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 258 00000100:00100000:0.0:1787367962.686874:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+22:2401:x1874190788576384:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:0.0:1787367962.686904:0:6538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0306bc 00000020:00010000:0.0:1787367962.686922:0:6538:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c548252b800: total 0 00000100:00080000:0.0:1787367962.686926:0:6538:0:(import.c:65:import_set_state_nolock()) ffff9c54830c5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787367962.686956:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1787367962.687118:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6033427c-dc64-421a-b37f-d4458dbaa527+21:2401:x1874190788576384:12345-192.168.203.4@tcp:39:umount.0 Request processed in 245us (515us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1787367962.687133:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 258 00000020:00010000:2.0:1787367962.689289:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c548252b800: total 0 00010000:00010000:2.0:1787367962.689485:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c548252b800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787367962.689914:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367962.689919:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787367962.689929:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b000/0x66f5679bff030d5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e7ad expref: 20 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.689949:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55a01e4200) 00010000:00010000:2.0:1787367962.689951:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367962.689955:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83c00/0x66f5679bff030a04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6bf expref: 19 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.689971:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:2.0:1787367962.689973:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367962.689977:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031667 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea2a expref: 18 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.689988:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367962.689990:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787367962.689993:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff0310a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e88d expref: 17 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690062:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c5483331b00) 00010000:00010000:2.0:1787367962.690065:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367962.690070:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55c2175c00/0x66f5679bff0309e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6b8 expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690104:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:2.0:1787367962.690107:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787367962.690111:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a000/0x66f5679bff03113c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8b7 expref: 15 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690121:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367962.690124:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367962.690127:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff030f98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e847 expref: 14 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690137:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:2.0:1787367962.690139:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787367962.690143:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff031771 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea70 expref: 13 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690153:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c55937a6400) 00010000:00010000:2.0:1787367962.690155:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787367962.690158:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55afa83200/0x66f5679bff030a5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6d4 expref: 12 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690169:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c54824f2500) 00010000:00010000:2.0:1787367962.690171:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367962.690175:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74400/0x66f5679bff031747 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea62 expref: 11 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690187:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c55bc700500) 00010000:00010000:2.0:1787367962.690189:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367962.690682:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff031078 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e87f expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690707:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c54824f2600) 00010000:00010000:2.0:1787367962.690710:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787367962.690715:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241cc00/0x66f5679bff031429 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e990 expref: 9 pid: 9404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690728:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:2.0:1787367962.690731:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367962.690734:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613ac00/0x66f5679bff031120 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e8b0 expref: 8 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367962.690745:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c548252b800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787367962.690770:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367962.690772:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367962.690774:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367962.693243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367962.693323:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788576512 00000100:00100000:2.0:1787367962.693333:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788576512 00000100:00100000:2.0:1787367962.693432:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 259 00000100:00100000:2.0:1787367962.693443:0:15019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6033427c-dc64-421a-b37f-d4458dbaa527+5:2401:x1874190788576512:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:2.0:1787367962.693477:0:15019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0306c3 00000100:00080000:2.0:1787367962.693493:0:15019:0:(import.c:65:import_set_state_nolock()) ffff9c5481bca800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787367962.693522:0:15019:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787367962.693931:0:15019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6033427c-dc64-421a-b37f-d4458dbaa527+3:2401:x1874190788576512:12345-192.168.203.4@tcp:39:umount.0 Request processed in 489us (694us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787367962.693940:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 259 00010000:00010000:3.0:1787367962.694040:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787367962.694273:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787367962.968801:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367963.992594:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367964.752276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367964.752331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787367964.752415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367964.752506:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788576640 00000100:00100000:1.0:1787367964.752517:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788576640 00000100:00100000:1.0:1787367964.752590:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788576896 00000100:00100000:1.0:1787367964.752594:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788576896 00000100:00100000:1.0:1787367964.752637:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788576768 00000100:00100000:1.0:1787367964.752640:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788576768 00000100:00100000:1.0:1787367964.752660:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1787367964.752671:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:926ebb72-6750-4035-807e-0762300bea95+12:2403:x1874190788576640:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367964.752689:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367964.752718:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673e00/0x66f5679bff0307bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5e6 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367964.752738:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367964.752800:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:926ebb72-6750-4035-807e-0762300bea95+11:2403:x1874190788576640:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 131us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367964.752807:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1787367964.752825:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1787367964.752830:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5598cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:926ebb72-6750-4035-807e-0762300bea95+10:2403:x1874190788576896:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367964.752838:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367964.752847:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672400/0x66f5679bff03097f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e6a3 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367964.752856:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367964.752874:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5598cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:926ebb72-6750-4035-807e-0762300bea95+9:2403:x1874190788576896:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 43us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367964.752880:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1787367964.752919:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1787367964.752926:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:926ebb72-6750-4035-807e-0762300bea95+8:2403:x1874190788576768:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367964.752935:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367964.752944:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55afa82c00/0x66f5679bff0307c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e617 expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367964.752960:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367964.752978:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:926ebb72-6750-4035-807e-0762300bea95+7:2403:x1874190788576768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 53us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367964.752985:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1787367964.758718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787367964.758828:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788577152 00000100:00100000:2.0:1787367964.758838:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788577152 00000100:00100000:2.0:1787367964.758906:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 260 00000100:00100000:2.0:1787367964.758916:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+6:2401:x1874190788577152:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:2.0:1787367964.758955:0:9404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0307d4 00000020:00010000:2.0:1787367964.758963:0:9404:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c5483679800: total 0 00000100:00080000:2.0:1787367964.758968:0:9404:0:(import.c:65:import_set_state_nolock()) ffff9c548367b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787367964.758995:0:9404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1787367964.759152:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:376539eb-750a-402c-b2b9-1c135ada549f+5:2401:x1874190788577152:12345-192.168.203.4@tcp:39:umount.0 Request processed in 236us (444us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1787367964.759160:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 260 00000020:00010000:3.0:1787367964.759389:0:8468:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c5483679800: total 0 00010000:00010000:3.0:1787367964.759394:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367964.759443:0:8468:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c5483679800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787367964.759479:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c54824f2b00) 00010000:00010000:3.0:1787367964.759483:0:8468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787367964.759492:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b800/0x66f5679bff031794 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea7e expref: 4 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367964.759513:0:8468:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c5483679800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787367964.759525:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367964.759527:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367964.759528:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787367964.759676:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367964.773668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787367964.773916:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788577280 00000100:00100000:1.0:1787367964.773926:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788577280 00000100:00100000:1.0:1787367964.774009:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 261 00000100:00100000:1.0:1787367964.774019:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+5:2401:x1874190788577280:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:1.0:1787367964.774062:0:6539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0307db 00000100:00080000:1.0:1787367964.774072:0:6539:0:(import.c:65:import_set_state_nolock()) ffff9c548367c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787367964.774103:0:6539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787367964.774273:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:376539eb-750a-402c-b2b9-1c135ada549f+3:2401:x1874190788577280:12345-192.168.203.4@tcp:39:umount.0 Request processed in 255us (616us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787367964.774282:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 261 00010000:00010000:3.0:1787367964.774496:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787367964.774924:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787367964.840205:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787367964.842512:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788577536 00000100:00100000:0.0:1787367964.842527:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788577536 00000100:00100000:0.0:1787367964.842620:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 397 00000100:00100000:0.0:1787367964.842642:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+7:2401:x1874190788577536:12345-192.168.203.4@tcp:251:umount.0 00000020:00000080:0.0:1787367964.842691:0:6530:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030699 00000020:00010000:0.0:1787367964.842698:0:6530:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c548372f800: total 0 00000100:00080000:0.0:1787367964.842702:0:6530:0:(import.c:65:import_set_state_nolock()) ffff9c548372b000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787367964.842800:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:926ebb72-6750-4035-807e-0762300bea95+3:2401:x1874190788577536:12345-192.168.203.4@tcp:251:umount.0 Request processed in 160us (2615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367964.842809:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 397 00000020:00010000:2.0:1787367964.843209:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c548372f800: total 0 00010000:00010000:2.0:1787367964.843271:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c548372f800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787367964.843308:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613bc00/0x66f5679bff030772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2e5d8 expref: 2 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367964.843322:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c548372f800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787367964.843334:0:6527:0:(genops.c:885:class_export_put()) final put ffff9c548372f800/926ebb72-6750-4035-807e-0762300bea95 00010000:00010000:2.0:1787367964.843412:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367964.843414:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367964.843416:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787367964.845596:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548372f800/926ebb72-6750-4035-807e-0762300bea95 for MGS 00000020:00000080:0.0:1787367964.845660:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548372b000 for MGS 00010000:00010000:3.0:1787367965.016649:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367965.595031:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808546432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787367965.595230:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.595537:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808546560:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.595571:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.595595:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808547072:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.595646:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.595665:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808547584:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.595685:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.595706:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787367965.595712:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808546688:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.595731:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.595745:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808547200:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.595762:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.595777:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808547712:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.596309:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.596413:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808546560 00000100:00100000:3.0:1787367965.596421:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808546560 00000100:00100000:2.0:1787367965.596452:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808546432 00000100:00100000:2.0:1787367965.596458:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808546432 00000100:00100000:3.0:1787367965.596474:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1787367965.596485:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808546560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367965.596501:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787367965.596513:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808546432:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367965.596538:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808546560:12345-0@lo:400:kworker.0 Request processed in 53us (965us total) trans 0 rc 0/0 00000004:00000024:2.0:1787367965.596545:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787367965.596549:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1787367965.596594:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808546432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367965.596612:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787367965.596648:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808547072 00000100:00100000:1.0:1787367965.596654:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808547072 00000100:00100000:1.0:1787367965.596688:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808547584 00000100:00080000:2.0:1787367965.596692:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367965.596692:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808547584 00000100:00100000:1.0:1787367965.596709:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808546688 00000100:00100000:1.0:1787367965.596713:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808546688 00000100:00100000:1.0:1787367965.596724:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808547200 00000100:00100000:1.0:1787367965.596727:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808547200 00000100:00100000:1.0:1787367965.596747:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808547712 00000100:00100000:1.0:1787367965.596755:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808547712 00000100:00100000:1.0:1787367965.596774:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787367965.596970:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787367965.596978:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808547584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.597012:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808547584:12345-0@lo:400:kworker.0 Request processed in 35us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367965.597018:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787367965.597033:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1787367965.597039:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808546688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.597063:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808546688:12345-0@lo:400:kworker.0 Request processed in 25us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367965.597075:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787367965.597215:0:15019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808547072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367965.597251:0:15019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808547072:12345-0@lo:400:kworker.0 Request processed in 471us (1605us total) trans 0 rc 0/0 00000100:00080000:2.0:1787367965.597292:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787367965.597311:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787367965.597326:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787367965.597332:0:15019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808547200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367965.597415:0:15019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808547200:12345-0@lo:400:kworker.0 Request processed in 82us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367965.597422:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787367965.597434:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787367965.597441:0:15019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808547712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367965.597467:0:15019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808547712:12345-0@lo:400:kworker.0 Request processed in 27us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367965.597472:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1787367965.597559:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808546816:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.597592:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.597661:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808547328:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.597687:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.597715:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808547840:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.597735:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.597755:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787367965.597762:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808546944:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.597786:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.597800:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808547456:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.597816:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.597830:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808547968:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.597852:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367965.597874:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808547840 00000100:00100000:0.0:1787367965.597874:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808547328 00000100:00100000:3.0:1787367965.597879:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808547840 00000100:00100000:0.0:1787367965.597879:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808547328 00000100:00100000:3.0:1787367965.597908:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808547456 00000100:00100000:0.0:1787367965.597908:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808547968 00000100:00100000:3.0:1787367965.597911:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808547456 00000100:00100000:0.0:1787367965.597911:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808547968 00000100:00100000:3.0:1787367965.597924:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787367965.597930:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808547328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367965.597932:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787367965.597937:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808547840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.597965:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808547328:12345-0@lo:400:kworker.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367965.597965:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808547840:12345-0@lo:400:kworker.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367965.597972:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787367965.597975:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787367965.597985:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787367965.597988:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787367965.597990:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808547456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367965.597993:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808547968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598018:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808547456:12345-0@lo:400:kworker.0 Request processed in 27us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367965.598018:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808547968:12345-0@lo:400:kworker.0 Request processed in 24us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367965.598023:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787367965.598068:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808546816 00000100:00100000:1.0:1787367965.598072:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808546816 00000100:00100000:3.0:1787367965.598209:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787367965.598230:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808546944 00000100:00100000:3.0:1787367965.598233:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808546944 00000100:00100000:3.0:1787367965.598255:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787367965.598261:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55a937c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808546944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598296:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55a937c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808546944:12345-0@lo:400:kworker.0 Request processed in 36us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367965.598301:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1787367965.598607:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787367965.598611:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367965.598661:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808546432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367965.598698:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808546944:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598709:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808547456:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598717:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808547968:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598725:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808547328:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598734:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808547840:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598764:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808546688:0@lo:400:kworker.0 00010000:00080000:3.0:1787367965.598777:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836bb800 x1874190808547200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367965.598788:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808547200:0@lo:400:kworker.0 00010000:00080000:3.0:1787367965.598797:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836b8a80 x1874190808547712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367965.598813:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808547712:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598824:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808546560:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598835:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808547072:0@lo:400:kworker.0 00000100:00100000:3.0:1787367965.598845:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808547584:0@lo:400:kworker.0 00000100:00100000:1.0:1787367965.598949:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787367965.598957:0:15019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808546816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367965.598997:0:15019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808546816:12345-0@lo:400:kworker.0 Request processed in 41us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367965.599003:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787367965.599069:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808546816:0@lo:400:kworker.0 00010000:00010000:3.0:1787367966.040499:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367966.105308:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808548096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367966.105396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367966.105467:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808548096 00000100:00100000:2.0:1787367966.105474:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808548096 00000100:00100000:2.0:1787367966.105514:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787367966.105522:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808548096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787367966.105546:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367966.105588:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808548096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367966.105596:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787367966.105893:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808548096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367966.105951:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808548224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367966.105979:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367966.106016:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808548224 00000100:00100000:2.0:1787367966.106019:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808548224 00000100:00100000:2.0:1787367966.106042:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787367966.106049:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808548224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787367966.106066:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787367966.106100:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808548224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367966.106106:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787367966.106135:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808548224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787367966.114252:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808548352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367966.114318:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367966.115171:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808548352 00000100:00100000:2.0:1787367966.115182:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808548352 00000100:00100000:2.0:1787367966.115236:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787367966.115245:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808548352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367966.115267:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787367966.115321:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808548352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367966.115328:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787367966.116441:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808548352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367966.629004:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808548480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367966.629069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367966.629172:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808548480 00000100:00100000:2.0:1787367966.629179:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808548480 00000100:00100000:2.0:1787367966.629224:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787367966.629233:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808548480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367966.629253:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367966.629939:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808548480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 704us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367966.629948:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787367966.630117:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808548480:0@lo:13:osp-pre-0-0.0 00000020:01000004:1.0:1787367966.754205:0:15171:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787367966.793227:0:15171:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787367966.793281:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.793389:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.793398:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.793405:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.793436:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787367966.793441:0:15171:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787367966.793464:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787367966.793468:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787367966.793473:0:15171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787367966.793494:0:15171:0:(import.c:65:import_set_state_nolock()) ffff9c55a0f17000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787367966.793802:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367966.793811:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367966.793820:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787367966.793823:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367966.793831:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367966.793838:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367966.793844:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787367966.793847:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787367966.793849:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787367966.793875:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367966.793881:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367966.793906:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367966.793913:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a1800/0x66f5679bff030741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367966.793932:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367966.793934:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367966.793935:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367966.793943:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367966.793958:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808548736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367966.794030:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367966.794091:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808548736 00000100:00100000:1.0:1787367966.794097:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808548736 00000100:00100000:3.0:1787367966.794211:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808548608:0@lo:39:umount.0 00000100:00100000:3.0:1787367966.794243:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367966.794275:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808548608 00000100:00100000:3.0:1787367966.794278:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808548608 00000100:00100000:3.0:1787367966.794854:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787367966.794865:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874190808548608:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787367966.794891:0:9404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0302be 00000100:00080000:3.0:1787367966.794899:0:9404:0:(import.c:65:import_set_state_nolock()) ffff9c55c0020800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787367966.794961:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3650:x1874190808548608:12345-0@lo:39:umount.0 Request processed in 98us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367966.794969:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1787367966.794981:0:9404:0:(genops.c:885:class_export_put()) final put ffff9c55c0027000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787367966.795011:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787367966.795036:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55a0f17000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787367966.795045:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808548608:0@lo:39:umount.0 00000020:00000080:3.0:1787367966.795065:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55c0027000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1787367966.795210:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787367966.795214:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787367966.795218:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787367966.796493:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55c0020800 for lustre-MDT0000 00000100:00100000:1.0:1787367966.796761:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787367966.796774:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3654:x1874190808548736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367966.796788:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367966.796807:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68a400/0x66f5679bff030748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff030741 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367966.796823:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367966.796883:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:3654:x1874190808548736:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (2853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367966.796890:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787367966.796936:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808548736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787367966.801486:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801500:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801508:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801514:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801529:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367966.801534:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801539:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801561:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801566:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801581:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787367966.801587:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801594:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801600:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801606:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801624:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787367966.801630:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801636:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801641:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.801656:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367966.803297:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787367966.803306:0:15171:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787367966.803341:0:15171:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787367966.803344:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787367966.803349:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367966.803368:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787367966.803375:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c54832fc800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787367966.803382:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c55a9159000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787367966.803387:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c55ad9de000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787367966.803392:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c55adb24800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787367966.803399:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c5483679800 376539eb-750a-402c-b2b9-1c135ada549f 192.168.203.4@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787367966.803404:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c548252b800 6033427c-dc64-421a-b37f-d4458dbaa527 192.168.203.4@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1787367966.803409:0:15171:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c55912fb370) has exports, disconnecting them 00000020:00080000:2.0:1787367966.803414:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c54832fc800), last request at 1787367965 00000020:00000080:2.0:1787367966.803420:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0305c7 00000100:00080000:2.0:1787367966.803437:0:15171:0:(import.c:65:import_set_state_nolock()) ffff9c54832fa800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787367966.805232:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787367966.805246:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805258:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0200 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367966.805262:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805271:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367966.805278:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367966.805296:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367966.805298:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787367966.805301:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787367966.805340:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805346:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367966.805398:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805405:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03074f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030756 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805418:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787367966.805421:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805426:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174a00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367966.805440:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805446:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367966.805451:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367966.805456:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367966.805458:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787367966.805459:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787367966.805472:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805478:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367966.805492:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805497:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174a00/0x66f5679bff030653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff03065a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805506:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367966.805509:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805514:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367966.805517:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805524:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367966.805536:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367966.805541:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787367966.805543:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787367966.805544:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787367966.805557:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805562:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367966.805568:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805573:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174000/0x66f5679bff0309b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0309be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805581:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367966.805584:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805590:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367966.805592:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805598:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367966.805603:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367966.805626:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367966.805628:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787367966.805630:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787367966.805644:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805650:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367966.805656:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805662:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5580030000/0x66f5679bff03020f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030216 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.805686:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367966.805688:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367966.805690:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367966.805701:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367966.807417:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808549248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367966.807490:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367966.807542:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367966.807548:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808548864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367966.807569:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367966.807595:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808548992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367966.807631:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367966.807651:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367966.807657:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808549120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367966.807677:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367966.807721:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808549248 00000100:00100000:3.0:1787367966.807728:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808549248 00000100:00100000:3.0:1787367966.807765:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808548864 00000100:00100000:3.0:1787367966.807768:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808548864 00000100:00100000:3.0:1787367966.807780:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808548992 00000100:00100000:3.0:1787367966.807783:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808548992 00000100:00100000:3.0:1787367966.807792:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808549120 00000100:00100000:3.0:1787367966.807793:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808549120 00000100:00100000:3.0:1787367966.807806:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787367966.807813:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+26:3653:x1874190808549248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367966.807825:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367966.807843:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55814a1200/0x66f5679bff030216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff03020f expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.807860:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367966.807894:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+25:3653:x1874190808549248:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367966.807901:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787367966.807928:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787367966.807934:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+24:3653:x1874190808548864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367966.807941:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367966.807950:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68a000/0x66f5679bff030756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff03074f expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.807961:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367966.807981:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+23:3653:x1874190808548864:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367966.807987:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787367966.808000:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787367966.808013:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+22:3651:x1874190808548992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367966.808020:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367966.808028:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55afa82600/0x66f5679bff03065a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff030653 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.808036:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367966.808061:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+21:3651:x1874190808548992:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367966.808067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787367966.808080:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367966.808085:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+20:3651:x1874190808549120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367966.808092:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367966.808100:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613ae00/0x66f5679bff0309be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0309b7 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367966.808109:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367966.808128:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f+19:3651:x1874190808549120:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367966.808134:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367966.808164:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808549120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367966.808173:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3651:1874190808548992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367966.808199:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808548864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367966.808207:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3653:1874190808549248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367966.809072:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787367966.811429:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c54832fc800): rc 0 00000020:00000080:2.0:1787367966.811435:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c54832fc800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787367966.811446:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c55a9159000), last request at 1787367965 00000020:00000080:2.0:1787367966.811454:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03049a 00000100:00080000:2.0:1787367966.811466:0:15171:0:(import.c:65:import_set_state_nolock()) ffff9c55a915d000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787367966.811515:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54832fc800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787367966.811561:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54832fa800 for lustre-MDT0000 00010000:00010000:0.0:1787367966.812152:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787367966.812296:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55a9159000): rc 0 00000020:00000080:2.0:1787367966.812306:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55a9159000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787367966.812321:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c55ad9de000), last request at 1787367735 00000020:00000080:2.0:1787367966.812326:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030397 00000100:00080000:2.0:1787367966.812332:0:15171:0:(import.c:65:import_set_state_nolock()) ffff9c55ad9db800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787367966.812376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a9159000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787367966.812409:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55a915d000 for lustre-MDT0000 00010000:00010000:3.0:1787367966.814990:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787367966.815261:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55ad9de000): rc 0 00000020:00000080:2.0:1787367966.815266:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55ad9de000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787367966.815423:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c55adb24800), last request at 1787367735 00000020:00000080:2.0:1787367966.815431:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030358 00000100:00080000:2.0:1787367966.815440:0:15171:0:(import.c:65:import_set_state_nolock()) ffff9c55adb23800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787367966.815488:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787367966.815568:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55ad9de000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787367966.817853:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55ad9db800 for lustre-MDT0000 00000001:00000004:2.0:1787367966.817940:0:15171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1787367966.818021:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55adb24800): rc 0 00000004:00000080:2.0:1787367966.818030:0:15171:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffafad01857ae0 00000100:00080000:2.0:1787367966.818049:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787367966.818053:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1787367966.818198:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787367966.820995:0:15171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787367966.821035:0:15171:0:(import.c:65:import_set_state_nolock()) ffff9c55adb21000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787367966.821099:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808549376:0@lo:39:umount.0 00000100:00100000:3.0:1787367966.821423:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367966.822475:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808549376 00000100:00100000:0.0:1787367966.822485:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808549376 00000100:00100000:0.0:1787367966.822553:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787367966.822563:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874190808549376:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787367966.822596:0:6543:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0303f2 00000100:00080000:0.0:1787367966.822604:0:6543:0:(import.c:65:import_set_state_nolock()) ffff9c55bd4f8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787367966.822638:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1787367966.823014:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787367966.823018:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1787367966.823030:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787367966.823122:0:15171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787367966.823138:0:15171:0:(import.c:65:import_set_state_nolock()) ffff9c5481bcd800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787367966.823459:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367966.829546:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808549504:0@lo:9:umount.0 00000100:00100000:3.0:1787367966.829632:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367966.829858:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3650:x1874190808549376:12345-0@lo:39:umount.0 Request processed in 7294us (8434us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787367966.829884:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787367966.829922:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808549504 00000100:00100000:0.0:1787367966.829940:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808549504 00000100:00100000:0.0:1787367966.829984:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787367966.829992:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874190808549504:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787367966.830018:0:8454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030542 00000100:00080000:0.0:1787367966.830026:0:8454:0:(import.c:65:import_set_state_nolock()) ffff9c55b606f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787367966.830071:0:8454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787367966.830196:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3650:x1874190808549504:12345-0@lo:9:umount.0 Request processed in 204us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367966.830202:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1787367966.830223:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787367966.830563:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787367966.830568:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787367966.830578:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787367966.830854:0:15171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787367966.830876:0:15171:0:(import.c:65:import_set_state_nolock()) ffff9c54832fe000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787367966.830909:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c55912fb370) has no exports 00000100:00080000:3.0:1787367966.832162:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55adb21000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787367966.832172:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808549376:0@lo:39:umount.0 00000100:00100000:1.0:1787367966.832602:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808549632:0@lo:9:umount.0 00000100:00100000:1.0:1787367966.832787:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787367966.832833:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5481bcd800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787367966.832845:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787367966.832847:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787367966.832850:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808549504:0@lo:9:umount.0 00000100:00100000:3.0:1787367966.832968:0:8925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808549632 00000100:00100000:3.0:1787367966.832975:0:8925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808549632 00000100:00100000:3.0:1787367966.833024:0:8925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787367966.833033:0:8925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874190808549632:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787367966.833056:0:8925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030684 00000100:00080000:3.0:1787367966.833064:0:8925:0:(import.c:65:import_set_state_nolock()) ffff9c54830c4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787367966.833106:0:8925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787367966.833233:0:8925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3650:x1874190808549632:12345-0@lo:9:umount.0 Request processed in 200us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367966.833240:0:8925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1787367966.833259:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787367966.834076:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54832fe000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787367966.834093:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787367966.834095:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787367966.834099:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808549632:0@lo:9:umount.0 00000020:00080000:0.0:1787367966.837975:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c55912fb370) has no exports 00000020:00000080:0.0:1787367966.941611:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03026a 00000020:00000080:0.0:1787367966.941729:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55bc4ce800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787367966.941749:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787367966.941901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bc4ce800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787367966.941950:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367966.941960:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787367966.941964:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c55b8aa8000) has no exports 00000020:00000080:2.0:1787367966.942401:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030263 00000020:00000080:2.0:1787367966.942407:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55bc4ce000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787367966.942470:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787367966.942477:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787367966.942480:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c559840e800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787367966.942483:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff9c559840e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787367966.942489:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787367966.942894:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bc4ce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787367967.071270:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787367968.025039:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787367968.088970:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787367968.675738:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787367968.675753:0:8447:0:(genops.c:885:class_export_put()) final put ffff9c55b606f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787367968.675779:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:2.0:1787367968.675781:0:8447:0:(genops.c:885:class_export_put()) final put ffff9c5483db3000/6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:0.0:1787367968.675873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b606f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787367968.675927:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483db3000/6033427c-dc64-421a-b37f-d4458dbaa527 for lustre-OST0000 00000020:00000080:0.0:1787367968.675946:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55b606f000 for lustre-OST0000 00000020:00000080:0.0:1787367968.675950:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5483db7800 for lustre-OST0000 00000001:00100000:3.0:1787367968.676333:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787367968.676342:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1787367968.676345:0:7470:0:(genops.c:885:class_export_put()) final put ffff9c55bd40d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787367968.676384:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 376539eb-750a-402c-b2b9-1c135ada549f 00000001:00080000:3.0:1787367968.676613:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1787367968.676617:0:7470:0:(genops.c:885:class_export_put()) final put ffff9c548367e000/376539eb-750a-402c-b2b9-1c135ada549f 00000001:00100000:3.0:1787367968.676638:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000001:00080000:3.0:1787367968.676643:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1787367968.676645:0:7470:0:(genops.c:885:class_export_put()) final put ffff9c55ad9dd000/6033427c-dc64-421a-b37f-d4458dbaa527 00000001:00100000:1.0:1787367968.676731:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787367968.676735:0:9534:0:(genops.c:885:class_export_put()) final put ffff9c54830c2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787367968.676742:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:1.0:1787367968.676744:0:9534:0:(genops.c:885:class_export_put()) final put ffff9c5483744800/6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:0.0:1787367968.676874:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd40d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787367968.676926:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548367e000/376539eb-750a-402c-b2b9-1c135ada549f for lustre-MDT0001 00000020:00000080:0.0:1787367968.676949:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55ad9dd000/6033427c-dc64-421a-b37f-d4458dbaa527 for lustre-MDT0001 00000020:00000080:0.0:1787367968.676982:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54830c2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787367968.676998:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483744800/6033427c-dc64-421a-b37f-d4458dbaa527 for lustre-OST0001 00000020:00000080:0.0:1787367968.677013:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55bd4f8000 for lustre-MDT0001 00000020:00000080:0.0:1787367968.677018:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548367c000 for lustre-MDT0001 00000020:00000080:0.0:1787367968.677022:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5481bca800 for lustre-MDT0001 00000020:00000080:0.0:1787367968.677025:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54830c4800 for lustre-OST0001 00000020:00000080:0.0:1787367968.677028:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5483746000 for lustre-OST0001 00000001:00100000:2.0:1787367968.677252:0:6517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787367968.677257:0:6517:0:(genops.c:885:class_export_put()) final put ffff9c55adb24800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787367968.677313:0:6517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 376539eb-750a-402c-b2b9-1c135ada549f 00000001:00080000:2.0:1787367968.677319:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1787367968.677322:0:6517:0:(genops.c:885:class_export_put()) final put ffff9c5483679800/376539eb-750a-402c-b2b9-1c135ada549f 00000020:00000080:1.0:1787367968.681208:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55adb24800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787367968.681336:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55adb23800 for lustre-MDT0000 00000001:00100000:2.0:1787367968.681449:0:6517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6033427c-dc64-421a-b37f-d4458dbaa527 00000001:00080000:2.0:1787367968.681458:0:6517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787367968.681468:0:6517:0:(genops.c:885:class_export_put()) final put ffff9c548252b800/6033427c-dc64-421a-b37f-d4458dbaa527 00000020:00000080:1.0:1787367968.681661:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483679800/376539eb-750a-402c-b2b9-1c135ada549f for lustre-MDT0000 00000020:00000080:1.0:1787367968.681688:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548252b800/6033427c-dc64-421a-b37f-d4458dbaa527 for lustre-MDT0000 00000020:00000080:1.0:1787367968.681714:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548367b000 for lustre-MDT0000 00000020:00000080:1.0:1787367968.681718:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54830c5800 for lustre-MDT0000 00000020:01000000:2.0:1787367968.989999:0:15171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5481b0f840 - data ffff9c55b1723ca8/ffff9c55bd791800 00000020:01000000:2.0:1787367968.990210:0:15171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5590d815a0 - data ffff9c55b14e26c0/ffff9c55bc66a400 00000001:00000004:2.0:1787367969.000286:0:15171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1787367969.056073:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787367969.056081:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787367969.056096:0:15171:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c5482623800 x1874190808549376/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787367976 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367969.056117:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787367969.059399:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787367969.059406:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1787367969.059428:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787367969.059431:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787367969.064108:0:8919:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787367969.064114:0:8919:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787367969.064124:0:8919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787367969.065188:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787367969.065194:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1787367969.065204:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787367969.065206:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787367969.065840:0:10006:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787367969.065844:0:10006:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787367969.065853:0:10006:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787367969.067946:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030232 00000020:00000080:1.0:1787367969.067957:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55b12c5000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787367969.070738:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030247 00000020:00000080:1.0:1787367969.070855:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55c0023000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787367969.070970:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787367969.071044:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787367969.071078:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55c0023000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787367969.071089:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367969.071095:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787367969.071099:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c55912f99b8) has no exports 00000004:01000000:1.0:1787367969.071336:0:15171:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787367969.071344:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03067d 00000020:00000080:1.0:1787367969.071349:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c548367c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787367969.071571:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787367969.071581:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367969.071605:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787367969.071608:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9c5482773370) has no exports 00000020:00000080:1.0:1787367969.071614:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030676 00000020:00000080:1.0:1787367969.071618:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c54832ff800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787367969.071681:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548367c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1787367969.072169:0:15171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787367969.072173:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787367969.072177:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1787367969.072182:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787367969.072184:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787367969.072213:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54832ff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787367969.072289:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787367969.072298:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787367969.072304:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03053b 00000020:00000080:1.0:1787367969.072308:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c548252f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787367969.072498:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54832fe000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787367969.072504:0:8:0:(genops.c:885:class_export_put()) final put ffff9c548335f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787367969.072506:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548335f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787367969.072510:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787367969.072696:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787367969.072701:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367969.072706:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787367969.072709:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9c55bd6d8000) has no exports 00000020:00000080:1.0:1787367969.072714:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030534 00000020:00000080:1.0:1787367969.072718:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c5481bcc000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787367969.072738:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548252f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787367969.073165:0:15171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787367969.073168:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787367969.073170:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1787367969.073173:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787367969.073175:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787367969.073202:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5481bcc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787367969.073277:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787367969.073283:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787367969.073294:0:15171:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787367969.073299:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0303eb 00000020:00000080:1.0:1787367969.073303:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55bd409000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787367969.073490:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5481bcd800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787367969.073499:0:8:0:(genops.c:885:class_export_put()) final put ffff9c5481bcb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787367969.073501:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5481bcb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787367969.073506:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787367969.073618:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787367969.073622:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367969.073633:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787367969.073637:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c55bc5e4d28) has no exports 00000020:00000080:1.0:1787367969.073641:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0303e4 00000020:00000080:1.0:1787367969.073644:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55adb20000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787367969.073712:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd409000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787367969.074064:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55adb20000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787367969.076423:0:15171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787367969.076491:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787367969.076495:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787367969.076503:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787367969.076564:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787367969.076659:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55adb21000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787367969.076694:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787367969.076699:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55bd409800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787367969.076702:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd409800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787367969.076709:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787367969.076812:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367969.076815:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787367969.076818:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55b12c4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787367969.076820:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787367969.076823:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787367969.076868:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03024e 00000020:00000080:0.0:1787367969.076873:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55c0021800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787367969.076908:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787367969.076912:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367969.076916:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787367969.076920:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c55912f8000) has no exports 00000020:00000080:0.0:1787367969.076936:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367969.076938:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787367969.076942:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030255 00000020:00000080:0.0:1787367969.076945:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55c0024800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787367969.077062:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55c0021800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787367969.077066:0:8:0:(genops.c:885:class_export_put()) final put ffff9c55b12c0000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787367969.077068:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787367969.077075:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1787367969.077170:0:15171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55834d5000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787367969.077174:0:15171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55834d5000 3 00000020:01000004:0.0:1787367969.077176:0:15171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c55834d5000 from lustre-MDT0000 00000020:00000080:0.0:1787367969.077191:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367969.077195:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787367969.077197:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55b12c3800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787367969.077199:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787367969.077213:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787367969.077240:0:15171:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787367969.077244:0:15171:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787367969.077246:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787367969.077248:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367969.077250:0:15171:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787367969.077256:0:15171:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c55b1108800 c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787367969.077261:0:15171:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c559124b370) has exports, disconnecting them 00000020:00080000:0.0:1787367969.077264:0:15171:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c55b1108800), last request at 1787367717 00000020:00000080:0.0:1787367969.077286:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0301f3 00000020:00010000:0.0:1787367969.077289:0:15171:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c55b1108800: total 1 00000100:00080000:0.0:1787367969.077292:0:15171:0:(import.c:65:import_set_state_nolock()) ffff9c55b110d800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787367969.077307:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55b1108800): rc 0 00000020:00080000:0.0:1787367969.077310:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c559124b370) has no exports 00000020:00010000:3.0:1787367969.077317:0:6526:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c55b1108800: total 1 00010000:00010000:3.0:1787367969.077351:0:6526:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c55b1108800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787367969.077410:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff030710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff030709 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077494:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68b000/0x66f5679bff03071e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff030717 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077509:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55afa83600/0x66f5679bff03072c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff030725 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077520:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55814a0400/0x66f5679bff03073a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff030733 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077531:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55c2175e00/0x66f5679bff0302ef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0302e8 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077545:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68b200/0x66f5679bff0302fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0302f6 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077556:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613ba00/0x66f5679bff030994 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff03098d expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077566:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55afa82200/0x66f5679bff030702 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0306fb expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077576:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5580031a00/0x66f5679bff0309b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0309a9 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077606:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673600/0x66f5679bff030614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff03060d expref: 5 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077619:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68bc00/0x66f5679bff030764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff03075d expref: 4 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077628:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672c00/0x66f5679bff0306f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0306ed expref: 3 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077639:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5580031400/0x66f5679bff0309a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff03099b expref: 2 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367969.077649:0:6526:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c55b1108800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787367969.077663:0:6526:0:(genops.c:885:class_export_put()) final put ffff9c55b1108800/c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f 00010000:00010000:3.0:1787367969.077669:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367969.077671:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367969.077673:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787367969.077687:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55c0024800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787367969.077693:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b1108800/c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f for MGS 00000100:00100000:3.0:1787367969.077703:0:6533:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c558673a000:6533] 2 exiting: rc = 0 00000020:00000080:2.0:1787367969.077718:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55b110d800 for MGS 00000100:00100000:3.0:1787367969.077793:0:6532:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c558673be00:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1787367969.077838:0:6530:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c558673b000:6530] 0 exiting: rc = 1 00000100:00100000:0.0:1787367969.077943:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.077964:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.077970:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.077975:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.077982:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.077988:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.077994:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.077999:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078005:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078010:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078015:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078020:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078025:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078030:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078035:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078040:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078045:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078049:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078055:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078066:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078071:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078076:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078081:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078086:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078091:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078096:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078101:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078106:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078111:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078116:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078121:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078125:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078132:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078137:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078143:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078147:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078152:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078157:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078162:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078167:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078172:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078176:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078181:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078185:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078190:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078194:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078199:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078204:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078208:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078212:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078217:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078221:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078225:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078230:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078239:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078243:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078248:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078253:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078257:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078262:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078324:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078330:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078335:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367969.078340:0:15171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787367969.080172:0:15171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c548324a060 - data ffff9c55b17311b0/ffff9c54835c3c00 00000020:01000000:0.0:1787367969.082463:0:15171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c55882aa960 - data ffff9c55b14621b0/ffff9c55bb61a400 00000020:00000080:0.0:1787367969.083966:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0301d7 00000020:00000080:0.0:1787367969.083977:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55b88ed800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787367969.083998:0:15171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55834d5000 from MGS, refs=2 00000020:01000004:0.0:1787367969.084001:0:15171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55834d5000 2 00000020:01000004:0.0:1787367969.084004:0:15171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c55834d5000 from MGS 00000020:00000080:1.0:1787367969.084016:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b88ed800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787367969.084026:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367969.084032:0:15171:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787367969.084035:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55b88ed000/MGS 00000020:00000080:0.0:1787367969.084037:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b88ed000/MGS for MGS 00000020:01000000:0.0:1787367969.084045:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787367969.084322:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787367969.084327:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367969.084333:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787367969.084340:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c55bc509800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787367969.084345:0:15171:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9c55bc5e19b8) has exports, disconnecting them 00000020:00080000:1.0:1787367969.084351:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c55bc509800), last request at 1787367717 00000020:00000080:1.0:1787367969.084378:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0302a2 00000020:00080000:1.0:1787367969.084391:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55bc509800): rc 0 00000020:00000080:1.0:1787367969.084396:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55bc509800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787367969.084474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bc509800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787367969.088415:0:15171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787367969.088423:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787367969.088427:0:15171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787367969.088433:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787367969.088507:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55a0f17000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787367969.088771:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367969.088780:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787367969.088785:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55a0f15800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787367969.088789:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a0f15800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787367969.088798:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787367969.088895:0:15171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55834d5000 1 00000020:00000080:0.0:1787367969.088910:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0301c9 00000020:00000080:0.0:1787367969.088917:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55b88e8800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787367969.088925:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787367969.088928:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367969.088933:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787367969.088936:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c55b8aa99b8) has no exports 00000020:00000080:2.0:1787367969.089121:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b88e8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787367969.113472:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787367969.126294:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787367969.126305:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787367969.126311:0:15171:0:(genops.c:885:class_export_put()) final put ffff9c55834d3800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787367969.126315:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55834d3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787367969.126320:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787367969.126617:0:15171:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c55834d7000 00000020:02000400:2.0:1787367969.126675:0:15171:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787367970.137874:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367970.715931:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808549760:0@lo:400:kworker.0 00000400:00000100:1.0:1787367970.715980:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190808549760 offset 0 length 224: 4 00000100:00100000:1.0:1787367970.716023:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808550272:0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716055:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367970.716074:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808550784:0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716097:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367970.716118:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787367970.716124:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808550144:0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716142:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367970.716156:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808550656:0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716174:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367970.716201:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808549888:0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716232:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367970.716250:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808550400:0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716267:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367970.716283:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787367970.716288:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808550016:0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716306:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367970.716320:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808550528:0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716339:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367970.716384:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808550272 00000100:00100000:1.0:1787367970.716403:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808550272 00000100:00100000:1.0:1787367970.716449:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808550144 00000100:00100000:1.0:1787367970.716453:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808550144 00000100:00100000:1.0:1787367970.716461:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808550656 00000100:00100000:1.0:1787367970.716463:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808550656 00000100:00100000:1.0:1787367970.716474:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808550016 00000100:00100000:1.0:1787367970.716477:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808550016 00000100:00100000:1.0:1787367970.716483:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808550528 00000100:00100000:1.0:1787367970.716485:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808550528 00000100:00100000:1.0:1787367970.716496:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787367970.716515:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808550272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716566:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808550272:12345-0@lo:400:kworker.0 Request processed in 61us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367970.716573:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787367970.716600:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787367970.716606:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808550656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716629:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808550656:12345-0@lo:400:kworker.0 Request processed in 24us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367970.716635:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787367970.716651:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787367970.716655:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1874190808550144:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787367970.716660:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787367970.716679:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1874190808550144:12345-0@lo:400:kworker.0 Request processed in 24us (537us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787367970.716684:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787367970.716692:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787367970.716695:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1874190808550016:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787367970.716698:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787367970.716720:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1874190808550016:12345-0@lo:400:kworker.0 Request processed in 23us (413us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787367970.716725:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787367970.716735:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787367970.716739:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1874190808550528:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787367970.716744:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787367970.716763:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1874190808550528:12345-0@lo:400:kworker.0 Request processed in 22us (423us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787367970.716768:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787367970.716786:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808550784 00000100:00100000:1.0:1787367970.716789:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808550784 00000100:00100000:1.0:1787367970.716814:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808550400 00000100:00100000:1.0:1787367970.716817:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808550400 00000100:00100000:1.0:1787367970.716834:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787367970.716840:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808550784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716867:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808550784:12345-0@lo:400:kworker.0 Request processed in 28us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367970.716873:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787367970.716883:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787367970.716896:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808550400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.716922:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808550400:12345-0@lo:400:kworker.0 Request processed in 28us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367970.716928:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787367970.716951:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808549888 00000100:00100000:1.0:1787367970.716955:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808549888 00000100:00100000:1.0:1787367970.716974:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787367970.716979:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1874190808549888:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787367970.716982:0:6544:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787367970.717006:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1874190808549888:12345-0@lo:400:kworker.0 Request processed in 26us (774us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787367970.717011:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1787367970.717035:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367970.717039:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367970.717041:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787367970.717071:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787367970.717076:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c55bd40c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787367970.717080:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787367970.719714:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787367970.719722:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787367970.719726:0:3654:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787367970.719731:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787367970.719735:0:3654:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 210 00000100:00080000:0.0:1787367970.719743:0:3654:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c5481b9a000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787367970.719779:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b6040700 x1874190808550912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787367970.719808:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808550144:0@lo:400:kworker.0 00010000:00080000:0.0:1787367970.719822:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c5483c4e680 x1874190808550656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367970.719832:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808550656:0@lo:400:kworker.0 00010000:00080000:0.0:1787367970.719842:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c5483711180 x1874190808550272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367970.719849:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808550272:0@lo:400:kworker.0 00000100:00100000:0.0:1787367970.719860:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808550784:0@lo:400:kworker.0 00000100:00100000:0.0:1787367970.719890:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808550912:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787367970.719952:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367970.719995:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808550912 00000100:00100000:0.0:1787367970.720000:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808550912 00000100:00100000:0.0:1787367970.720031:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787367970.720038:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808550912:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1787367970.720056:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787367970.720093:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808550912:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 55us (142us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787367970.720100:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1787367970.720123:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787367970.720126:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787367970.720129:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808550912:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787367970.721164:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367970.721180:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808551040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787367970.721224:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367970.721303:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808551040 00000100:00100000:2.0:1787367970.721309:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808551040 00000100:00100000:2.0:1787367970.721345:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787367970.721351:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874190808551040:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787367970.721377:0:6543:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787367970.721424:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874190808551040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (199us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787367970.721431:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:02020000:2.0:1787367970.721460:0:3652:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787367970.727838:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c55bd40c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367970.727847:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 192 00000100:00080000:1.0:1787367970.727857:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c55bd40c000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787367970.727918:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4f100 x1874190808551168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367970.727958:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808550016:0@lo:400:kworker.0 00000100:00080000:1.0:1787367970.727994:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787367970.727997:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c5483358800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787367970.728008:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787367970.728013:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c5483358800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367970.728016:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 230 00000100:00080000:1.0:1787367970.728021:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c5483358800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787367970.728037:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4c000 x1874190808551296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367970.728047:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808550528:0@lo:400:kworker.0 00000100:00080000:1.0:1787367970.728062:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787367970.728065:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c559840a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787367970.728068:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787367970.728072:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c559840a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367970.728075:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 192 00000100:00080000:1.0:1787367970.728079:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c559840a800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787367970.728090:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4df80 x1874190808551424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367970.728100:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808549888:0@lo:400:kworker.0 00000100:00100000:1.0:1787367970.728120:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808550400:0@lo:400:kworker.0 00000100:00100000:3.0:1787367970.731649:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808551168:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787367970.731726:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367970.731766:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808551296:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787367970.731788:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367970.731810:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808551424:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787367970.731832:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367970.731872:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808551168 00000100:00100000:3.0:1787367970.731879:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808551168 00000100:00100000:3.0:1787367970.731910:0:9404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808551296 00000100:00100000:3.0:1787367970.731913:0:9404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808551296 00000100:00100000:3.0:1787367970.731933:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787367970.731940:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874190808551168:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787367970.731958:0:9404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787367970.731998:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874190808551168:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 57us (272us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787367970.732005:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787367970.732020:0:9404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787367970.732025:0:9404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874190808551296:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787367970.732034:0:9404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787367970.732057:0:9404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874190808551296:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (268us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787367970.732063:0:9404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787367970.732082:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808551424 00000100:00100000:3.0:1787367970.732086:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808551424 00000100:00100000:3.0:1787367970.732104:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787367970.732109:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874190808551424:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787367970.732128:0:7862:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787367970.732151:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874190808551424:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 41us (318us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787367970.732156:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:3.0:1787367970.732190:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bd40c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787367970.732195:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787367970.732198:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808551168:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1787367970.732207:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5483358800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787367970.732210:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787367970.732212:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808551296:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1787367970.732219:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c559840a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787367970.732222:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787367970.732224:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808551424:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787367970.752303:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787367970.752310:0:3652:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c559840a800 already not connected (conn 2, was 1): DISCONN 00010000:00010000:0.0:1787367971.164534:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367971.226764:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808551552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367971.226996:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367971.227077:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808551680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787367971.227099:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367971.227129:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808551552 00000100:00100000:2.0:1787367971.227136:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808551552 00000100:00100000:2.0:1787367971.227174:0:13832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808551680 00000100:00100000:2.0:1787367971.227177:0:13832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808551680 00000100:00100000:2.0:1787367971.227191:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787367971.227199:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808551552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787367971.227230:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787367971.227273:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808551552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367971.227280:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787367971.227297:0:13832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787367971.227303:0:13832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808551680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787367971.227316:0:13832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787367971.227345:0:13832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808551680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367971.227351:0:13832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787367971.227418:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808551552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787367971.227445:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808551680:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1787367971.985851:0:15372:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787367972.014484:0:15372:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787367972.014532:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367972.014546:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367972.014553:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367972.014560:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367972.014603:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787367972.014609:0:15372:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787367972.014632:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367972.014637:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367972.014644:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a200 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787367972.014647:0:8468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367972.014656:0:8468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367972.014663:0:8468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367972.014668:0:8468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367972.014671:0:8468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787367972.014673:0:8468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787367972.014706:0:8468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367972.014712:0:8468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367972.014751:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367972.014758:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a200/0x66f5679bff030725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff03072c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367972.014769:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367972.014776:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367972.014778:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367972.014798:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808551808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367972.014863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367972.014928:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808551808 00000100:00100000:3.0:1787367972.014935:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808551808 00000100:00100000:3.0:1787367972.014969:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787367972.014977:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5598cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3654:x1874190808551808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787367972.014983:0:6525:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787367972 with bad export cookie 7418949880858739187 00000100:00080000:1.0:1787367972.018822:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787367972.018832:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787367972.018839:0:15372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787367972.018845:0:15372:0:(import.c:65:import_set_state_nolock()) ffff9c55bd40c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787367972.018851:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787367972.018853:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787367972.018869:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787367972.020803:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020821:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020829:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020836:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020857:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367972.020864:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020871:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020877:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020882:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020955:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787367972.020963:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020970:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020989:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.020996:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367972.029769:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5598cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3654:x1874190808551808:12345-0@lo:103:ldlm_bl.0 Request processed in 14783us (14898us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787367972.029784:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787367972.029857:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787367972.029862:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9c55b110b800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787367972.029866:0:3654:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787367972.031140:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787367972.031153:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.031163:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82400 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367972.031167:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.031190:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367972.031197:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367972.031202:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787367972.031205:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1787367972.034494:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367972.034508:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367972.034520:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83400 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787367972.034524:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367972.036892:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367972.036904:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367972.036910:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787367972.036928:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787367972.036931:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787367972.037012:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367972.037025:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.037033:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.037040:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.037046:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367972.037056:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787367972.037059:0:15372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1787367972.037062:0:15372:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1787367972.037101:0:15372:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1787367972.037105:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1787367972.037109:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367972.037114:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787367972.037121:0:15372:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c54832fe800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787367972.037126:0:15372:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c548252d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787367972.037139:0:15372:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9c55b5540000) has exports, disconnecting them 00000020:00080000:1.0:1787367972.037143:0:15372:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c54832fe800), last request at 1787367970 00000020:00000080:1.0:1787367972.037150:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0305d5 00000100:00080000:1.0:1787367972.037167:0:15372:0:(import.c:65:import_set_state_nolock()) ffff9c54832ff000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787367972.037214:0:15372:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c54832fe800): rc 0 00000020:00000080:1.0:1787367972.037217:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c54832fe800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1787367972.037227:0:15372:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c548252d800), last request at 1787367970 00000020:00000080:1.0:1787367972.037230:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0304af 00000100:00080000:1.0:1787367972.037234:0:15372:0:(import.c:65:import_set_state_nolock()) ffff9c548252c000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787367972.037243:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54832fe800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1787367972.037290:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54832ff000 for lustre-MDT0001 00000020:00080000:1.0:1787367972.037301:0:15372:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c548252d800): rc 0 00000020:00000080:1.0:1787367972.037303:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c548252d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1787367972.037313:0:15372:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffafad01c6fae0 00000020:00000080:1.0:1787367972.037322:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548252d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787367972.037341:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548252c000 for lustre-MDT0001 00000100:00080000:1.0:1787367972.037378:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787367972.037386:0:15372:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9c5482623800 x1874190808551040/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787367986 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367972.037402:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1787367972.038173:0:15372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787367972.038179:0:15372:0:(import.c:65:import_set_state_nolock()) ffff9c559840a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787367972.038895:0:3654:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787367972.038899:0:3654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787367972.038906:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c5483712680 x1874190808549760/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787367986 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367972.038919:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c548278f800 x1874190808551808/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787367988 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787367972.038927:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787367972.038930:0:3654:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787367972.038931:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1787367972.039709:0:6526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.039720:0:6526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367972.039848:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.039858:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa82400/0x66f5679bff030733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff03073a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.039878:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367972.039883:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.039890:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55c2174600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367972.039894:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.039903:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367972.039909:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367972.039928:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787367972.039931:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787367972.039933:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787367972.039944:0:6526:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00010000:00010000:2.0:1787367972.039947:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.039955:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55c2174600/0x66f5679bff0309a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0309b0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.039966:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367972.039969:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.039974:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367972.039976:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.039982:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367972.039988:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367972.039992:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787367972.039994:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787367972.039996:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787367972.040001:0:6526:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00010000:00010000:2.0:1787367972.040004:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.040016:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff0302f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0302fd expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367972.040031:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367972.040033:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367972.040035:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367972.040055:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808551040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787367972.040083:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367972.040090:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:0:1874190808551936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367972.040257:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367972.040265:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367972.040288:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367972.040296:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa83400/0x66f5679bff03060d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff030614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367972.040308:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367972.040309:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367972.040311:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367972.040317:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367972.040325:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:0:1874190808552064:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787367972.040866:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9c55b110b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787367972.040873:0:3654:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 174 00000100:00080000:3.0:1787367972.040879:0:3654:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c55b110b800 using connection 192.168.203.104@tcp/0@lo 00010000:00010000:3.0:1787367972.040889:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367972.041057:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c548278f480 x1874190808552192/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787367972.041091:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808549760:0@lo:400:kworker.0 00000100:00100000:3.0:1787367972.041107:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3654:1874190808551808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367972.041169:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3650:1874190808552192:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1787367972.041210:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190808552192 offset 0 length 520: 4 00000100:00080000:1.0:1787367972.042277:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787367972.042283:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1787367972.042334:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787367972.042421:0:15372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787367972.042437:0:15372:0:(import.c:65:import_set_state_nolock()) ffff9c55b606c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787367972.042459:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787367972.042461:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1787367972.042471:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787367972.042532:0:15372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787367972.042540:0:15372:0:(import.c:65:import_set_state_nolock()) ffff9c548252c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787367972.042561:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c55b5540000) has no exports 00000100:00100000:3.0:1787367972.042683:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808552320:0@lo:9:umount.0 00000100:00100000:3.0:1787367972.042848:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367972.042883:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808552448:0@lo:9:umount.0 00000100:00100000:3.0:1787367972.042906:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367972.042938:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808552320 00000100:00100000:3.0:1787367972.042944:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808552320 00000100:00100000:3.0:1787367972.042988:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808552448 00000100:00100000:3.0:1787367972.042991:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808552448 00000100:00100000:3.0:1787367972.043011:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787367972.043020:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874190808552320:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787367972.043042:0:8453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03050a 00000100:00080000:3.0:1787367972.043049:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c55a94e2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787367972.043084:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787367972.043198:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3650:x1874190808552320:12345-0@lo:9:umount.0 Request processed in 178us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367972.043207:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787367972.043220:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787367972.043227:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874190808552448:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787367972.043236:0:8453:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03063e 00000100:00080000:3.0:1787367972.043241:0:8453:0:(import.c:65:import_set_state_nolock()) ffff9c54830c0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787367972.043259:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787367972.043323:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3650:x1874190808552448:12345-0@lo:9:umount.0 Request processed in 96us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367972.043336:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1787367972.043374:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367972.043378:0:6534:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787367972.043408:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55b606c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1787367972.043541:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367972.044188:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787367972.044232:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787367972.044236:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787367972.044241:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808552320:0@lo:9:umount.0 00000100:00080000:3.0:1787367972.044260:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548252c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787367972.044334:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787367972.044539:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787367972.044544:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808552448:0@lo:9:umount.0 00000020:00080000:1.0:1787367972.053332:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c55b5540000) has no exports 00000020:01000000:2.0:1787367972.152452:0:15372:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5481b0fea0 - data ffff9c55b171c870/ffff9c55bd790000 00000020:01000000:2.0:1787367972.152616:0:15372:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c55adafd000 - data ffff9c55b1595e58/ffff9c55bd4a8c00 00000001:00000004:2.0:1787367972.167268:0:15372:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:3.0:1787367972.184658:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787367972.228321:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787367972.228329:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787367972.228338:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787367972.230716:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787367972.230733:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1787367972.230757:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787367972.230759:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787367972.231176:0:8912:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787367972.231181:0:8912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1787367972.231190:0:8912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787367972.233234:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787367972.233241:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787367972.233262:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787367972.233265:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787367972.234425:0:10002:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787367972.234431:0:10002:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1787367972.234444:0:10002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787367972.237044:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030319 00000020:00000080:2.0:1787367972.237056:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55c0021000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787367972.237528:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55c0021000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787367972.240274:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03032e 00000020:00000080:2.0:1787367972.240292:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55b12c6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787367972.240415:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787367972.240420:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367972.240428:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787367972.240432:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c55b8aacd28) has no exports 00000004:01000000:2.0:1787367972.240595:0:15372:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787367972.240603:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030637 00000020:00000080:2.0:1787367972.240608:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c548335a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787367972.241190:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787367972.246966:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787367972.246982:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367972.246997:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787367972.247001:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9c54826b99b8) has no exports 00000020:00000080:2.0:1787367972.247011:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030630 00000020:00000080:2.0:1787367972.247019:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55a94e1800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1787367972.247404:0:15372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787367972.247408:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787367972.247412:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1787367972.247417:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787367972.247419:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787367972.247451:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787367972.247458:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787367972.247466:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0304f5 00000020:00000080:2.0:1787367972.247470:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55b6069000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787367972.247474:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787367972.247477:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367972.247481:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787367972.247483:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9c55912499b8) has no exports 00000020:00000080:2.0:1787367972.247487:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0304ee 00000020:00000080:2.0:1787367972.247490:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55bd4fd000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787367972.248221:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548335a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787367972.248232:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a94e1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787367972.248250:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548252c800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787367972.248256:0:36:0:(genops.c:885:class_export_put()) final put ffff9c54832fd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787367972.248258:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54832fd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787367972.248262:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787367972.248334:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b6069000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787367972.248339:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd4fd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787367972.248521:0:15372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787367972.248525:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787367972.248529:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1787367972.248538:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787367972.248540:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787367972.248587:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787367972.248595:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1787367972.248608:0:15372:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787367972.248615:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030351 00000020:00000080:2.0:1787367972.248621:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55a9158800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787367972.248625:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1787367972.248628:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367972.248632:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787367972.248635:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c5591248000) has no exports 00000020:00000080:2.0:1787367972.248639:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03034a 00000020:00000080:2.0:1787367972.248643:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c559840c800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787367972.250102:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55b606c000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787367972.250114:0:36:0:(genops.c:885:class_export_put()) final put ffff9c5481b98800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787367972.250117:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5481b98800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787367972.250122:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787367972.250184:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a9158800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787367972.250189:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c559840c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787367972.330458:0:15372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787367972.330471:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787367972.330476:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787367972.330484:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787367972.330525:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367972.330534:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787367972.330563:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367972.330565:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787367972.330569:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55bc508800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787367972.330573:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bc508800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787367972.330603:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c559840a800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787367972.330609:0:36:0:(genops.c:885:class_export_put()) final put ffff9c55a94e4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787367972.330611:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a94e4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787367972.330619:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787367972.330795:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787367972.331002:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030335 00000020:00000080:1.0:1787367972.331009:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55b12c7800/lustre-MDD0001_UUID 00000020:01000000:1.0:1787367972.331047:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787367972.331051:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367972.331056:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787367972.331060:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9c55b5544d28) has no exports 00000020:00000080:1.0:1787367972.331082:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787367972.331085:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787367972.331089:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03033c 00000020:00000080:1.0:1787367972.331093:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55b12c3000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787367972.331136:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c7800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1787367972.331140:0:36:0:(genops.c:885:class_export_put()) final put ffff9c55b12c6800/lustre-MDD0001_UUID 00000020:00000080:0.0:1787367972.331142:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c6800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1787367972.331146:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:1.0:1787367972.331372:0:15372:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bc6be800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787367972.331376:0:15372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bc6be800 2 00000020:01000004:1.0:1787367972.331380:0:15372:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c55bc6be800 from lustre-MDT0001 00000020:00000080:1.0:1787367972.331423:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787367972.331427:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787367972.331430:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55c0026000/lustre-MDT0001_UUID 00000020:00000080:1.0:1787367972.331432:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55c0026000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787367972.331438:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787367972.331466:0:15372:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787367972.331469:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787367972.331480:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367972.331483:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787367972.331489:0:15372:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c55bd40f000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787367972.331493:0:15372:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9c55bc5e0000) has exports, disconnecting them 00000020:00080000:1.0:1787367972.331497:0:15372:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c55bd40f000), last request at 1787367735 00000020:00000080:1.0:1787367972.331501:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030390 00000020:00080000:1.0:1787367972.331510:0:15372:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55bd40f000): rc 0 00000020:00000080:1.0:1787367972.331513:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55bd40f000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787367972.331546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787367972.332271:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd40f000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1787367972.332394:0:15372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1787367972.332398:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787367972.332401:0:15372:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787367972.332405:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787367972.332564:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55bd40c000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787367972.332626:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367972.332633:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1787367972.332636:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55bd40d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1787367972.332639:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd40d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1787367972.332642:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1787367972.332687:0:15372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bc6be800 1 00000020:00000080:0.0:1787367972.332695:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0302cc 00000020:00000080:0.0:1787367972.332699:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55c0025000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1787367972.332707:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1787367972.332710:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367972.332714:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787367972.332717:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c55bc5e3370) has no exports 00000020:00000080:2.0:1787367972.332726:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55c0025000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787367972.373698:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787367972.373711:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787367972.373716:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55bc6ba800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787367972.373720:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bc6ba800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787367972.373733:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787367972.373844:0:15372:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c55bc6bd800 00000020:01000000:2.0:1787367972.373862:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787367972.373866:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367972.373869:0:15372:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787367972.373873:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c55912fcd28) has no exports 00000100:00100000:0.0:1787367972.374768:0:6539:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c55aa48d200:6539] 1 exiting: rc = 0 00000100:00100000:1.0:1787367972.374984:0:15019:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9c5584c0c200:15019] 4 exiting: rc = 0 00000100:00100000:1.0:1787367972.375075:0:6540:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c55aa48ce00:6540] 2 exiting: rc = 0 00000100:00100000:3.0:1787367972.375204:0:9404:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c5481ba1c00:9404] 3 exiting: rc = 0 00000100:00100000:3.0:1787367972.375272:0:6538:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c55aa48d400:6538] 0 exiting: rc = 1 00000100:00100000:0.0:1787367972.376645:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376654:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376659:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376675:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376684:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376691:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376697:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376702:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376708:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376713:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376718:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376724:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376730:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376734:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376756:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376761:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376766:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376772:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376777:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376783:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376789:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376794:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376799:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376805:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376810:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376815:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376820:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376826:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376832:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376847:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376853:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376859:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376864:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376869:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376875:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376880:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376887:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376892:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376897:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376903:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376908:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376913:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376917:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376921:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376926:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376931:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376935:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376940:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376944:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376957:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376962:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376968:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376974:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376979:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376984:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376990:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.376995:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.377000:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.377005:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.377011:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.377017:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.377021:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.377027:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.377042:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367972.382196:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c55aa48c800:6541] 0 exiting: rc = 1 00000100:00100000:2.0:1787367972.382313:0:6542:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c55aa48c000:6542] 1 exiting: rc = 0 00000100:00100000:0.0:1787367972.388162:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388174:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388180:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388188:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388194:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388200:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388206:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388212:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388217:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388223:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388229:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388235:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388242:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388248:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388253:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388259:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388264:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388269:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388275:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388280:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388301:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388306:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388311:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388317:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388323:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388329:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388334:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388339:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388344:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388349:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388500:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388507:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388512:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388517:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388522:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388527:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388532:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388538:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388544:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388549:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388555:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388563:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388568:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388573:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388588:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388593:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388599:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388604:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388610:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388615:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388620:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388625:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388631:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388636:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388641:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388824:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388829:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388834:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388894:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388901:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388906:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388912:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388917:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.388921:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367972.390001:0:6544:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c5592f88000:6544] 1 exiting: rc = 0 00000100:00100000:1.0:1787367972.390141:0:7862:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9c55bd561e00:7862] 2 exiting: rc = 0 00000100:00100000:2.0:1787367972.390272:0:6543:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c5592f89000:6543] 0 exiting: rc = 1 00000100:00100000:0.0:1787367972.395810:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395824:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395860:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395866:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395873:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395879:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395885:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395890:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395896:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395901:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395909:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395915:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395922:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395928:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395945:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395953:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395959:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395965:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395971:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395977:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395983:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395989:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.395995:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396001:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396006:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396012:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396045:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396052:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396057:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396064:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396071:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396078:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396083:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396088:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396094:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396099:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396106:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396111:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396130:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396137:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396142:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396148:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396153:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396159:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396165:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396171:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396179:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396185:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396191:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396197:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396217:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396224:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396231:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396238:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396245:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396250:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396256:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396262:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396269:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396275:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396281:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396293:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396300:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367972.396306:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367972.423855:0:6545:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c55a0878c00:6545] 0 exiting: rc = 1 00000100:00100000:2.0:1787367972.425321:0:6546:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c55a0878200:6546] 1 exiting: rc = 0 00000100:00100000:1.0:1787367972.428699:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428710:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428715:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428720:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428726:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428733:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428738:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428744:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428749:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428753:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428760:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428764:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428769:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428774:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428779:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428784:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428788:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428793:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428797:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428803:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428808:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428829:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428833:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428838:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428843:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428847:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428852:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428856:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428861:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428865:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428870:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428874:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428879:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428883:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428891:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428896:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428902:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428907:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428912:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428917:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428922:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428926:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428931:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428936:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428942:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428947:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428951:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428956:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428961:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428966:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428971:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428976:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428981:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428986:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428991:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.428996:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.429008:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.429013:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.429017:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.429021:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.429026:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.429031:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.429036:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.429041:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367972.429468:0:6547:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c55a0879c00:6547] 0 exiting: rc = 1 00000100:00100000:2.0:1787367972.429558:0:6548:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c55a0878000:6548] 1 exiting: rc = 0 00000100:00100000:1.0:1787367972.430168:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430175:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430181:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430186:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430191:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430197:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430201:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430206:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430211:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430215:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430220:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430225:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430230:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430235:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430239:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430244:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430249:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430253:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430258:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430263:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430268:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430273:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430279:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430284:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430289:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430293:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430297:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430313:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430319:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430323:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430329:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430333:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430338:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430342:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430347:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430351:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430381:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430387:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430392:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430396:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430401:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430406:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430411:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430415:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430420:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430425:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430430:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430435:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430440:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430445:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430449:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430454:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430459:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430464:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430469:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430473:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430478:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430484:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430489:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430494:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430499:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430503:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430516:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.430522:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367972.430958:0:6549:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c55a0879600:6549] 0 exiting: rc = 1 00000100:00100000:3.0:1787367972.431137:0:6550:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c55a0879200:6550] 1 exiting: rc = 0 00000100:00100000:1.0:1787367972.434569:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434590:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434597:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434602:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434608:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434612:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434617:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434623:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434628:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434633:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434639:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434645:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434650:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434655:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434670:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434676:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434682:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434687:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434692:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434697:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434702:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434706:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434711:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434716:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434722:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434726:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434730:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434735:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434741:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434745:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434750:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434755:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434760:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434776:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434781:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434786:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434791:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434796:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434812:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434817:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434822:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434827:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434832:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434837:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434842:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434847:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434852:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434857:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434862:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434867:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434872:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434876:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434881:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434886:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434890:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434895:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434900:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434905:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434910:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434915:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434920:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434925:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434929:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.434934:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367972.435935:0:6551:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c5586721a00:6551] 0 exiting: rc = 1 00000100:00100000:2.0:1787367972.437941:0:6552:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c558a3ec000:6552] 1 exiting: rc = 0 00000100:00100000:1.0:1787367972.443895:0:6553:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c558a3eca00:6553] 2 exiting: rc = 0 00000100:00100000:1.0:1787367972.444007:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444025:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444034:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444051:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444057:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444062:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444068:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444074:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444079:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444084:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444112:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444119:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444125:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444129:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444134:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444139:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444144:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444149:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444154:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444160:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444164:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444169:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444174:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444179:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444184:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444188:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444194:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444200:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444205:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444210:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444216:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444221:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444226:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444232:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444255:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444262:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444267:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444273:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444285:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444290:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444296:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444302:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444309:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444314:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444320:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444326:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444331:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444337:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444342:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444348:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444382:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444390:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444395:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444401:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444407:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444413:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444418:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444423:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444429:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444434:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444439:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444444:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444449:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367972.444462:0:15372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787367972.453774:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367972.453787:0:15372:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787367972.453792:0:15372:0:(genops.c:885:class_export_put()) final put ffff9c55a915b800/MDS_uuid 00000020:00000080:0.0:1787367972.453797:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a915b800/MDS_uuid for MDS 00000020:01000000:0.0:1787367972.453806:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787367972.453979:0:15372:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787367973.209534:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367974.233463:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367975.256489:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787367975.836088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787367975.836096:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787367975.836099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787367975.836102:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787367975.836106:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367975.836114:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1787367975.836128:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787367975.836134:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c5481b9a000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787367975.836165:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4dc00 x1874190808552576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787367975.836205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787367975.836208:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787367975.836210:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c5483358800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367975.836213:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1787367975.836216:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787367975.836219:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c5483358800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787367975.836229:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4ed80 x1874190808552832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367975.836265:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808552576:0@lo:38:kworker.0 00000400:00000100:1.0:1787367975.836312:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808552576 offset 0 length 520: 4 00000100:00100000:1.0:1787367975.836373:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808552832:0@lo:38:kworker.0 00000100:00100000:3.0:1787367975.836376:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808552960:0@lo:400:kworker.0 00000400:00000100:1.0:1787367975.836402:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808552832 offset 0 length 520: 4 00000400:00000100:3.0:1787367975.836779:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808552960 offset 0 length 224: 4 00000100:00100000:3.0:1787367975.836797:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367975.836804:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808552704:0@lo:400:kworker.0 00000400:00000100:3.0:1787367975.836821:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808552704 offset 0 length 224: 4 00000020:01000004:1.0:1787367976.163407:0:15573:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787367976.186506:0:15573:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787367976.186568:0:15573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367976.186595:0:15573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367976.186602:0:15573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367976.186689:0:15573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367976.186766:0:15573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787367976.186771:0:15573:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787367976.186800:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787367976.186811:0:15573:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c5483c4dc00 x1874190808552576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787367990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367976.186828:0:15573:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787367976.186833:0:15573:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787367976.186839:0:15573:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787367976.186844:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787367976.186847:0:15573:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c5483c4dc00 x1874190808552576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787367990 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367976.186854:0:15573:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787367976.186857:0:15573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:2.0:1787367976.186870:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367976.186877:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367976.186885:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367976.186888:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367976.186897:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367976.186904:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367976.186910:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787367976.186912:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787367976.186914:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787367976.186926:0:6527:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00010000:00010000:2.0:1787367976.186930:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367976.186936:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a0600/0x66f5679bff030709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff030710 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367976.186946:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367976.186947:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367976.186948:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367976.187233:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808552576:0@lo:38:kworker.0 00000100:00080000:3.0:1787367976.188604:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787367976.188624:0:15573:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c5483c4c700 x1874190808552704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367976.188645:0:15573:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787367976.188650:0:15573:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787367976.188682:0:15573:0:(import.c:65:import_set_state_nolock()) ffff9c55c0027800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787367976.188800:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808553088:0@lo:39:umount.0 00000400:00000100:2.0:1787367976.188857:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808553088 offset 0 length 224: 4 00000100:00100000:1.0:1787367976.188925:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808552704:0@lo:400:kworker.0 00010000:00010000:2.0:1787367976.281951:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787367976.857272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787367976.857282:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787367976.857285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787367976.857288:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787367976.857676:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808553216:0@lo:400:kworker.0 00000400:00000100:2.0:1787367976.857726:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808553216 offset 0 length 224: 4 00010000:00010000:3.0:1787367977.307912:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787367977.886458:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787367977.886467:0:8447:0:(genops.c:885:class_export_put()) final put ffff9c55a94e7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787367977.886591:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a94e7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787367977.886633:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55a94e2800 for lustre-OST0000 00000001:00100000:3.0:1787367977.886772:0:9534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787367977.886776:0:9534:0:(genops.c:885:class_export_put()) final put ffff9c54830c2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787367977.886881:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54830c2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787367977.886914:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54830c0000 for lustre-OST0001 00010000:00010000:2.0:1787367978.328594:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367979.360407:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367980.376597:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787367980.888644:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787367980.888654:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787367980.888674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787367980.888678:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787367980.888891:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367980.888910:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808553344:0@lo:400:kworker.0 00000400:00000100:2.0:1787367980.888966:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808553344 offset 0 length 224: 4 00010000:00010000:2.0:1787367981.400962:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367982.360547:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787367972/real 1787367972] req@ffff9c548278f480 x1874190808552192/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787367982 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367982.360582:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c548278f480 x1874190808552192/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787367982 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787367982.360605:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55b110b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787367982.360634:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787367982.360638:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3650:1874190808552192:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1787367982.360796:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787367982.360803:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787367982.360806:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c55b110b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787367982.360810:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 429 00000100:00080000:3.0:1787367982.360815:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787367982.360822:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c55b110b800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787367982.360865:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c548278c000 x1874190808553472/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787367982.360880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787367982.360883:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787367982.360995:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367982.361009:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808553600:0@lo:400:kworker.0 00000400:00000100:1.0:1787367982.361057:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808553600 offset 0 length 224: 4 00000100:00100000:2.0:1787367982.361542:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3650:1874190808553472:0@lo:250:kworker.0 00000400:00000100:2.0:1787367982.361566:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190808553472 offset 0 length 520: 4 00010000:00010000:2.0:1787367982.425524:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367983.448953:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367984.472625:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367985.496929:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367986.456996:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787367976/real 1787367976] req@ffff9c548278e300 x1874190808553088/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787367986 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367986.457042:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c548278e300 x1874190808553088/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787367986 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787367986.457061:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55c0027800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787367986.457083:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808553088:0@lo:39:umount.0 00000100:00080000:3.0:1787367986.457190:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787367986.457195:0:15573:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787367986.457200:0:15573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787367986.458553:0:15573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367986.458570:0:15573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367986.458577:0:15573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367986.458600:0:15573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367986.458633:0:15573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367986.458640:0:15573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367986.458647:0:15573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367986.458652:0:15573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367986.458658:0:15573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367986.458676:0:15573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787367986.458680:0:15573:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787367986.458706:0:15573:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787367986.458710:0:15573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787367986.458714:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787367986.458719:0:15573:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787367986.458723:0:15573:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c55bd6db370) has no exports 00000020:00080000:3.0:1787367986.458743:0:15573:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c55bd6db370) has no exports 00010000:00010000:2.0:1787367986.459271:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367986.459279:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367986.459287:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367986.459290:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367986.459393:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367986.459404:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367986.459410:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787367986.459413:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787367986.459415:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787367986.459429:0:6527:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00010000:00010000:2.0:1787367986.459433:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367986.459440:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa83000/0x66f5679bff030717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff03071e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367986.459468:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367986.459471:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367986.459593:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367986.459598:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367986.459606:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367986.459613:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367986.459619:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787367986.459621:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787367986.459623:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787367986.459630:0:6527:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00010000:00010000:2.0:1787367986.459634:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367986.459640:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5581672800/0x66f5679bff03099b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0309a2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367986.459651:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367986.459653:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367986.459655:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367986.459712:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787367986.467159:0:15573:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5481b0f960 - data ffff9c5481c44510/ffff9c55bd793400 00000020:01000000:3.0:1787367986.467588:0:15573:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c54821cc6c0 - data ffff9c55b1655d80/ffff9c55be764400 00100000:10000000:3.0:1787367986.479058:0:15573:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787367986.502906:0:15573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030469 00000020:00000080:0.0:1787367986.507906:0:15573:0:(genops.c:885:class_export_put()) final put ffff9c5481bc9800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787367986.507950:0:15573:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bd606800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787367986.507954:0:15573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bd606800 2 00000020:01000004:0.0:1787367986.507957:0:15573:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c55bd606800 from lustre-OST0000 00000020:00000080:0.0:1787367986.507988:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367986.507997:0:15573:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787367986.508001:0:15573:0:(genops.c:885:class_export_put()) final put ffff9c5481bce800/lustre-OST0000_UUID 00000020:00000080:0.0:1787367986.508008:0:15573:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5481bce800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787367986.508019:0:15573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1787367986.508075:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5481bc9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1787367986.508087:0:15573:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787367986.508093:0:15573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787367986.508097:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367986.508103:0:15573:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787367986.508122:0:15573:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c55b12c2800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787367986.508128:0:15573:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9c559124cd28) has exports, disconnecting them 00000020:00080000:0.0:1787367986.508133:0:15573:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c55b12c2800), last request at 1787367753 00000020:00000080:0.0:1787367986.508137:0:15573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030493 00000020:00080000:0.0:1787367986.508151:0:15573:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55b12c2800): rc 0 00000020:00000080:0.0:1787367986.508157:0:15573:0:(genops.c:885:class_export_put()) final put ffff9c55b12c2800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787367986.508191:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c2800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787367986.517466:0:15573:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787367986.517475:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787367986.517488:0:15573:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787367986.517495:0:15573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787367986.517799:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5481b9a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787367986.518248:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787367986.518257:0:15573:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787367986.518262:0:15573:0:(genops.c:885:class_export_put()) final put ffff9c5481b9f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787367986.518266:0:15573:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5481b9f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787367986.518272:0:15573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787367986.518334:0:15573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787367986.518339:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367986.518344:0:15573:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787367986.518350:0:15573:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c55b12c1800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787367986.522074:0:15573:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9c55b55419b8) has exports, disconnecting them 00000020:00080000:2.0:1787367986.522087:0:15573:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c55b12c1800), last request at 1787367753 00000020:00000080:2.0:1787367986.522093:0:15573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0304a8 00000020:00080000:2.0:1787367986.522233:0:15573:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55b12c1800): rc 0 00000020:00000080:2.0:1787367986.522241:0:15573:0:(genops.c:885:class_export_put()) final put ffff9c55b12c1800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787367986.522306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c1800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787367986.524814:0:15573:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787367986.524823:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787367986.524827:0:15573:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787367986.524834:0:15573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787367986.525120:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787367986.525129:0:15573:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787367986.525136:0:15573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bd606800 1 00000020:00000080:3.0:1787367986.525142:0:15573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff030431 00000020:00000080:3.0:1787367986.525160:0:15573:0:(genops.c:885:class_export_put()) final put ffff9c55bd603000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787367986.525165:0:15573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787367986.525170:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787367986.525174:0:15573:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787367986.525177:0:15573:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9c55bd6dcd28) has no exports 00000020:00000080:3.0:1787367986.528434:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55c0027800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787367986.528448:0:36:0:(genops.c:885:class_export_put()) final put ffff9c55b12c1000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787367986.528453:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b12c1000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787367986.528465:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787367986.528539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd603000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787367986.682970:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787367986.682984:0:15573:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787367986.682989:0:15573:0:(genops.c:885:class_export_put()) final put ffff9c55bd601800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787367986.682993:0:15573:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd601800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787367986.683003:0:15573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787367986.683131:0:15573:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c55bd604800 00000020:02000400:3.0:1787367986.683175:0:15573:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787367986.730953:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787367987.608987:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787367987.608996:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787367987.608999:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787367987.609001:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787367987.609384:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808553728:0@lo:400:kworker.0 00000400:00000100:2.0:1787367987.612823:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808553728 offset 0 length 224: 4 00010000:00010000:2.0:1787367987.742761:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367988.760690:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367989.786765:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787367990.293267:0:15775:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787367990.310508:0:15775:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787367990.310594:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367990.310621:0:15775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367990.310630:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367990.310637:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367990.310658:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787367990.310663:0:15775:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787367990.310685:0:15775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787367990.310695:0:15775:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c5483c4ed80 x1874190808552832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787367990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367990.310711:0:15775:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787367990.310716:0:15775:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787367990.310722:0:15775:0:(import.c:65:import_set_state_nolock()) ffff9c5483358800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787367990.310738:0:15775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787367990.310742:0:15775:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c5483c4ed80 x1874190808552832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787367990 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367990.310749:0:15775:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787367990.310752:0:15775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787367990.310940:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367990.310948:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367990.310975:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787367990.310979:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367990.310987:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367990.310994:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367990.311000:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787367990.311003:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787367990.311005:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787367990.311018:0:6527:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00010000:00010000:2.0:1787367990.311021:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367990.311028:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa83800/0x66f5679bff0306ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0306f4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367990.311040:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367990.311041:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367990.311043:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367990.311206:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808552832:0@lo:38:kworker.0 00000100:00080000:0.0:1787367990.314159:0:15775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787367990.314177:0:15775:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c5483c4e300 x1874190808552960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367990.314202:0:15775:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55b6042680 x1874190808553216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367992 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367990.314216:0:15775:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c5483c4c700 x1874190808553344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367996 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367990.314224:0:15775:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c548278dc00 x1874190808553600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367998 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367990.314231:0:15775:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c548278e300 x1874190808553728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368003 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367990.314237:0:15775:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787367990.314242:0:15775:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787367990.314265:0:15775:0:(import.c:65:import_set_state_nolock()) ffff9c548335c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787367990.314314:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808553856:0@lo:39:umount.0 00000400:00000100:0.0:1787367990.314391:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808553856 offset 0 length 224: 4 00000100:00100000:2.0:1787367990.314823:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808553728:0@lo:400:kworker.0 00000100:00100000:2.0:1787367990.314834:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808553600:0@lo:400:kworker.0 00000100:00100000:2.0:1787367990.314841:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808552960:0@lo:400:kworker.0 00000100:00100000:1.0:1787367990.315566:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808553344:0@lo:400:kworker.0 00000100:00100000:1.0:1787367990.315575:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808553216:0@lo:400:kworker.0 00010000:00010000:0.0:1787367990.811066:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367991.832870:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787367992.728557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787367992.728568:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787367992.856615:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367993.880724:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367994.904655:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367995.928905:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367996.952583:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367997.465388:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787367982/real 1787367982] req@ffff9c548278c000 x1874190808553472/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787367997 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367997.465431:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c548278c000 x1874190808553472/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787367997 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787367997.465451:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55b110b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787367997.465466:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787367997.465470:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3650:1874190808553472:0@lo:250:kworker.0 00000100:00080000:1.0:1787367997.465587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787367997.465592:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787367997.465595:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55b110b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367997.465599:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 439 00000100:00080000:1.0:1787367997.465605:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.104@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787367997.465611:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c55b110b800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787367997.465644:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4c700 x1874190808553984/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787367997.466418:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3650:1874190808553984:0@lo:250:kworker.0 00000400:00000100:0.0:1787367997.466467:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190808553984 offset 0 length 520: 4 00010000:00010000:2.0:1787367997.977081:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367999.000643:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368000.025571:0:8468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368000.537015:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787367990/real 1787367990] req@ffff9c55b6043480 x1874190808553856/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787368000 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368000.537050:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55b6043480 x1874190808553856/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787368000 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787368000.537070:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548335c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787368000.537097:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808553856:0@lo:39:umount.0 00000100:00080000:1.0:1787368000.538015:0:15775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787368000.538022:0:15775:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787368000.538029:0:15775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787368000.539175:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368000.539193:0:15775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368000.540747:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368000.540755:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368000.540784:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368000.540794:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368000.540801:0:15775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368000.540807:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368000.540813:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368000.540835:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787368000.540839:0:15775:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1787368000.540856:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368000.540863:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368000.540869:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ba00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368000.540872:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787368000.540874:0:15775:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787368000.540879:0:15775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1787368000.540881:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787368000.540883:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:2.0:1787368000.540888:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787368000.540888:0:15775:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787368000.540892:0:15775:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9c55b5543370) has no exports 10000000:01000000:2.0:1787368000.540893:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787368000.540896:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787368000.540898:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787368000.540911:0:6526:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00000020:00080000:1.0:1787368000.540912:0:15775:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9c55b5543370) has no exports 00010000:00010000:2.0:1787368000.540914:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368000.540921:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68ba00/0x66f5679bff0306fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff030702 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368000.540935:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368000.540938:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368000.540949:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368000.540952:0:6526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368000.540960:0:6526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368000.540966:0:6526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368000.540971:0:6526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787368000.540973:0:6526:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787368000.540975:0:6526:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787368000.540979:0:6526:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00010000:00010000:2.0:1787368000.540982:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368000.540988:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff03098d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff030994 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368000.541001:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368000.541003:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368000.541005:0:6526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787368000.542731:0:15775:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5481b0f2a0 - data ffff9c55b15a85e8/ffff9c55bd793c00 00000020:01000000:1.0:1787368000.542845:0:15775:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5481b0f900 - data ffff9c5481ca9870/ffff9c54830a0800 00010000:00010000:0.0:1787368000.543495:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787368000.556232:0:15775:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787368000.571739:0:15775:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03058f 00000020:00000080:1.0:1787368000.571753:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c55c0026800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787368000.571765:0:15775:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bc4cb000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787368000.571768:0:15775:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bc4cb000 2 00000020:01000004:1.0:1787368000.571771:0:15775:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c55bc4cb000 from lustre-OST0001 00000020:00000080:1.0:1787368000.571797:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368000.571807:0:15775:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787368000.571810:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c55c0023800/lustre-OST0001_UUID 00000020:00000080:1.0:1787368000.571813:0:15775:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55c0023800/lustre-OST0001_UUID for lustre-OST0001 00000020:00000080:3.0:1787368000.571819:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55c0026800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787368000.571819:0:15775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787368000.572319:0:15775:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f->MGS 00010000:00010000:3.0:1787368000.572336:0:15775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68aa00/0x66f5679bff0302e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0302ef expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787368000.572380:0:15775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68aa00/0x66f5679bff0302e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0302ef expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368000.572396:0:15775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787368000.572399:0:15775:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787368000.572402:0:15775:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787368000.572417:0:15775:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00010000:00010000:3.0:1787368000.572420:0:15775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68aa00/0x66f5679bff0302e8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0302ef expref: -99 pid: 7468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368000.572436:0:15775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff030764 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787368000.572443:0:15775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff030764 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368000.572448:0:15775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787368000.572450:0:15775:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787368000.572452:0:15775:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787368000.572460:0:15775:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c55b110b800 00010000:00010000:3.0:1787368000.572463:0:15775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55afa82000/0x66f5679bff03075d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff030764 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787368000.572672:0:15775:0:(import.c:65:import_set_state_nolock()) ffff9c55b110b800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787368000.572677:0:15775:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787368000.572689:0:15775:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787368000.572691:0:15775:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787368000.572696:0:15775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787368000.572706:0:15775:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c5483c4c700 x1874190808553984/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787368017 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787368000.572723:0:15775:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787368000.572726:0:15775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:1.0:1787368000.572909:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f:3650:1874190808553984:0@lo:250:kworker.0 10000000:01000000:3.0:1787368000.572940:0:15775:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787368000.572947:0:15775:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0301e5 00000020:00000080:3.0:1787368000.572953:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c55a915e000/c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f 00000020:01000000:3.0:1787368000.572975:0:15775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.104@tcp (flags='') 00000020:00000080:3.0:1787368000.572980:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787368000.572986:0:15775:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787368000.572990:0:15775:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c55b8aab370) has no exports 00000020:00000080:1.0:1787368000.572990:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a915e000/c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f for MGC192.168.203.104@tcp 10000000:01000000:2.0:1787368000.573157:0:6535:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787368000.573279:0:15775:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.104@tcp: client import never connected 00000100:00080000:1.0:1787368000.573283:0:15775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787368000.573285:0:15775:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787368000.573287:0:15775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787368000.573289:0:15775:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787368000.573333:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368000.573338:0:15775:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.104@tcp (uuid c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f) 00000020:01000000:1.0:1787368000.573345:0:15775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787368000.573348:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787368000.573352:0:15775:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787368000.573372:0:15775:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c548335e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787368000.573378:0:15775:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9c5482774d28) has exports, disconnecting them 00000020:00080000:1.0:1787368000.573391:0:15775:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c548335e800), last request at 1787367773 00000020:00000080:1.0:1787368000.573394:0:15775:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0305b9 00000020:00000080:3.0:1787368000.573448:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55b110b800 for MGC192.168.203.104@tcp 00000020:00000080:3.0:1787368000.573456:0:37:0:(genops.c:885:class_export_put()) final put ffff9c55b110f800/c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f 00000020:00000080:3.0:1787368000.573459:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b110f800/c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f for MGC192.168.203.104@tcp 00000020:01000000:3.0:1787368000.573464:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.104@tcp (c0ef649e-e1b4-4ea0-b65e-3e2eefedec8f) 00000020:00080000:1.0:1787368000.574009:0:15775:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c548335e800): rc 0 00000020:00000080:1.0:1787368000.574015:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c548335e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787368000.575054:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548335e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787368000.577463:0:15775:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787368000.577472:0:15775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787368000.577476:0:15775:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787368000.577484:0:15775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787368000.577799:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5483358800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787368000.578398:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787368000.578408:0:15775:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787368000.578415:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c5482779000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787368000.578419:0:15775:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5482779000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787368000.578425:0:15775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787368000.578497:0:15775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787368000.578501:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787368000.578506:0:15775:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787368000.578520:0:15775:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c5483359800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787368000.578595:0:15775:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9c54827719b8) has exports, disconnecting them 00000020:00080000:3.0:1787368000.578610:0:15775:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c5483359800), last request at 1787367773 00000020:00000080:3.0:1787368000.578615:0:15775:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0305ce 00000020:00080000:3.0:1787368000.578628:0:15775:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c5483359800): rc 0 00000020:00000080:3.0:1787368000.578632:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c5483359800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787368000.581012:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483359800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787368000.588352:0:15775:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787368000.588372:0:15775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787368000.588376:0:15775:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787368000.588390:0:15775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787368000.588420:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548335c800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1787368000.594574:0:8468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787368000.594757:0:6526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787368000.596524:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787368000.598529:0:6522:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c55aa48f800:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1787368000.624295:0:6521:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c55a03fee00:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1787368000.626454:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.626935:0:8469:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c55bb6a0200:8469] 3 exiting: rc = 0 00000100:00100000:2.0:1787368000.627035:0:6524:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c5586791400:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1787368000.627444:0:6525:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c5583554e00:6525] 2 exiting: rc = 0 00000100:00100000:1.0:1787368000.629276:0:6523:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c5583554200:6523] 0 exiting: rc = 1 00000100:00100000:2.0:1787368000.629500:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629509:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629515:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629520:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629526:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629603:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629609:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629614:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629620:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629636:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629643:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629649:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629655:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629666:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629672:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629678:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629684:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629690:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629696:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629703:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629721:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629726:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.629731:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.630249:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.630258:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.631333:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.631345:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.631351:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.632063:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.632073:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.632080:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.632091:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.632096:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633653:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633664:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633668:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633673:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633678:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633682:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633687:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633692:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633696:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633700:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633705:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633709:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633713:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633717:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633721:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633725:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633729:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633791:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633822:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633900:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633904:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.633909:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.634099:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.634104:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.634108:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.634113:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.634118:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.634122:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.634127:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.634131:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.634135:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787368000.647414:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368000.647427:0:15775:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1787368000.647432:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c548335f000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1787368000.647436:0:15775:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548335f000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1787368000.647441:0:15775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1787368000.647488:0:15775:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bc4cb000 1 00000020:00000080:2.0:1787368000.647494:0:15775:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03055e 00000020:00000080:2.0:1787368000.647500:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c5481bcd000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787368000.647514:0:15775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787368000.647518:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368000.647523:0:15775:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787368000.647685:0:15775:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9c5482770000) has no exports 00000020:00000080:1.0:1787368000.647707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5481bcd000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787368000.727750:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368000.727763:0:15775:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787368000.727769:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c548277a000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787368000.727774:0:15775:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548277a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787368000.727784:0:15775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787368000.728217:0:15775:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c55a915a000 00000020:01000000:2.0:1787368000.728241:0:15775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787368000.728245:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368000.728250:0:15775:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787368000.728254:0:15775:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c55bd6d99b8) has no exports 00000020:00000080:2.0:1787368000.728284:0:15775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368000.728289:0:15775:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787368000.728299:0:15775:0:(genops.c:885:class_export_put()) final put ffff9c55bd605000/OSS_uuid 00000020:00000080:2.0:1787368000.728301:0:15775:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd605000/OSS_uuid for OSS 00000020:01000000:2.0:1787368000.728305:0:15775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787368000.728437:0:6534:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787368000.729968:0:8925:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c55a94ba000:8925] 3 exiting: rc = 0 00000100:00100000:1.0:1787368000.730060:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c55bd506000:8453] 1 exiting: rc = 0 00000100:00100000:0.0:1787368000.730506:0:8454:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c5590f70800:8454] 2 exiting: rc = 0 00000100:00100000:3.0:1787368000.731110:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c55bd507600:8451] 0 exiting: rc = 1 00000100:00100000:1.0:1787368000.733545:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733554:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733560:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733566:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733571:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733577:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733582:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733588:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733716:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733721:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733726:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733730:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733735:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733740:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733746:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733751:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733756:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733761:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733765:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733770:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733775:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733780:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733785:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733791:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733796:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733800:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733805:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733810:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733815:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733819:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733840:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733845:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733850:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733856:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733860:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733866:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733871:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733877:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733883:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733888:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733894:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733899:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733904:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733909:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733914:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733918:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733923:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733928:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733933:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733938:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733943:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733947:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733952:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733957:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733962:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733966:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733971:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733975:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733980:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733984:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733989:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.733994:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.734000:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.734012:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787368000.737524:0:8455:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c5590f70600:8455] 0 exiting: rc = 1 00000100:00100000:2.0:1787368000.737865:0:8456:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c5590f71400:8456] 1 exiting: rc = 0 00000100:00100000:0.0:1787368000.737891:0:13832:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c5482237a00:13832] 2 exiting: rc = 0 00000100:00100000:0.0:1787368000.737977:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.737985:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.737991:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.737997:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738001:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738020:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738028:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738035:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738042:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738046:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738051:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738057:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738062:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738066:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738071:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738077:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738082:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738086:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738090:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738095:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738101:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738105:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738109:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738114:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738120:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738126:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738130:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738135:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738139:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738144:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738148:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738152:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738158:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738162:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738166:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738171:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738176:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738181:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738186:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738190:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738204:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738210:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738215:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738220:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738225:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738230:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738235:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738240:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738246:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738251:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738256:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738261:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738265:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738271:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738276:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738282:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738287:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738292:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738297:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738302:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738307:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738312:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738316:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.738328:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.739222:0:8458:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c55bd4db600:8458] 1 exiting: rc = 0 00000100:00100000:2.0:1787368000.739527:0:8457:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c5582c12c00:8457] 0 exiting: rc = 1 00000100:00100000:2.0:1787368000.739678:0:8459:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c5582c12e00:8459] 2 exiting: rc = 0 00000100:00100000:0.0:1787368000.743299:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.743309:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.743315:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.743321:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744886:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744904:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744910:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744915:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744921:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744926:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744947:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744953:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744958:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744962:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744967:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744971:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744976:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744981:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.744987:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745011:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745017:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745022:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745421:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745426:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745431:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745436:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745441:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745446:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745451:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.745455:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746328:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746431:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746437:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746443:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746448:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746453:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746459:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746465:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746534:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746539:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746544:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746549:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746554:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746579:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746586:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746723:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746729:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746734:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746740:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746745:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746751:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746756:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746762:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746767:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746773:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746778:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746784:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746789:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746795:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746809:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746822:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746839:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746845:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368000.746851:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.767142:0:8460:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c5582c12400:8460] 0 exiting: rc = 1 00000100:00100000:3.0:1787368000.767436:0:8461:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c5582c12a00:8461] 1 exiting: rc = 0 00000100:00100000:2.0:1787368000.767641:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767649:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767654:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767659:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767664:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767669:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767674:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767679:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767684:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767689:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767694:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767699:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767703:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767708:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767713:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767717:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767722:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767727:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767732:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767737:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767741:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767747:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767752:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767756:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767761:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767766:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767771:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767778:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767793:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767799:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767806:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767811:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767817:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767822:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767827:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767832:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767836:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767842:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767847:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767852:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767857:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767862:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767866:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767871:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767875:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767880:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767885:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767892:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767897:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767902:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767907:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767912:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767917:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767921:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767927:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767931:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767936:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767941:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.767946:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.768025:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.768034:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.768039:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.768045:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.768065:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368000.771505:0:8463:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c5590f42e00:8463] 1 exiting: rc = 0 00000100:00100000:0.0:1787368000.771505:0:8462:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c55bd505400:8462] 0 exiting: rc = 1 00000100:00100000:2.0:1787368000.771638:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771647:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771654:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771659:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771665:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771670:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771676:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771681:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771687:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771692:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771697:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771703:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771724:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771731:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771737:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771743:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771748:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771753:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771759:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771765:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771770:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771776:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771782:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771788:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771809:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771816:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771822:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771827:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771832:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771837:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771843:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771849:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771857:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771863:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771884:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771891:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771916:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771923:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771928:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771934:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.771942:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772596:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772607:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772613:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772620:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772625:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772630:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772636:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772661:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772673:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772680:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772689:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772698:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772710:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772723:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772735:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772746:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772755:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772765:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772775:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772800:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772817:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772822:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368000.772828:0:15775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787368000.793935:0:15775:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787368019.696828:0:16541:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787368030.007994:0:17141:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787368030.008000:0:17141:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787368030.008001:0:17141:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787368030.008109:0:17141:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c5483e3e800 00000020:01000004:3.0:1787368030.008124:0:17141:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787368030.008130:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787368030.008143:0:17141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c55bd6d99b8) 00000020:00000080:3.0:1787368030.008156:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787368030.081445:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787368030.081941:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787368030.087221:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.088482:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.088792:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787368030.089701:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787368030.090216:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787368030.090571:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.090887:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787368030.091393:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.091718:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787368030.092143:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.092508:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.092850:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787368030.093229:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.094683:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.095172:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.095471:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.095758:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.096167:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.096492:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.096700:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.096979:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.097453:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.097683:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.098205:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.098511:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.098728:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.098996:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.099478:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.099727:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.100219:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.101241:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.101521:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.101719:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.102139:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.102516:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.102709:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.103222:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.103553:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.103776:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.103957:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.104461:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.105215:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787368030.105667:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.105889:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.106668:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787368030.113402:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.113825:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.114125:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787368030.114576:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787368030.115259:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787368030.115582:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1787368030.116565:0:17141:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787368030.116765:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787368030.116773:0:17141:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787368030.116784:0:17141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff0317a2 00000020:01000004:3.0:1787368030.116792:0:17141:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787368030.116795:0:17141:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787368030.116800:0:17141:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c5483e3e800 from MGS 00000020:01000004:3.0:1787368030.116804:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787368030.116814:0:17141:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c55bd6dcd28) 00000020:00000080:3.0:1787368030.116835:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787368030.116892:0:17141:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5483e3e800 from MGS, refs=2 00080000:01000000:3.0:1787368030.116897:0:17141:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787368030.116901:0:17141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff0317b0 00000100:00100000:3.0:1787368030.117304:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787368030.117529:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787368030.117535:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787368030.118244:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787368030.118253:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787368030.119319:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787368030.119582:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787368030.119587:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787368030.119954:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787368030.119959:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787368030.121483:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787368030.121494:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787368030.122264:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368030.122269:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368030.122270:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368030.123098:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368030.123101:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368030.123103:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368030.123833:0:17141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787368030.126129:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787368030.133486:0:17141:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787368030.134280:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787368030.134401:0:17141:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787368030.134431:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787368030.135511:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787368030.136348:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787368030.136523:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787368030.136528:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787368030.138745:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787368030.138758:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787368030.146554:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787368030.146631:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787368030.147851:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787368030.147873:0:17141:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.104@tcp' 00000020:01000004:1.0:1787368030.147875:0:17141:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787368030.147900:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.104@tcp (typ=mgc) 00000020:00000080:1.0:1787368030.147913:0:17141:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.104@tcp (ffff9c5591248000) 00000020:00000080:1.0:1787368030.147928:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787368030.148293:0:17141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5584c45000@MGC192.168.203.104@tcp: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1787368030.148480:0:17141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.104@tcp-0 is initialized 00000040:01000000:1.0:1787368030.148486:0:17141:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787368030.150171:0:17159:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787368030.150230:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.104@tcp (uuid b3ce871c-8318-4c29-9238-0157d9966155) 00000020:00000080:1.0:1787368030.150250:0:17141:0:(genops.c:1385:class_connect()) connect: client b3ce871c-8318-4c29-9238-0157d9966155, cookie 0x66f5679bff0317be 00000100:00080000:1.0:1787368030.150261:0:17141:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787368030.150267:0:17141:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c5584c45000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368030.150296:0:17141:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4ce00 x1874190808554112/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368030.150344:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3ce871c-8318-4c29-9238-0157d9966155:3650:1874190808554112:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787368030.150414:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787368030.150463:0:17141:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b3ce871c-8318-4c29-9238-0157d9966155->MGS 00000020:01000004:1.0:1787368030.150484:0:17141:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787368030.150498:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787368030.150510:0:17141:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c559124b370) 00000020:00000080:1.0:1787368030.150520:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787368030.153876:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808554112 00000100:00100000:0.0:1787368030.153891:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808554112 00000100:00100000:0.0:1787368030.153982:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787368030.153991:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3650:x1874190808554112:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787368030.154080:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b3ce871c-8318-4c29-9238-0157d9966155@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1787368030.154117:0:17154:0:(genops.c:1385:class_connect()) connect: client b3ce871c-8318-4c29-9238-0157d9966155, cookie 0x66f5679bff0317cc 00000100:00080000:0.0:1787368030.154348:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9c548372d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368030.154453:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+5:3650:x1874190808554112:12345-0@lo:250:mount.lustre.0 Request processed in 460us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368030.154461:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787368030.154506:0:3650:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787368030.154515:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1787368030.154523:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787368030.154528:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787368030.154531:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5584c45000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787368030.154534:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787368030.154537:0:3650:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787368030.154543:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3ce871c-8318-4c29-9238-0157d9966155:3650:1874190808554112:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1787368030.154798:0:17158:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1787368030.181660:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787368030.181876:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787368030.181883:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787368030.186091:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787368030.186103:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787368030.187221:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787368030.187231:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787368030.194996:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787368030.195209:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787368030.195215:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787368030.196706:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787368030.196718:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787368030.266632:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787368030.266829:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787368030.266835:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787368030.267926:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787368030.267936:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787368030.269312:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787368030.269528:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787368030.269533:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787368030.270573:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787368030.270581:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787368030.274682:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787368030.274857:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787368030.274863:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787368030.275720:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787368030.275728:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787368030.276287:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787368030.276688:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787368030.276694:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787368030.277206:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787368030.277212:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787368030.298259:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787368030.298822:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787368030.298827:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787368030.301059:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787368030.301072:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787368030.302151:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787368030.302160:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787368030.303069:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787368030.303096:0:17141:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787368030.303102:0:17141:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787368030.303287:0:17141:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787368030.303509:0:17141:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787368030.303512:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787368030.303513:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787368030.303514:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787368030.303515:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787368030.303516:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787368030.303517:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787368030.303518:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787368030.303519:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787368030.303521:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787368030.303522:0:17141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787368030.303525:0:17141:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787368030.303528:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787368030.303529:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787368030.303530:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787368030.303532:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787368030.303533:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787368030.303534:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787368030.303535:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787368030.303536:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787368030.303537:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787368030.303538:0:17141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787368030.303566:0:17141:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787368030.303590:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787368030.303661:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368030.303762:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.303850:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808554240 00000100:00100000:3.0:1787368030.303858:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808554240 00000100:00100000:0.0:1787368030.303921:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787368030.303932:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+5:17141:x1874190808554240:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787368030.303983:0:17154:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787368030.303986:0:17154:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787368030.303989:0:17154:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787368030.304434:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787368030.305048:0:17154:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1787368030.306270:0:17179:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787368030.306276:0:17179:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787368030.306279:0:17179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787368030.306282:0:17179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787368030.306463:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787368030.306690:0:17154:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787368030.306700:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787368030.308025:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+5:17141:x1874190808554240:12345-0@lo:253:mount.lustre.0 Request processed in 4089us (4357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368030.308042:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787368030.308121:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554240:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787368030.308135:0:17141:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787368030.308138:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787368030.308139:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787368030.308141:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787368030.308142:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787368030.308143:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787368030.308144:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787368030.308145:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787368030.308146:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787368030.308148:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787368030.308149:0:17141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787368030.308165:0:17141:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c5483e3e800 from lustre-MDT0000 10000000:01000000:0.0:1787368030.308199:0:17141:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787368030.308202:0:17141:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787368030.308206:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c5591248000 10000000:01000000:0.0:1787368030.308210:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787368030.308217:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c5591248000 from 1 10000000:01000000:0.0:1787368030.308220:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787368030.308253:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.308263:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.308285:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368030.308303:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787368030.308533:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368030.308606:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54836063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368030.308646:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808554368 00000100:00100000:2.0:1787368030.308651:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808554368 00000100:00100000:2.0:1787368030.308728:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787368030.308737:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+5:17141:x1874190808554368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368030.308749:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368030.308765:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241d400/0x66f5679bff0317da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0317d3 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.308787:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241d400/0x66f5679bff0317da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0317d3 expref: 6 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.308796:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241d400/0x66f5679bff0317da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0317d3 expref: 6 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.308805:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241d400, rc 0) 00000100:00100000:2.0:1787368030.308842:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+6:17141:x1874190808554368:12345-0@lo:101:mount.lustre.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368030.308848:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368030.308900:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368030.308913:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.308922:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368030.308968:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368030.308991:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368030.309047:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54836063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.309102:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808554496 00000100:00100000:3.0:1787368030.309106:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808554496 00000100:00100000:3.0:1787368030.309124:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368030.309130:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+6:17141:x1874190808554496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368030.309207:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+6:17141:x1874190808554496:12345-0@lo:501:mount.lustre.0 Request processed in 77us (215us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787368030.309222:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787368030.309283:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554496:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787368030.309309:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787368030.309320:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.309336:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368030.309343:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c5483e3e800 10000000:01000000:0.0:1787368030.309384:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787368030.309393:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c5483e3e800 10000000:01000000:0.0:1787368030.309396:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787368030.309399:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c5483e3e800 from 1 10000000:01000000:0.0:1787368030.309401:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787368030.309417:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.309424:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.309432:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368030.309443:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787368030.309466:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368030.309481:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54836063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.309522:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808554624 00000100:00100000:3.0:1787368030.309526:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808554624 00000100:00100000:3.0:1787368030.309542:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368030.309546:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+6:17141:x1874190808554624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368030.309553:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368030.309563:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0317e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0317e1 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.309578:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0317e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0317e1 expref: 7 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.309585:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0317e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0317e1 expref: 7 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.309592:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75e00, rc 0) 00000100:00100000:3.0:1787368030.309623:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+7:17141:x1874190808554624:12345-0@lo:101:mount.lustre.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.309629:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787368030.309685:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368030.309694:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.309701:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368030.309712:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787368030.309718:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.309725:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368030.309741:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787368030.309752:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787368030.309755:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c5483e3e800 10000000:01000000:0.0:1787368030.309758:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787368030.309761:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787368030.309763:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787368030.309775:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.309782:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.309789:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368030.309798:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787368030.309819:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368030.309837:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54836063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.309874:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808554752 00000100:00100000:3.0:1787368030.309878:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808554752 00000100:00100000:3.0:1787368030.309893:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787368030.309897:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+7:17141:x1874190808554752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368030.309903:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368030.309909:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74000/0x66f5679bff0317f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0317ef expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.309922:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74000/0x66f5679bff0317f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0317ef expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.309935:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74000/0x66f5679bff0317f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0317ef expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.309942:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74000, rc 0) 00000100:00100000:3.0:1787368030.309971:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+8:17141:x1874190808554752:12345-0@lo:101:mount.lustre.0 Request processed in 73us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.309977:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787368030.310089:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368030.310098:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.310106:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368030.310140:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368030.310161:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368030.310193:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54836063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.310233:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808554880 00000100:00100000:3.0:1787368030.310236:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808554880 00000100:00100000:3.0:1787368030.310250:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787368030.310255:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+8:17141:x1874190808554880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368030.310380:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+9:17141:x1874190808554880:12345-0@lo:501:mount.lustre.0 Request processed in 123us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.310386:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787368030.310512:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808554880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368030.310536:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808555008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368030.310575:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368030.310591:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54836063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.310631:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808555008 00000100:00100000:3.0:1787368030.310635:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808555008 00000100:00100000:3.0:1787368030.310650:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787368030.310655:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+9:17141:x1874190808555008:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368030.311152:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+9:17141:x1874190808555008:12345-0@lo:503:mount.lustre.0 Request processed in 495us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.311159:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787368030.311235:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808555008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368030.311555:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17180:1874190808555136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368030.311589:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.311609:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808555136 00000100:00100000:3.0:1787368030.311612:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808555136 00000100:00100000:3.0:1787368030.311636:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787368030.311642:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+9:17180:x1874190808555136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368030.312100:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+9:17180:x1874190808555136:12345-0@lo:502:llog_process_th.0 Request processed in 456us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.312106:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787368030.312142:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.312154:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17180:1874190808555136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787368030.312172:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368030.312193:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.312195:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787368030.312200:0:17180:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787368030.312202:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787368030.312216:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c55bd6db370) 00000020:00000080:3.0:1787368030.312229:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787368030.312233:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787368030.312294:0:17180:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787368030.312301:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff031804 00000020:00000080:3.0:1787368030.312760:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787368030.312767:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368030.312772:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.312773:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787368030.312776:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368030.312780:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.312781:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787368030.312784:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787368030.312792:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c55bd6d8000) 00000020:00000080:3.0:1787368030.312802:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787368030.312805:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787368030.312806:0:17180:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787368030.312809:0:17180:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787368030.312824:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787368030.312875:0:17180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5483e3e800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787368030.312897:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c55b5ca4d28) 00000020:00000080:3.0:1787368030.312904:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787368030.312950:0:17180:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787368030.312956:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff031819 00000020:00000080:3.0:1787368030.313253:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787368030.313263:0:17180:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787368030.313268:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x66f5679bff031820 00080000:01000000:3.0:1787368030.313274:0:17180:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787368030.313276:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff031827 00010000:00010000:2.0:1787368030.372484:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787368030.373071:0:17180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787368030.374255:0:17180:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787368030.374968:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c5482770000) 00000020:00000080:2.0:1787368030.374996:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787368030.375062:0:17180:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787368030.375068:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff031835 00000020:00000080:3.0:1787368030.375834:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787368030.379083:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x66f5679bff03183c 00000020:00000080:3.0:1787368030.380272:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787368030.380285:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368030.380291:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.380293:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787368030.380296:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787368030.380299:0:17180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787368030.380301:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787368030.380302:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787368030.380304:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787368030.380306:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.380307:0:17180:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787368030.380310:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368030.380314:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.380315:0:17180:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787368030.380319:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787368030.380378:0:17180:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787368030.380392:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368030.380394:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.380396:0:17180:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787368030.380398:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368030.380402:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.380408:0:17180:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787368030.380412:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787368030.380417:0:17180:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:3.0:1787368030.380440:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787368030.380455:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c55b5ca19b8) 00000020:00000080:3.0:1787368030.380468:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787368030.380472:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787368030.380519:0:17180:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787368030.380525:0:17180:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787368030.380531:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff03184a 00010000:00080000:3.0:1787368030.380561:0:17180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55834d0000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1787368030.382166:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1787368030.390504:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787368030.390519:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787368030.390559:0:17180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787368030.390581:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff031851 00000100:00080000:0.0:1787368030.390591:0:17180:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368030.390597:0:17180:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55834d0000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368030.390632:0:17180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b6040e00 x1874190808555264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368030.390673:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808555264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368030.390864:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787368030.390936:0:17180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787368030.391006:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368030.391010:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368030.391012:0:17180:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787368030.391015:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787368030.391018:0:17180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1787368030.391019:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368030.391021:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368030.391022:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787368030.391024:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368030.391025:0:17180:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787368030.391028:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787368030.391038:0:17180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787368030.391042:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368030.391044:0:17180:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787368030.391047:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787368030.391051:0:17180:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1787368030.391073:0:17180:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787368030.391075:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368030.391089:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c54826b99b8) 00000020:00000080:0.0:1787368030.391101:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787368030.391106:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787368030.391172:0:17180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787368030.391189:0:17180:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787368030.391196:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff03185f 00010000:00080000:0.0:1787368030.391233:0:17180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55a9345000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368030.391486:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787368030.392724:0:17180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787368030.392963:0:17180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787368030.393258:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808555264 00000100:00100000:1.0:1787368030.393269:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808555264 00000100:00100000:1.0:1787368030.393305:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787368030.393313:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808555264:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787368030.393341:0:17167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:0.0:1787368030.398213:0:17180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368030.400346:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787368030.411289:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787368030.412412:0:17186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787368030.412418:0:17186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787368030.413525:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787368030.413538:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787368030.413575:0:17180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787368030.413596:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff031866 00000100:00080000:0.0:1787368030.413607:0:17180:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368030.413614:0:17180:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c55a9345000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368030.413648:0:17180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b6041f80 x1874190808555392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368030.413684:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808555392:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787368030.413735:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808555392 offset 0 length 520: 4 00000100:00080000:0.0:1787368030.415285:0:17180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787368030.415445:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368030.415452:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368030.415454:0:17180:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787368030.415458:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787368030.415460:0:17180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1787368030.415462:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368030.415463:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368030.415465:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787368030.415467:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368030.415469:0:17180:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787368030.415471:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787368030.415476:0:17180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787368030.415480:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368030.415481:0:17180:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787368030.415484:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787368030.415488:0:17180:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1787368030.415510:0:17180:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787368030.415512:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368030.415527:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c54826bb370) 00000020:00000080:0.0:1787368030.415544:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787368030.415550:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787368030.415636:0:17180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787368030.415641:0:17180:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787368030.415649:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff031874 00010000:00080000:0.0:1787368030.415677:0:17180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55867d7000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368030.415897:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787368030.415958:0:17180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787368030.415973:0:17180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787368030.422859:0:17180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368030.423466:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787368030.423596:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1787368030.426956:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808555264:12345-0@lo:38:llog_process_th.0 Request processed in 33637us (36202us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368030.426970:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787368030.427067:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787368030.427074:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787368030.427078:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808555264:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787368030.427407:0:17188:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787368030.427412:0:17188:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787368030.429322:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787368030.429511:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787368030.429604:0:17180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787368030.429624:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff03187b 00000100:00080000:1.0:1787368030.429633:0:17180:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787368030.429638:0:17180:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c55867d7000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368030.429672:0:17180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4c380 x1874190808555520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368030.429732:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808555520:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787368030.429807:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808555520 offset 0 length 520: 4 00000100:00080000:1.0:1787368030.429860:0:17180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787368030.429928:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787368030.429933:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368030.429935:0:17180:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787368030.429938:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787368030.429942:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368030.429943:0:17180:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787368030.429946:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787368030.429954:0:17180:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787368030.429957:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787368030.429960:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368030.429961:0:17180:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787368030.429963:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787368030.429966:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368030.429967:0:17180:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787368030.429971:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787368030.430001:0:17180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17180:1874190808555648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368030.430046:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368030.430073:0:17180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55882c3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.430268:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808555648 00000100:00100000:3.0:1787368030.430275:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808555648 00000100:00100000:3.0:1787368030.430316:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368030.430333:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+9:17180:x1874190808555648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368030.430499:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+9:17180:x1874190808555648:12345-0@lo:502:llog_process_th.0 Request processed in 175us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.430508:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787368030.430786:0:17180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17180:1874190808555648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787368030.430814:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787368030.430820:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368030.430822:0:17180:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787368030.430826:0:17180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787368030.431013:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787368030.431037:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787368030.431057:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.431068:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368030.431083:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c5483e3e800 from 1 10000000:01000000:3.0:1787368030.431086:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787368030.431111:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.431119:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.431137:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368030.431152:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808555776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787368030.431191:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.431220:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787368030.431316:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808555776 00000100:00100000:2.0:1787368030.431321:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808555776 00000100:00100000:2.0:1787368030.431377:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787368030.431385:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+9:17141:x1874190808555776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368030.431395:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368030.431407:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031882 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.431437:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031882 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.431447:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031882 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.431456:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241da00, rc 0) 00000100:00100000:2.0:1787368030.431487:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+10:17141:x1874190808555776:12345-0@lo:101:mount.lustre.0 Request processed in 103us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368030.431494:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368030.431655:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808555776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368030.431668:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.431677:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368030.432240:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808555904:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787368030.432284:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.432330:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.432378:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808555904 00000100:00100000:3.0:1787368030.432382:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808555904 00000100:00100000:3.0:1787368030.432410:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787368030.432444:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+10:17141:x1874190808555904:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787368030.432459:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787368030.432464:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787368030.432527:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+10:17141:x1874190808555904:12345-0@lo:256:mount.lustre.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.432534:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787368030.432955:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808555904:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787368030.434035:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787368030.434059:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.434073:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368030.434080:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5483e3e800 from 1 10000000:01000000:3.0:1787368030.434083:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787368030.434118:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.434197:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.434208:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368030.434227:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787368030.434280:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.434313:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787368030.434972:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808556032 00000100:00100000:0.0:1787368030.434981:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808556032 00000100:00100000:0.0:1787368030.435037:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787368030.435046:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+10:17141:x1874190808556032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368030.435060:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368030.435076:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031890 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.435098:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031890 expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.435108:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031890 expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368030.435116:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b000, rc 0) 00000100:00100000:0.0:1787368030.435172:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+11:17141:x1874190808556032:12345-0@lo:101:mount.lustre.0 Request processed in 127us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368030.435186:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787368030.435348:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368030.435392:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.435402:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368030.435457:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368030.435482:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.435501:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787368030.435671:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808556160 00000100:00100000:0.0:1787368030.435675:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808556160 00000100:00100000:0.0:1787368030.435703:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787368030.435710:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+11:17141:x1874190808556160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368030.435931:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+11:17141:x1874190808556160:12345-0@lo:501:mount.lustre.0 Request processed in 221us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368030.435938:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787368030.435996:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368030.436020:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368030.436054:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.436097:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787368030.436237:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808556288 00000100:00100000:1.0:1787368030.436242:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808556288 00000100:00100000:1.0:1787368030.436300:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787368030.436307:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+11:17141:x1874190808556288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368030.436410:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+11:17141:x1874190808556288:12345-0@lo:503:mount.lustre.0 Request processed in 103us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368030.436416:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368030.436566:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368030.436975:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17190:1874190808556416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368030.437009:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.437239:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368030.437292:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808556416 00000100:00100000:0.0:1787368030.437296:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808556416 00000100:00100000:0.0:1787368030.437319:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787368030.437420:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+11:17190:x1874190808556416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787368030.437907:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+11:17190:x1874190808556416:12345-0@lo:502:llog_process_th.0 Request processed in 488us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368030.437915:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787368030.438066:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17190:1874190808556416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787368030.438090:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368030.438098:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.438100:0:17190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787368030.438106:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c5483e3e800 00000020:00000080:3.0:1787368030.438109:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368030.438116:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368030.438118:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.438193:0:17190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787368030.438197:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368030.438201:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.438202:0:17190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787368030.438205:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c5483e3e800 00000020:00000080:3.0:1787368030.438207:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368030.438297:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368030.438301:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.438302:0:17190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787368030.438305:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368030.438307:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.438308:0:17190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787368030.438311:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c5483e3e800 00000020:00000080:3.0:1787368030.438313:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368030.443188:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368030.443204:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.443207:0:17190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787368030.443211:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368030.443215:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.443217:0:17190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787368030.443222:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c5483e3e800 00000020:00000080:3.0:1787368030.443224:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787368030.443307:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17190:1874190808556544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368030.443412:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.443585:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368030.443636:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808556544 00000100:00100000:2.0:1787368030.443643:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808556544 00000100:00100000:2.0:1787368030.443692:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787368030.443706:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+11:17190:x1874190808556544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787368030.443823:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+11:17190:x1874190808556544:12345-0@lo:502:llog_process_th.0 Request processed in 122us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368030.443831:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787368030.444156:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17190:1874190808556544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787368030.444192:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368030.444199:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368030.444201:0:17190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787368030.444205:0:17190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787368030.444307:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787368030.444343:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787368030.444412:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.444422:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368030.444475:0:17141:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787368030.444479:0:17141:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c5483e3e800 10000000:01000000:2.0:1787368030.444481:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c5483e3e800 10000000:01000000:2.0:1787368030.444488:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787368030.444494:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c5483e3e800 from 1 10000000:01000000:2.0:1787368030.444496:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787368030.444524:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.444532:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.444540:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368030.444555:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368030.444590:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368030.444610:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.445254:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808556672 00000100:00100000:3.0:1787368030.445267:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808556672 00000100:00100000:3.0:1787368030.445301:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787368030.445309:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+11:17141:x1874190808556672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368030.445319:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368030.445333:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74200/0x66f5679bff0318a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03189e expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.445381:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74200/0x66f5679bff0318a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03189e expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.445393:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74200/0x66f5679bff0318a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03189e expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.445402:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74200, rc 0) 00000100:00100000:3.0:1787368030.445452:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+12:17141:x1874190808556672:12345-0@lo:101:mount.lustre.0 Request processed in 143us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.445467:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787368030.445477:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368030.445490:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368030.445499:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368030.445559:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368030.445587:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368030.445624:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787368030.445691:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808556800 00000100:00100000:1.0:1787368030.445695:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808556800 00000100:00100000:1.0:1787368030.445728:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787368030.445735:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+12:17141:x1874190808556800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368030.445841:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+12:17141:x1874190808556800:12345-0@lo:501:mount.lustre.0 Request processed in 106us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368030.445859:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787368030.446390:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368030.446421:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368030.446461:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368030.446480:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.446627:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808556928 00000100:00100000:3.0:1787368030.446632:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808556928 00000100:00100000:3.0:1787368030.446661:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787368030.446668:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17141:x1874190808556928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368030.446758:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17141:x1874190808556928:12345-0@lo:503:mount.lustre.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.446765:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787368030.446829:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808556928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368030.448488:0:17192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17192:1874190808557056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368030.448551:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368030.448583:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808557056 00000100:00100000:1.0:1787368030.448588:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808557056 00000100:00100000:1.0:1787368030.448621:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787368030.448629:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+12:17192:x1874190808557056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368030.448722:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+12:17192:x1874190808557056:12345-0@lo:502:llog_process_th.0 Request processed in 93us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368030.448730:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787368030.448788:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368030.448805:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17192:1874190808557056:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787368030.448859:0:17192:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787368030.448874:0:17192:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c559124cd28) 00000020:00000080:1.0:1787368030.448893:0:17192:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787368030.448971:0:17192:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5483e3e800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787368030.448976:0:17192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c5483e3e800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787368030.448978:0:17192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5483e3e800 4 00010000:00080000:1.0:1787368030.449012:0:17192:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55a9341000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1787368030.455501:0:17192:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787368030.458659:0:17192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787368030.458707:0:17192:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787368030.458720:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x66f5679bff0318b3 00000100:00080000:3.0:1787368030.458731:0:17192:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787368030.458737:0:17192:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c55a9341000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368030.458776:0:17192:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c548278f480 x1874190808557184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787368030.458806:0:17192:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787368030.459100:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808557184:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368030.459164:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368030.460601:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808557184 00000100:00100000:1.0:1787368030.460613:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808557184 00000100:00100000:1.0:1787368030.460648:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787368030.460656:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808557184:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787368030.460744:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808557184:12345-0@lo:38:llog_process_th.0 Request processed in 87us (1579us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787368030.461933:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368030.461942:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55a9341000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787368030.461948:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787368030.461952:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808557184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787368030.461968:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787368030.463609:0:17192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17192:1874190808557312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368030.466742:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.466782:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808557312 00000100:00100000:3.0:1787368030.466790:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808557312 00000100:00100000:3.0:1787368030.466844:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787368030.466853:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17192:x1874190808557312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368030.468329:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17192:x1874190808557312:12345-0@lo:502:llog_process_th.0 Request processed in 1472us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368030.468341:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787368030.468414:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.468437:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17192:1874190808557312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368030.468502:0:17192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17192:1874190808557440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368030.469222:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.469257:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787368030.469272:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808557440 00000100:00100000:1.0:1787368030.469277:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808557440 00000100:00100000:1.0:1787368030.469316:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787368030.469336:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+12:17192:x1874190808557440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368030.469459:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+12:17192:x1874190808557440:12345-0@lo:502:llog_process_th.0 Request processed in 135us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368030.469466:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787368030.469608:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3ce871c-8318-4c29-9238-0157d9966155:17192:1874190808557440:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787368030.469631:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787368030.469698:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787368030.469720:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787368030.469740:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.469750:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787368030.469803:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787368030.469805:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787368030.469807:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368030.469808:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368030.469809:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368030.469810:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368030.469811:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787368030.469813:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787368030.469815:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368030.469816:0:17141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787368030.469819:0:17141:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787368030.469821:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787368030.469823:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787368030.469824:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368030.469825:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368030.469826:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368030.469827:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368030.469828:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787368030.469829:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787368030.469830:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368030.469832:0:17141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787368030.469847:0:17141:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787368030.469858:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808557568:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787368030.470659:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368030.470683:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368030.470703:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808557568 00000100:00100000:3.0:1787368030.470707:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808557568 00000100:00100000:3.0:1787368030.470748:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787368030.470756:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17141:x1874190808557568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787368030.470780:0:17157:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787368030.470793:0:17157:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787368030.481788:0:17157:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787368030.481838:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787368030.482277:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17141:x1874190808557568:12345-0@lo:253:mount.lustre.0 Request processed in 11518us (11615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368030.482290:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787368030.482461:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17141:1874190808557568:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787368030.482476:0:17141:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787368030.482479:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787368030.482481:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787368030.482482:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787368030.482483:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787368030.482485:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787368030.482486:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787368030.482487:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787368030.482489:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787368030.482490:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787368030.482492:0:17141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787368030.482506:0:17141:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787368030.486687:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787368030.486696:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787368030.487505:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.487525:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031882 expref: 11 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.487535:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.487574:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff031882 expref: 11 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.487588:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff031882 expref: 11 pid: 17154 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368030.487602:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808557696:0@lo:104: 00000100:00100000:1.0:1787368030.487669:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368030.487721:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808557696 00000100:00100000:1.0:1787368030.487849:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808557696 00000100:00100000:1.0:1787368030.487963:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787368030.487973:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808557696:12345-0@lo:104: 00010000:00010000:1.0:1787368030.487987:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.488031:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787368030.488037:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808557696:12345-0@lo:104: Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368030.488044:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787368030.488066:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368030.488072:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.488080:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74e00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368030.488084:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.488093:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368030.488100:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368030.488106:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787368030.488269:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.488285:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787368030.488373:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787368030.488407:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.488415:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031882 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031889 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.488430:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368030.488431:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368030.488433:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368030.488480:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368030.488499:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808557696:0@lo:104: 00010000:00010000:1.0:1787368030.488515:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368030.489082:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808557824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368030.489250:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368030.489343:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808557824 00000100:00100000:1.0:1787368030.489350:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808557824 00010000:00010000:1.0:1787368030.489402:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031882 expref: 12 pid: 17154 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368030.489427:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787368030.489435:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3ce871c-8318-4c29-9238-0157d9966155+12:3652:x1874190808557824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368030.489446:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368030.489452:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031882 expref: 12 pid: 17154 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489463:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff031882 expref: 12 pid: 17154 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489493:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241da00/0x66f5679bff031889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff031882 expref: 12 pid: 17154 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489507:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489515:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787368030.489529:0:17147:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002833574s 00010000:00010000:1.0:1787368030.489533:0:17147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489539:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489545:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489551:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489556:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368030.489560:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489568:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489585:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368030.489600:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368030.489631:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3ce871c-8318-4c29-9238-0157d9966155+11:3652:x1874190808557824:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368030.489639:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787368030.489716:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808557824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368030.489852:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.489927:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368030.489935:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bd67f000/0x66f5679bff0318ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787368030.513673:0:17141:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787368030.515638:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787368030.515818:0:17202:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787368030.515822:0:17202:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787368030.518695:0:17203:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787368030.518795:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787368030.519446:0:17203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787368030.520596:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787368030.520645:0:17141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1787368030.521055:0:17204:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c548278ea00 x1874190808557952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368030.521067:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00000004:00000080:1.0:1787368030.522632:0:17141:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787368030.522652:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787368030.522855:0:17141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787368030.524959:0:17203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787368030.525029:0:17203:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1787368030.526550:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787368030.527572:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787368030.527619:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787368030.528645:0:17141:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1787368030.529981:0:17141:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1787368030.532664:0:17141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787368030.534539:0:17141:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787368030.534573:0:17141:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafad0145b988 00100000:10000000:1.0:1787368030.534580:0:17141:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787368030.537676:0:17141:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787368030.537692:0:17141:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787368030.537711:0:17141:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787368030.537738:0:17141:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787368030.538696:0:17141:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787368030.539265:0:17141:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787368031.135448:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787368031.519306:0:17198:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787368031.519315:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787368031.536390:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787368031.536403:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787368031.576510:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 10000000:01000000:1.0:1787368032.088422:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787368032.088438:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c5483e3e800 from 7 10000000:01000000:1.0:1787368032.088442:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787368032.088516:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368032.088528:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368032.088539:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368032.088564:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808558080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787368032.088629:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368032.088686:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787368032.089069:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808558080 00000100:00100000:2.0:1787368032.089077:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808558080 00000100:00100000:2.0:1787368032.089132:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787368032.089142:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+11:17159:x1874190808558080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368032.089162:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368032.089185:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0318c1 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368032.089209:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0318c1 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368032.089220:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0318c1 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368032.089229:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c200, rc 0) 00000100:00100000:2.0:1787368032.089280:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+12:17159:x1874190808558080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368032.089287:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787368032.089331:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808558080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368032.089346:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368032.089380:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368032.089430:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808558208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787368032.089461:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368032.089551:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787368032.089565:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808558208 00000100:00100000:1.0:1787368032.089569:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808558208 00000100:00100000:1.0:1787368032.089594:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787368032.089600:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17159:x1874190808558208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787368032.089612:0:17157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787368032.089629:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787368032.089632:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787368032.089703:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17159:x1874190808558208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368032.089710:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787368032.089740:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808558208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787368032.089954:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787368032.089960:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368032.089969:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368032.153567:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368032.606107:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00000040:00080000:1.0:1787368032.607237:0:17198:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787368032.607244:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787368032.607393:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787368032.607432:0:17198:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787368032.607572:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1787368033.180534:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368033.625472:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787368034.204666:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368034.649409:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00000001:02000400:2.0:1787368034.804997:0:17447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787368035.224810:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368035.675242:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00000100:00080000:3.0:1787368035.741811:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787368035.741817:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787368035.741821:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368035.741829:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:3.0:1787368035.741834:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787368035.741840:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55834d0000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368035.741872:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c548278d500 x1874190808558464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787368035.741889:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368035.741893:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368035.741895:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368035.741898:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368035.741900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787368035.741903:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787368035.741905:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55a9341000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368035.741910:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c55a9341000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368035.741923:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c548278df80 x1874190808558592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368035.741952:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808558336:0@lo:400:kworker.0 00000100:00100000:3.0:1787368035.742016:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368035.742091:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808558464:0@lo:38:kworker.0 00000100:00100000:3.0:1787368035.742121:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368035.742139:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808558592:0@lo:38:kworker.0 00000100:00100000:3.0:1787368035.742177:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368035.742220:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808558464 00000100:00100000:3.0:1787368035.742227:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808558464 00000100:00100000:3.0:1787368035.742258:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787368035.742265:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808558464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787368035.742281:0:17168:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787368035.743450:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808558592 00000100:00100000:0.0:1787368035.743460:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808558592 00000100:00100000:0.0:1787368035.743495:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787368035.743502:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874190808558592:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787368035.743524:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:0.0:1787368035.743561:0:17164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x66f5679bff0318cf 00000004:00100000:0.0:1787368035.743585:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787368035.743724:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9c55867de000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368035.743794:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874190808558592:12345-0@lo:38:kworker.0 Request processed in 291us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368035.743801:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787368035.744931:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c548278df80 x1874190808558592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787368035.744949:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787368035.744956:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787368035.744961:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787368035.744964:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55a9341000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787368035.744970:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808558592:0@lo:38:kworker.0 00000100:00100000:2.0:1787368035.745201:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808558336 00000100:00100000:2.0:1787368035.745207:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808558336 00000100:00100000:2.0:1787368035.745255:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787368035.745264:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+12:3652:x1874190808558336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368035.745325:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+12:3652:x1874190808558336:12345-0@lo:400:kworker.0 Request processed in 62us (3308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368035.745333:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787368035.745390:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808558336:0@lo:400:kworker.0 00000100:00100000:3.0:1787368035.767962:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808558464:12345-0@lo:38:kworker.0 Request processed in 25689us (25832us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787368035.767977:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787368035.768169:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368035.768175:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787368035.768187:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808558464:0@lo:38:kworker.0 00000020:00000004:0.0:1787368035.782064:0:17499:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787368035.782227:0:17499:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787368036.248557:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368036.696484:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00000020:00000004:3.0:1787368036.698520:0:17549:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787368036.698707:0:17549:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787368037.273228:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368037.721625:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787368038.296474:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368038.744679:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787368039.320681:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368039.770507:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787368040.344516:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368040.793301:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00000100:00080000:2.0:1787368040.856548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787368040.856555:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787368040.856559:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368040.856566:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1787368040.856572:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787368040.856578:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55834d0000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368040.856601:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5482621180 x1874190808558848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787368040.856619:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368040.856623:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368040.856625:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368040.856628:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787368040.856654:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368030/real 1787368030] req@ffff9c5483c4c380 x1874190808555520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368040.856677:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c5483c4c380 x1874190808555520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368040.856686:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368030/real 1787368030] req@ffff9c55b6041f80 x1874190808555392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368040.856696:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55b6041f80 x1874190808555392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368040.856715:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808558848:0@lo:38:kworker.0 00000100:00100000:2.0:1787368040.856781:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787368040.856823:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787368040.856834:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787368040.856838:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808555520:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787368040.856843:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55a9345000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787368040.856848:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787368040.856851:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808555392:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787368040.856875:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368040.856878:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787368040.856880:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55a9345000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368040.856883:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1787368040.856886:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787368040.856890:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c55a9345000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368040.856902:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5482622a00 x1874190808559104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787368040.856926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368040.856928:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787368040.856930:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55867d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368040.856933:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1787368040.856935:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787368040.856939:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c55867d7000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368040.856949:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5482620380 x1874190808559232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787368040.856966:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808559104:0@lo:8:kworker.0 00000400:00000100:2.0:1787368040.856997:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808559104 offset 0 length 520: 4 00000100:00100000:2.0:1787368040.857017:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808559232:0@lo:8:kworker.0 00000400:00000100:2.0:1787368040.857036:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808559232 offset 0 length 520: 4 00000100:00100000:3.0:1787368040.857183:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808558720:0@lo:400:kworker.0 00000100:00100000:3.0:1787368040.857217:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368040.857246:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787368040.857252:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808558976:0@lo:400:kworker.0 00000100:00100000:3.0:1787368040.857279:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368040.857335:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808558720 00000100:00100000:2.0:1787368040.857341:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808558720 00000100:00100000:2.0:1787368040.857410:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787368040.857420:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+12:3653:x1874190808558720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368040.857467:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+12:3653:x1874190808558720:12345-0@lo:400:kworker.0 Request processed in 48us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368040.857474:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787368040.857588:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808558848 00000100:00100000:1.0:1787368040.857592:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808558848 00000100:00100000:1.0:1787368040.857619:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787368040.857623:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808558848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787368040.857639:0:17167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787368040.858563:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808558720:0@lo:400:kworker.0 00000100:00100000:0.0:1787368040.864477:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808558976 00000100:00100000:0.0:1787368040.864489:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808558976 00000100:00100000:0.0:1787368040.864548:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787368040.864560:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808558976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368040.864654:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808558976:12345-0@lo:400:kworker.0 Request processed in 97us (7374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368040.864662:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787368040.865458:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c5482622680 x1874190808558976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368040.865477:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808558976:0@lo:400:kworker.0 00000100:00100000:1.0:1787368040.873457:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808558848:12345-0@lo:38:kworker.0 Request processed in 15824us (16668us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368040.873470:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787368040.873524:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368040.873529:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787368040.873533:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808558848:0@lo:38:kworker.0 00010000:00010000:2.0:1787368041.368529:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368041.825605:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787368042.392473:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368042.840418:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00000040:00080000:3.0:1787368042.841119:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1787368043.281760:0:17894:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787368043.281764:0:17894:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787368043.281765:0:17894:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787368043.282294:0:17894:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c55a0f12000 00000020:01000004:3.0:1787368043.282312:0:17894:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787368043.282324:0:17894:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787368043.282339:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c55b5ca3370) 00000020:00000080:3.0:1787368043.282513:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787368043.350396:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.352310:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787368043.354637:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.355571:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.355768:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.356465:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.356731:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.357128:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.357461:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.357692:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.360995:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.363313:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.363747:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.364306:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.364956:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.365447:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.366352:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.367449:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.367712:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.368087:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.368480:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.368686:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.369479:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787368043.369998:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787368043.370986:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787368043.371646:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787368043.371967:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1787368043.372459:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787368043.372654:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787368043.372955:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787368043.373322:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787368043.373528:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787368043.373702:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787368043.373992:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787368043.375591:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787368043.375814:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787368043.376427:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787368043.377100:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787368043.377964:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787368043.378525:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787368043.378740:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787368043.379118:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787368043.379563:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787368043.379766:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787368043.380318:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787368043.380559:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:01000000:2.0:1787368043.383782:0:17894:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787368043.384546:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787368043.384558:0:17894:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787368043.384569:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff0318dd 00000020:01000004:2.0:1787368043.384576:0:17894:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787368043.384595:0:17894:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787368043.384599:0:17894:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787368043.384604:0:17894:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787368043.384633:0:17894:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787368043.384637:0:17894:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787368043.391063:0:17894:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787368043.391110:0:17894:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787368043.391115:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787368043.391116:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787368043.391118:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368043.391119:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368043.391121:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368043.391122:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368043.391124:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787368043.391125:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368043.391127:0:17894:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787368043.391135:0:17894:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787368043.391137:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787368043.391138:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787368043.391139:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368043.391140:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368043.391141:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368043.391142:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368043.391143:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787368043.391144:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368043.391145:0:17894:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787368043.391185:0:17894:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787368043.391212:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559360:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787368043.391284:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.391337:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586700a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368043.391669:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808559360 00000100:00100000:1.0:1787368043.391677:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808559360 00000100:00100000:1.0:1787368043.391741:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787368043.391750:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17894:x1874190808559360:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787368043.391791:0:17157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787368043.391794:0:17157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787368043.391813:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787368043.392459:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+12:17894:x1874190808559360:12345-0@lo:253:mount.lustre.0 Request processed in 708us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368043.392468:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787368043.392616:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559360:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787368043.392627:0:17894:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787368043.392629:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787368043.392631:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787368043.392632:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368043.392633:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368043.392634:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368043.392635:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368043.392636:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787368043.392638:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368043.392639:0:17894:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787368043.392654:0:17894:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c55a0f12000 from lustre-MDT0001 10000000:01000000:3.0:1787368043.392675:0:17894:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787368043.392678:0:17894:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787368043.392684:0:17894:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c5591248000 local copy 00010000:00010000:3.0:1787368043.392694:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368043.392784:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368043.392825:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.392955:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368043.393623:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808559488 00000100:00100000:0.0:1787368043.393630:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808559488 00000100:00100000:0.0:1787368043.393702:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787368043.393712:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+12:17894:x1874190808559488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368043.393792:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+12:17894:x1874190808559488:12345-0@lo:501:mount.lustre.0 Request processed in 81us (966us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787368043.393807:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787368043.393871:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559488:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787368043.393886:0:17894:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787368043.393907:0:17894:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787368043.393913:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.393923:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368043.393946:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c55a0f12000 10000000:01000000:2.0:1787368043.393951:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787368043.393955:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c5591248000 10000000:01000000:2.0:1787368043.393957:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787368043.393960:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c5591248000 from 1 10000000:01000000:2.0:1787368043.393963:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787368043.393986:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.393993:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.394021:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368043.394034:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368043.394060:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.394678:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5599331840 going to sleep for 11 seconds 00000100:00100000:3.0:1787368043.394764:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808559616 00000100:00100000:3.0:1787368043.394769:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808559616 00000100:00100000:3.0:1787368043.394796:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787368043.394814:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+12:17894:x1874190808559616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368043.394823:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368043.394846:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74a00/0x66f5679bff0318eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0318e4 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.394870:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74a00/0x66f5679bff0318eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0318e4 expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.394881:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74a00/0x66f5679bff0318eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0318e4 expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.394890:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74a00, rc 0) 00000100:00100000:3.0:1787368043.394934:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+13:17894:x1874190808559616:12345-0@lo:101:mount.lustre.0 Request processed in 121us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368043.394941:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787368043.395121:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368043.395134:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318eb expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.395143:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0318eb expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368043.395172:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787368043.395191:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318eb expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.395206:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318eb expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368043.395216:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c55a0f12000 10000000:01000000:2.0:1787368043.395220:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787368043.395224:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c55a0f12000 from 1 10000000:01000000:2.0:1787368043.395227:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787368043.395252:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.395259:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.395277:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368043.395292:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368043.395321:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.395333:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5599331840 going to sleep for 11 seconds 00000100:00100000:3.0:1787368043.395654:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808559744 00000100:00100000:3.0:1787368043.395659:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808559744 00000100:00100000:3.0:1787368043.395680:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787368043.395686:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+13:17894:x1874190808559744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368043.395694:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368043.395702:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74800/0x66f5679bff0318f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0318f2 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.395717:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74800/0x66f5679bff0318f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0318f2 expref: 14 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.395736:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74800/0x66f5679bff0318f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0318f2 expref: 14 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.395743:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74800, rc 0) 00000100:00100000:3.0:1787368043.395782:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+14:17894:x1874190808559744:12345-0@lo:101:mount.lustre.0 Request processed in 95us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368043.395788:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787368043.395952:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368043.395964:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.395973:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368043.395984:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787368043.396006:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.396014:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368043.396020:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787368043.396024:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787368043.396028:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c55a0f12000 10000000:01000000:2.0:1787368043.396031:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787368043.396035:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787368043.396037:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787368043.396051:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.396064:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.396073:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368043.396086:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368043.396125:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.396144:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5599331840 going to sleep for 11 seconds 00000100:00100000:3.0:1787368043.396456:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808559872 00000100:00100000:3.0:1787368043.396461:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808559872 00000100:00100000:3.0:1787368043.396484:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787368043.396491:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+14:17894:x1874190808559872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368043.396499:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368043.396507:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74c00/0x66f5679bff031907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031900 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.396522:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74c00/0x66f5679bff031907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031900 expref: 15 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.396531:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74c00/0x66f5679bff031907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031900 expref: 15 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.396536:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74c00, rc 0) 00000100:00100000:3.0:1787368043.396565:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808559872:12345-0@lo:101:mount.lustre.0 Request processed in 75us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368043.396571:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787368043.396644:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808559872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368043.396655:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.396663:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787368043.398947:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1787368043.399974:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787368043.405688:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787368043.405743:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787368043.405760:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787368043.405773:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787368043.405793:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1787368043.405941:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1787368043.405957:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1787368043.405971:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787368043.405983:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787368043.405996:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1787368043.406088:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1787368043.406114:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1787368043.406127:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1787368043.406139:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787368043.406153:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787368043.406341:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1787368043.406453:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787368043.406473:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787368043.406486:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1787368043.406498:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787368043.406510:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787368043.406527:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787368043.406540:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787368043.406569:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1787368043.406575:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1787368043.406675:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808560000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368043.406747:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.406930:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 11 seconds 00000100:00100000:0.0:1787368043.407595:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808560000 00000100:00100000:0.0:1787368043.407602:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808560000 00000100:00100000:0.0:1787368043.407681:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787368043.407692:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808560000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368043.407864:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808560000:12345-0@lo:501:mount.lustre.0 Request processed in 173us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368043.407873:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787368043.407941:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808560000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368043.407979:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808560128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368043.408038:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.408551:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787368043.408631:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808560128 00000100:00100000:3.0:1787368043.408636:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808560128 00000100:00100000:3.0:1787368043.408662:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787368043.408670:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808560128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368043.409613:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808560128:12345-0@lo:503:mount.lustre.0 Request processed in 940us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368043.409623:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787368043.409705:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808560128:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787368043.410280:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787368043.410395:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808560256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368043.410440:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.410468:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55982fe900 going to sleep for 11 seconds 00000100:00100000:3.0:1787368043.410740:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808560256 00000100:00100000:3.0:1787368043.410746:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808560256 00000100:00100000:3.0:1787368043.410776:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787368043.410785:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808560256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368043.412473:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808560256:12345-0@lo:502:mount.lustre.0 Request processed in 1682us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.412484:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787368043.412621:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808560256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787368043.412952:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787368043.412982:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1787368043.412995:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1787368043.413083:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1787368043.413112:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1787368043.413126:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1787368043.413140:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1787368043.413318:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1787368043.413341:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1787368043.413472:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1787368043.413493:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1787368043.413508:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1787368043.413522:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1787368043.413536:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1787368043.413549:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1787368043.413564:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1787368043.413579:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1787368043.413593:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1787368043.413606:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1787368043.413617:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1787368043.413630:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1787368043.413656:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1787368043.413672:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1787368043.413685:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1787368043.413699:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1787368043.413712:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1787368043.413726:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1787368043.413740:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1787368043.413754:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1787368043.413767:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1787368043.413780:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1787368043.413792:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1787368043.415315:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00010000:00010000:1.0:1787368043.416966:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787368043.419523:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1787368043.419573:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1787368043.419588:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1787368043.419605:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1787368043.419618:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1787368043.419632:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1787368043.419644:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1787368043.419656:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1787368043.419668:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1787368043.419680:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1787368043.419692:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1787368043.419739:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808560384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368043.419829:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.421088:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89180 going to sleep for 11 seconds 00000100:00100000:0.0:1787368043.423958:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808560384 00000100:00100000:0.0:1787368043.423971:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808560384 00000100:00100000:0.0:1787368043.424154:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787368043.424174:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808560384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368043.424416:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808560384:12345-0@lo:502:mount.lustre.0 Request processed in 244us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368043.424424:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787368043.424532:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808560384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787368043.424603:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1787368043.424621:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787368043.428632:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368043.428659:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368043.428661:0:17898:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787368043.428668:0:17898:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787368043.428671:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368043.428686:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c54826b8000) 00000020:00000080:0.0:1787368043.428710:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787368043.428716:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787368043.428810:0:17898:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787368043.428819:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff031915 00000020:00000080:0.0:1787368043.429184:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787368043.429190:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368043.429194:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368043.429195:0:17898:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787368043.429476:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368043.429484:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368043.429485:0:17898:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787368043.429490:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368043.429499:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c54826bcd28) 00000020:00000080:0.0:1787368043.429511:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787368043.429516:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787368043.429518:0:17898:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787368043.429520:0:17898:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787368043.429525:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787368043.429586:0:17898:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55a0f12000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787368043.429599:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c55b5543370) 00000020:00000080:0.0:1787368043.429607:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787368043.429654:0:17898:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787368043.429660:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff03192a 00000020:00000080:0.0:1787368043.429755:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787368043.429761:0:17898:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787368043.429765:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x66f5679bff031931 00080000:01000000:0.0:1787368043.429772:0:17898:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787368043.429775:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff031938 00010000:00010000:2.0:1787368043.547184:0:17898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787368043.548151:0:17898:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1787368043.550548:0:17898:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787368043.556520:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787368043.556555:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368043.556562:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.556565:0:17898:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787368043.556569:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368043.556574:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.556575:0:17898:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787368043.556578:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787368043.556584:0:17898:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:3.0:1787368043.556611:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787368043.556626:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c55b5ca0000) 00000020:00000080:3.0:1787368043.556646:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787368043.556650:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787368043.556719:0:17898:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787368043.556725:0:17898:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787368043.556731:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff031946 00010000:00080000:3.0:1787368043.556762:0:17898:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c558335d800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1787368043.565774:0:17898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787368043.568746:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787368043.568761:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787368043.568807:0:17898:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787368043.568828:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff03194d 00000100:00080000:2.0:1787368043.568909:0:17898:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787368043.568915:0:17898:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c558335d800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368043.568948:0:17898:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5482621c00 x1874190808560512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368043.569005:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808560512:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787368043.569069:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787368043.569150:0:17898:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787368043.569241:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368043.569247:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368043.569248:0:17898:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787368043.569251:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787368043.569254:0:17898:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787368043.569256:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368043.569257:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368043.569258:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787368043.569260:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368043.569261:0:17898:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787368043.569264:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368043.569268:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368043.569269:0:17898:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787368043.569273:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787368043.569305:0:17898:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787368043.569319:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368043.569323:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368043.569330:0:17898:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787368043.569334:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787368043.569336:0:17898:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1787368043.569338:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368043.569339:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368043.569341:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787368043.569343:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368043.569345:0:17898:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787368043.569347:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787368043.569350:0:17898:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787368043.569384:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368043.569386:0:17898:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787368043.569390:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787368043.569394:0:17898:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:2.0:1787368043.569413:0:17898:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787368043.569416:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787368043.569430:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c54827719b8) 00000020:00000080:2.0:1787368043.569441:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787368043.569446:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787368043.569502:0:17898:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787368043.569508:0:17898:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787368043.569514:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff03195b 00010000:00080000:2.0:1787368043.569541:0:17898:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5585133000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1787368043.569734:0:17898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1787368043.570166:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808560512 00000100:00100000:3.0:1787368043.570174:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808560512 00000100:00100000:3.0:1787368043.570213:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368043.570220:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808560512:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787368043.570246:0:17168:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:3.0:1787368043.570274:0:17168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff031962 00000004:00100000:3.0:1787368043.570288:0:17168:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787368043.570293:0:17168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787368043.570679:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787368043.570691:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787368043.570695:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368043.570700:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1787368043.570704:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787368043.570709:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55834d0000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368043.570734:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b6041500 x1874190808560640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:3.0:1787368043.573484:0:17898:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787368043.576526:0:17898:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787368043.580130:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787368043.581138:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787368043.581322:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1787368043.582201:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808560640:0@lo:38:kworker.0 00000100:00100000:1.0:1787368043.582297:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.583200:0:17167:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787368043.583210:0:17167:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:00080000:1.0:1787368043.584053:0:17903:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787368043.584059:0:17903:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1787368043.584125:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808560640 00000100:00100000:2.0:1787368043.584133:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808560640 00000100:00100000:2.0:1787368043.584721:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787368043.584730:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874190808560640:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787368043.584831:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874190808560640:12345-0@lo:38:kworker.0 Request processed in 101us (2532us total) trans 0 rc -11/-11 00000100:00080000:3.0:1787368043.586124:0:17168:0:(import.c:65:import_set_state_nolock()) ffff9c55bd40e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787368043.586200:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874190808560512:12345-0@lo:38:llog_process_th.0 Request processed in 15978us (17130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368043.586211:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787368043.586328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368043.586334:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368043.586337:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368043.586340:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787368043.586471:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787368043.586508:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787368043.586516:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787368043.586520:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787368043.586523:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808560640:0@lo:38:kworker.0 00000100:00100000:2.0:1787368043.586536:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787368043.586541:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787368043.586548:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787368043.586553:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787368043.586555:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c558335d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787368043.586564:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808560512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787368043.586598:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368043.586609:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808560768:0@lo:400:kworker.0 00000100:00100000:2.0:1787368043.586643:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.586681:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808560768 00000100:00100000:2.0:1787368043.586685:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808560768 00000100:00100000:2.0:1787368043.586719:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368043.586726:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808560768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368043.586760:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808560768:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.586766:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787368043.586792:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c55b6042d80 x1874190808560768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368043.586814:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808560768:0@lo:400:kworker.0 00000100:00100000:1.0:1787368043.588630:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787368043.588647:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808560896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368043.588704:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.588948:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808560896 00000100:00100000:2.0:1787368043.588955:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808560896 00000020:00000080:0.0:1787368043.589408:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787368043.589421:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787368043.589484:0:17898:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787368043.589504:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff031969 00000100:00080000:0.0:1787368043.589511:0:17898:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368043.589517:0:17898:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c5585133000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368043.589543:0:17898:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b6042300 x1874190808561024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368043.589567:0:17898:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787368043.589591:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368043.589595:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368043.589598:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368043.589601:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1787368043.589650:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368043.589653:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368043.589655:0:17898:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787368043.589658:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787368043.589660:0:17898:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1787368043.589662:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368043.589663:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368043.589664:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787368043.589666:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368043.589668:0:17898:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787368043.589670:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787368043.589674:0:17898:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787368043.589676:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368043.589677:0:17898:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787368043.589679:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787368043.589682:0:17898:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1787368043.589701:0:17898:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787368043.589703:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368043.589713:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c55b55419b8) 00000020:00000080:0.0:1787368043.589725:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787368043.589729:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787368043.589778:0:17898:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787368043.589785:0:17898:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787368043.589789:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff031977 00010000:00080000:0.0:1787368043.589828:0:17898:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c548277b000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368043.590016:0:17898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787368043.590102:0:17898:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787368043.590117:0:17898:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1787368043.590322:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808561024:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787368043.590379:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808561024 offset 0 length 520: 4 00000100:00100000:2.0:1787368043.590420:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787368043.590430:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1874190808560896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368043.590474:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787368043.590518:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1874190808560896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.590525:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787368043.590559:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808560896:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787368043.607446:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368043.608123:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787368043.608305:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787368043.613912:0:17906:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787368043.613925:0:17906:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787368043.614866:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787368043.614878:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787368043.614917:0:17898:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787368043.614939:0:17898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff03197e 00000100:00080000:3.0:1787368043.614949:0:17898:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787368043.614954:0:17898:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c548277b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368043.614987:0:17898:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c548278c700 x1874190808561152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787368043.615018:0:17898:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787368043.615113:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808561152:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787368043.615314:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808561152 offset 0 length 520: 4 00000020:01000000:3.0:1787368043.615450:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368043.615454:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.615456:0:17898:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787368043.615460:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368043.615463:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.615464:0:17898:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787368043.615467:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787368043.615468:0:17898:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787368043.615470:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368043.615472:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.615473:0:17898:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787368043.615475:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368043.615477:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.615478:0:17898:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787368043.615480:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787368043.615504:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368043.615507:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.615508:0:17898:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787368043.615511:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1787368043.615687:0:17894:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787368043.615718:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787368043.615739:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.615751:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368043.615759:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55a0f12000 from 1 10000000:01000000:2.0:1787368043.615762:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787368043.615908:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.615926:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.615938:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368043.615955:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368043.615994:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.616026:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368043.616077:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808561280 00000100:00100000:3.0:1787368043.616084:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808561280 00000100:00100000:3.0:1787368043.616136:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787368043.616144:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+15:17894:x1874190808561280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368043.616166:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368043.616178:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031985 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.616200:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031985 expref: 16 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.616210:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031985 expref: 16 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.616218:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74e00, rc 0) 00000100:00100000:3.0:1787368043.616257:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+16:17894:x1874190808561280:12345-0@lo:101:mount.lustre.0 Request processed in 114us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368043.616263:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787368043.616306:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368043.616321:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.616329:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368043.618958:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561408:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787368043.619038:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.619082:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55905c7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787368043.619129:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808561408 00000100:00100000:3.0:1787368043.619136:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808561408 00000100:00100000:3.0:1787368043.619383:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787368043.619394:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+16:17894:x1874190808561408:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787368043.619413:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787368043.619432:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787368043.619435:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787368043.619521:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+16:17894:x1874190808561408:12345-0@lo:256:mount.lustre.0 Request processed in 129us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368043.619529:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787368043.619872:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368043.619878:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368043.619881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368043.619884:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787368043.623029:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561408:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787368043.623896:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787368043.623972:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.623983:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368043.623991:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55a0f12000 from 1 10000000:01000000:3.0:1787368043.623993:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787368043.624026:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.624034:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.624044:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368043.624063:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787368043.624144:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.624297:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89840 going to sleep for 11 seconds 00000100:00100000:0.0:1787368043.624581:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808561536 00000100:00100000:0.0:1787368043.624590:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808561536 00000100:00100000:0.0:1787368043.624728:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787368043.624738:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+16:17894:x1874190808561536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368043.624750:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368043.624763:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031993 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.624796:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031993 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.624807:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031993 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.624815:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b800, rc 0) 00000100:00100000:0.0:1787368043.624859:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808561536:12345-0@lo:101:mount.lustre.0 Request processed in 123us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368043.624867:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787368043.624929:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368043.624942:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.624950:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787368043.625072:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787368043.625112:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368043.625139:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.625330:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368043.625437:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808561664 00000100:00100000:2.0:1787368043.625442:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808561664 00000100:00100000:2.0:1787368043.625468:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787368043.625475:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808561664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368043.625556:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808561664:12345-0@lo:501:mount.lustre.0 Request processed in 81us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.625564:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787368043.625650:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368043.625676:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368043.625719:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.625744:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368043.625914:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808561792 00000100:00100000:2.0:1787368043.625920:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808561792 00000100:00100000:2.0:1787368043.625940:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787368043.625946:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808561792:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368043.626032:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808561792:12345-0@lo:503:mount.lustre.0 Request processed in 86us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.626040:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787368043.626115:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561792:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787368043.626477:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787368043.626539:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368043.626572:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.626594:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89840 going to sleep for 11 seconds 00000100:00100000:2.0:1787368043.630535:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808561920 00000100:00100000:2.0:1787368043.630549:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808561920 00000100:00100000:2.0:1787368043.630597:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787368043.630618:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808561920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368043.630929:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808561920:12345-0@lo:502:mount.lustre.0 Request processed in 311us (4355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.630938:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787368043.631035:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808561920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787368043.631261:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787368043.631290:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1787368043.631311:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1787368043.631337:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1787368043.631349:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1787368043.631395:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1787368043.631410:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1787368043.631422:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1787368043.631434:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787368043.631445:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1787368043.631457:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1787368043.631487:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368043.631529:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.631556:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89840 going to sleep for 11 seconds 00000100:00100000:2.0:1787368043.631674:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808562048 00000100:00100000:2.0:1787368043.631679:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808562048 00000100:00100000:2.0:1787368043.631704:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787368043.631712:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808562048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368043.631880:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808562048:12345-0@lo:502:mount.lustre.0 Request processed in 168us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.631888:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787368043.631970:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787368043.632012:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1787368043.632020:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787368043.633761:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368043.633774:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.633787:0:17908:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787368043.633796:0:17908:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55a0f12000 00000020:00000080:3.0:1787368043.633799:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368043.633807:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368043.633810:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.633812:0:17908:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787368043.633814:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368043.633817:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.633818:0:17908:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787368043.633821:0:17908:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55a0f12000 00000020:00000080:3.0:1787368043.633823:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368043.633889:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368043.635447:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.635452:0:17908:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787368043.635461:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368043.635471:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368043.635472:0:17908:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787368043.635478:0:17908:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55a0f12000 00000020:00000080:3.0:1787368043.635479:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368043.635526:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368043.641065:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368043.641073:0:17908:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787368043.641084:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368043.641101:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368043.641103:0:17908:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787368043.641108:0:17908:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55a0f12000 00000020:00000080:2.0:1787368043.641111:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787368043.641273:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368043.641278:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368043.641279:0:17908:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787368043.641284:0:17908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1787368043.653997:0:17894:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787368043.654044:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787368043.654060:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.654108:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368043.654175:0:17894:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787368043.654178:0:17894:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c55a0f12000 10000000:01000000:0.0:1787368043.654181:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c55a0f12000 10000000:01000000:0.0:1787368043.654185:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787368043.654189:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55a0f12000 from 1 10000000:01000000:0.0:1787368043.654192:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787368043.654224:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.654232:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.654242:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368043.654265:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787368043.654332:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368043.654388:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590d69000 going to sleep for 11 seconds 00000100:00100000:2.0:1787368043.654669:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808562176 00000100:00100000:2.0:1787368043.654676:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808562176 00000100:00100000:2.0:1787368043.654728:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787368043.654736:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17894:x1874190808562176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368043.654748:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368043.654760:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241c800/0x66f5679bff0319a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0319a1 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.654787:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241c800/0x66f5679bff0319a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0319a1 expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.654797:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241c800/0x66f5679bff0319a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0319a1 expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368043.654806:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c800, rc 0) 00000100:00100000:2.0:1787368043.654854:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562176:12345-0@lo:101:mount.lustre.0 Request processed in 118us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.654860:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787368043.654922:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368043.655043:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.655054:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368043.662428:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787368043.663686:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787368043.664762:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787368043.664795:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1787368043.664817:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1787368043.664883:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1787368043.664906:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1787368043.664918:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1787368043.664991:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1787368043.665008:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1787368043.665021:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1787368043.665033:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1787368043.665047:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1787368043.665061:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1787368043.665074:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1787368043.665112:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1787368043.665139:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1787368043.665166:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1787368043.665178:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1787368043.665189:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1787368043.665209:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1787368043.665221:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1787368043.665232:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1787368043.665242:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1787368043.665255:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1787368043.665270:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1787368043.665282:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1787368043.666154:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1787368043.666172:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1787368043.666183:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1787368043.666268:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1787368043.666276:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787368043.666469:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368043.666529:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368043.666763:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559378e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368043.667879:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808562304 00000100:00100000:3.0:1787368043.667890:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808562304 00000100:00100000:3.0:1787368043.667940:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787368043.667951:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368043.668111:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562304:12345-0@lo:501:mount.lustre.0 Request processed in 161us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368043.668119:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787368043.668563:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368043.668617:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368043.668670:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368043.668705:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559378e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368043.668725:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808562432 00000100:00100000:0.0:1787368043.668731:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808562432 00000100:00100000:0.0:1787368043.668769:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787368043.668776:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368043.668869:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562432:12345-0@lo:503:mount.lustre.0 Request processed in 93us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368043.668877:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787368043.668913:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787368043.669664:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787368043.669759:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368043.669802:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368043.669821:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559378e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787368043.671702:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808562560 00000100:00100000:1.0:1787368043.671718:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808562560 00000100:00100000:1.0:1787368043.671765:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787368043.671774:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368043.672707:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562560:12345-0@lo:502:mount.lustre.0 Request processed in 932us (2902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368043.672717:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787368043.672780:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368043.673022:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787368043.673050:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1787368043.673064:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1787368043.673077:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1787368043.673104:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1787368043.673121:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1787368043.673148:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1787368043.673165:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1787368043.673182:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1787368043.673208:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1787368043.673229:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1787368043.673244:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1787368043.673257:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1787368043.673297:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1787368043.673318:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1787368043.673334:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1787368043.673352:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1787368043.673394:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1787368043.673409:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1787368043.673502:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1787368043.673521:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1787368043.673538:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1787368043.673555:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1787368043.673585:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1787368043.673601:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1787368043.673617:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1787368043.673633:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1787368043.673647:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1787368043.673663:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1787368043.673692:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1787368043.673713:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1787368043.673726:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1787368043.673739:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1787368043.673753:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1787368043.673767:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1787368043.673780:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1787368043.673794:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1787368043.673810:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1787368043.673826:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1787368043.673841:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1787368043.673855:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1787368043.673869:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1787368043.673887:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1787368043.673905:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1787368043.673924:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1787368043.673955:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1787368043.673972:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1787368043.673987:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1787368043.674032:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368043.674099:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368043.674139:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559378e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787368043.675394:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808562688 00000100:00100000:2.0:1787368043.675406:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808562688 00000100:00100000:2.0:1787368043.675466:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787368043.675475:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368043.675626:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562688:12345-0@lo:502:mount.lustre.0 Request processed in 151us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.675634:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787368043.675659:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368043.676003:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1787368043.676033:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1787368043.676076:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368043.676266:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368043.676385:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808562816 00000100:00100000:1.0:1787368043.676391:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808562816 00000100:00100000:1.0:1787368043.681018:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787368043.681036:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368043.681220:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808562816:12345-0@lo:502:mount.lustre.0 Request processed in 191us (4953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368043.681228:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787368043.681261:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559378e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787368043.681465:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808562816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368043.681537:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1787368043.681550:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787368043.692948:0:17914:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787368043.692967:0:17914:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c5482774d28) 00000020:00000080:2.0:1787368043.693002:0:17914:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787368043.693073:0:17914:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55a0f12000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787368043.693077:0:17914:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55a0f12000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787368043.693080:0:17914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55a0f12000 3 00010000:00080000:2.0:1787368043.693119:0:17914:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c548367b000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1787368043.699118:0:17914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787368043.699542:0:17914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787368043.699585:0:17914:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787368043.699605:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x66f5679bff0319b6 00000100:00080000:2.0:1787368043.699615:0:17914:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787368043.699622:0:17914:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c548367b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368043.700241:0:17914:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5482620700 x1874190808562944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368043.700306:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808562944:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368043.700410:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.700546:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808562944 00000100:00100000:2.0:1787368043.700553:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808562944 00000100:00100000:2.0:1787368043.700585:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787368043.700592:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874190808562944:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787368043.700614:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1787368043.700658:0:17164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x66f5679bff0319bd 00000004:00100000:2.0:1787368043.700672:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787368043.700698:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787368043.711404:0:17914:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787368043.711444:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368043.711449:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368043.711453:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368043.711456:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787368043.712882:0:17914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1787368043.712937:0:17894:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787368043.712970:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787368043.712993:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.713005:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787368043.713057:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787368043.713064:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787368043.713065:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368043.713066:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368043.713068:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368043.713069:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368043.713070:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787368043.713071:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368043.713072:0:17894:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787368043.713075:0:17894:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787368043.713078:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787368043.713079:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787368043.713080:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368043.713081:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368043.713082:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368043.713083:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368043.713083:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787368043.713084:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368043.713085:0:17894:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787368043.713123:0:17894:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787368043.713142:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808563072:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787368043.713219:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.713257:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808563072 00000100:00100000:3.0:1787368043.713264:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808563072 00000100:00100000:3.0:1787368043.713304:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787368043.713313:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808563072:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787368043.713337:0:17157:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787368043.713350:0:17157:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787368043.713619:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867b26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368043.714173:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874190808562944:12345-0@lo:38:llog_process_th.0 Request processed in 13578us (13761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.714183:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000001:00100000:3.0:1787368043.715546:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787368043.717067:0:17157:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787368043.717085:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787368043.717114:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787368043.717119:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787368043.717140:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.717156:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0318c1 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.717173:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031985 expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.717180:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.717228:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff031985 expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.717250:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff031985 expref: 18 pid: 17157 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368043.717264:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808563200:0@lo:104: 00000100:00100000:3.0:1787368043.717324:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787368043.717402:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0318c1 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.717411:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0318c1 expref: 18 pid: 17154 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368043.717420:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808563328:0@lo:104: 00000100:00100000:3.0:1787368043.717442:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368043.717456:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808563200 00000100:00100000:3.0:1787368043.717464:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867b20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368043.717464:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808563200 00000100:00100000:1.0:1787368043.717493:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808563328 00000100:00100000:1.0:1787368043.717496:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808563328 00000100:00100000:1.0:1787368043.717511:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787368043.717519:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+4:17178:x1874190808563200:12345-0@lo:104: 00010000:00010000:1.0:1787368043.717531:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368043.717746:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:17894:x1874190808563072:12345-0@lo:253:mount.lustre.0 Request processed in 4433us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.717756:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787368043.718054:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c5482620700 x1874190808562944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368043.718066:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368043.718076:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787368043.718082:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787368043.718097:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787368043.718101:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548367b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787368043.718108:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808562944:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1787368043.718244:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787368043.718250:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+4:17178:x1874190808563200:12345-0@lo:104: Request processed in 731us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368043.718257:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787368043.718274:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787368043.718282:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808563328:12345-0@lo:104: 00010000:00010000:1.0:1787368043.718301:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718336:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787368043.718341:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808563328:12345-0@lo:104: Request processed in 61us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368043.718346:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787368043.718377:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787368043.718383:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718390:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241de00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368043.718394:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718403:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368043.718410:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368043.718415:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787368043.718440:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718447:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368043.718464:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718471:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03198c expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718487:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368043.718490:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718495:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f200 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368043.718497:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718503:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368043.718510:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368043.718515:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787368043.718526:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718532:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368043.718537:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718543:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f200/0x66f5679bff0318c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0318c8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368043.718554:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368043.718555:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368043.718557:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368043.718574:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808563456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368043.718607:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368043.718626:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787368043.718630:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808563584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368043.718753:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368043.718865:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368043.718975:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808563456 00000100:00100000:0.0:1787368043.718982:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808563456 00010000:00010000:0.0:1787368043.719001:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031985 expref: 18 pid: 17157 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368043.719028:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808563584 00000100:00100000:0.0:1787368043.719032:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808563584 00010000:00010000:0.0:1787368043.719043:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0318c1 expref: 19 pid: 17154 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368043.719055:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787368043.719061:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+19:3653:x1874190808563456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787368043.719069:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368043.719074:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031985 expref: 19 pid: 17157 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719083:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff031985 expref: 19 pid: 17157 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719120:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368043.719161:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+19:3653:x1874190808563456:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368043.719168:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787368043.719183:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368043.719189:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+18:3653:x1874190808563584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787368043.719196:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368043.719200:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0318c1 expref: 18 pid: 17154 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719207:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0318c1 expref: 18 pid: 17154 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719217:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719226:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787368043.719239:0:17148:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002833574s 00010000:00010000:0.0:1787368043.719244:0:17148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719251:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719258:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719275:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719280:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75a00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368043.719285:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719292:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719301:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368043.719310:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368043.719334:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+18:3653:x1874190808563584:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368043.719340:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787368043.719596:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:17894:1874190808563072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787368043.719606:0:17894:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787368043.719609:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787368043.719611:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787368043.719612:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787368043.719614:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787368043.719621:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787368043.719622:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787368043.719624:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787368043.719625:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787368043.719627:0:17894:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787368043.719652:0:17894:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787368043.721081:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e74e00/0x66f5679bff03198c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff031985 expref: 17 pid: 17157 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368043.721142:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808563200:0@lo:104: 00010000:00010000:3.0:1787368043.721158:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241c200/0x66f5679bff0318c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0318c1 expref: 16 pid: 17154 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368043.721178:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808563328:0@lo:104: 00010000:00010000:3.0:1787368043.721201:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.721209:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.721215:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368043.721235:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75a00/0x66f5679bff0319c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368043.721399:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808563584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368043.721410:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808563456:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1787368043.732396:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787368043.732420:0:17920:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787368043.732425:0:17920:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787368043.733510:0:17921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787368043.733956:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1787368043.734495:0:17921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787368043.736571:0:17921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787368043.736650:0:17921:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1787368043.737458:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1874190808563712:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787368043.737545:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368043.737579:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54810eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368043.737584:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808563712 00000100:00100000:1.0:1787368043.737591:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808563712 00000100:00100000:1.0:1787368043.737708:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368043.737720:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17922:x1874190808563712:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787368043.737895:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17922:x1874190808563712:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 177us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368043.737933:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1874190808563712:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787368043.737959:0:17922:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787368043.737996:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1874190808563840:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787368043.738027:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.738049:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368043.738349:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808563840 00000100:00100000:0.0:1787368043.738371:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808563840 00000100:00100000:1.0:1787368043.742596:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:1.0:1787368043.742864:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787368043.742903:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787368043.743517:0:17894:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787368043.743525:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787368043.743562:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787368043.744564:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787368043.744581:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17922:x1874190808563840:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787368043.745163:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787368043.745805:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787368043.745836:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787368043.745934:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787368043.748917:0:17894:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:3.0:1787368043.752330:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17922:x1874190808563840:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 7747us (14293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368043.752343:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00000004:3.0:1787368043.755043:0:17894:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787368043.756710:0:17894:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787368043.756744:0:17894:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffafad00c8f988 00100000:10000000:3.0:1787368043.756761:0:17894:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:2.0:1787368043.757313:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1874190808563840:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787368043.757418:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17922:1874190808563968:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787368043.757473:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.757510:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368043.757626:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808563968 00000100:00100000:1.0:1787368043.757632:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808563968 00000100:00100000:1.0:1787368043.757676:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787368043.757685:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17922:x1874190808563968:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787368043.757731:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17922:x1874190808563968:12345-0@lo:900:lod0001_rec0000.0 Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368043.757744:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787368043.757859:0:17922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c5482622680 x1874190808563968/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787368059 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368043.757870:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17922:1874190808563968:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787368043.757913:0:17922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1874190808564096:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787368043.757941:0:17922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368043.757964:0:17922:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93540 going to sleep for 11 seconds 00000100:00100000:1.0:1787368043.758008:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808564096 00000100:00100000:1.0:1787368043.758012:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808564096 00000100:00100000:1.0:1787368043.758039:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787368043.758045:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17922:x1874190808564096:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787368043.758115:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17922:x1874190808564096:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368043.758122:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787368043.758181:0:17922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1874190808564096:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787368043.758216:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787368043.760661:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787368043.760736:0:17922:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787368043.760740:0:17922:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:1.0:1787368043.761540:0:17894:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787368043.761569:0:17894:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787368043.761589:0:17894:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787368043.761606:0:17894:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787368043.762734:0:17894:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787368043.763055:0:17894:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787368043.867609:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787368044.450308:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787368044.697045:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787368044.888473:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 10000000:01000000:1.0:1787368045.144508:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787368045.144516:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55a0f12000 from 8 10000000:01000000:1.0:1787368045.144520:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787368045.144566:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368045.144577:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368045.144587:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368045.144610:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808564224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787368045.144694:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368045.144889:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808564224 00000100:00100000:0.0:1787368045.144896:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808564224 00000100:00100000:1.0:1787368045.144935:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787368045.152104:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787368045.152123:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+16:17159:x1874190808564224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368045.152152:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368045.152174:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0319cb expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152203:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0319cb expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152213:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0319cb expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152222:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613aa00, rc 0) 00000100:00100000:0.0:1787368045.152310:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808564224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (7614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368045.152318:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787368045.152392:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808564224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368045.152411:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152421:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368045.152482:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808564352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787368045.152519:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368045.152546:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368045.152560:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808564352 00000100:00100000:0.0:1787368045.152567:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808564352 00000100:00100000:0.0:1787368045.152594:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787368045.152600:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808564352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787368045.152618:0:17157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787368045.152633:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787368045.152636:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787368045.152715:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808564352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368045.152723:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787368045.152753:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808564352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787368045.152792:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787368045.152798:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152806:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368045.152815:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787368045.152817:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c5483e3e800 from 8 10000000:01000000:0.0:1787368045.152820:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787368045.152837:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152844:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152852:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368045.152866:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808564480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787368045.152891:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368045.152911:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368045.152922:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808564480 00000100:00100000:0.0:1787368045.152926:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808564480 00000100:00100000:0.0:1787368045.152947:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787368045.152953:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808564480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368045.152960:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368045.152969:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0319d9 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152982:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0319d9 expref: 18 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152991:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0319d9 expref: 18 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.152997:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a600, rc 0) 00000100:00100000:0.0:1787368045.153023:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:17159:x1874190808564480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368045.153029:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787368045.153055:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808564480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368045.153064:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.153071:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368045.153114:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808564608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787368045.153144:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368045.153165:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368045.153176:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808564608 00000100:00100000:0.0:1787368045.153180:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808564608 00000100:00100000:0.0:1787368045.153198:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787368045.153204:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+18:17159:x1874190808564608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787368045.153212:0:17154:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787368045.153223:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787368045.153225:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787368045.153282:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+18:17159:x1874190808564608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 78us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368045.153288:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787368045.153318:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808564608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787368045.153348:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787368045.153374:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368045.153382:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368045.469283:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787368045.726893:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787368045.912428:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787368046.488575:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368046.936435:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787368047.523622:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368047.967335:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00000001:02000400:3.0:1787368048.437015:0:18164:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787368048.536643:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368048.987724:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 0 seconds 00000100:00100000:0.0:1787368049.050922:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787368049.050944:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808564736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787368049.051014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368049.053455:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808564736 00000100:00100000:3.0:1787368049.053467:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808564736 00000100:00100000:3.0:1787368049.053539:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368049.053549:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808564736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787368049.053831:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787368049.053905:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808564736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 357us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368049.053913:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787368049.053989:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787368049.053994:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787368049.053997:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368049.054004:0:15931:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55834d0000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368049.054010:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808564864:0@lo:400:kworker.0 00000100:00100000:0.0:1787368049.054060:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368049.054120:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808564736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368049.054336:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808564864 00000100:00100000:1.0:1787368049.054342:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808564864 00000100:00100000:1.0:1787368049.054397:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787368049.054406:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:3652:x1874190808564864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368049.054445:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:3652:x1874190808564864:12345-0@lo:400:kworker.0 Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368049.054452:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787368049.054556:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c548278e300 x1874190808564992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787368049.054579:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368049.054583:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368049.054586:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368049.054596:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368049.054616:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368049.054618:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368049.054621:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368049.054624:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787368049.055392:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808565120:0@lo:400:kworker.0 00000100:00100000:0.0:1787368049.055438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368049.055468:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787368049.055473:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808565248:0@lo:400:kworker.0 00000100:00100000:0.0:1787368049.055495:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368049.055536:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808565120 00000100:00100000:0.0:1787368049.055542:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808565120 00000100:00100000:0.0:1787368049.055574:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808565248 00000100:00100000:0.0:1787368049.055578:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808565248 00000100:00100000:0.0:1787368049.055593:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368049.055600:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808565120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368049.055639:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808565120:12345-0@lo:400:kworker.0 Request processed in 39us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368049.055647:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368049.055662:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787368049.055668:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808565248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368049.055692:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808565248:12345-0@lo:400:kworker.0 Request processed in 25us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368049.055698:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787368049.055726:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c548278f100 x1874190808565248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368049.055738:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808565248:0@lo:400:kworker.0 00010000:00080000:0.0:1787368049.055748:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c548278c380 x1874190808565120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368049.055755:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808565120:0@lo:400:kworker.0 00000100:00100000:0.0:1787368049.055781:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808564864:0@lo:400:kworker.0 00000100:00100000:1.0:1787368049.056403:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808564992:0@lo:38:kworker.0 00000100:00100000:1.0:1787368049.056442:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368049.057033:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808564992 00000100:00100000:2.0:1787368049.057047:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808564992 00000100:00100000:2.0:1787368049.057087:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787368049.057094:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874190808564992:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787368049.057120:0:17904:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1787368049.057154:0:17904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff0319e7 00000004:00100000:2.0:1787368049.057169:0:17904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787368049.057174:0:17904:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787368049.066379:0:17904:0:(import.c:65:import_set_state_nolock()) ffff9c5483ce0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787368049.066469:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1874190808564992:12345-0@lo:38:kworker.0 Request processed in 9372us (10024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368049.066480:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787368049.066524:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787368049.066535:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787368049.066541:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787368049.066544:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787368049.066565:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000043120426): req@ffff9c548278ea00 x1874190808557952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368049.066587:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808564992:0@lo:38:kworker.0 00000100:00100000:1.0:1787368049.066665:0:17204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368049.066693:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586b563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368049.066711:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808557952 00000100:00100000:1.0:1787368049.066717:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808557952 00000100:00100000:1.0:1787368049.066762:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787368049.066773:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17204:x1874190808557952:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787368049.066857:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17204:x1874190808557952:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368049.066866:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787368049.066894:0:17204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1874190808557952:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787368049.066925:0:17204:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787368049.066966:0:17204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1874190808565376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787368049.066997:0:17204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368049.067019:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55855513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368049.067242:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368049.067252:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808565504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368049.067291:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368049.067324:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808565376 00000100:00100000:2.0:1787368049.067328:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808565376 00000100:00100000:1.0:1787368049.067332:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808565504 00000100:00100000:1.0:1787368049.067338:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808565504 00000100:00100000:2.0:1787368049.067376:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368049.067385:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17204:x1874190808565376:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787368049.067403:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787368049.067413:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808565504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787368049.067436:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787368049.067489:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808565504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368049.067497:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17204:x1874190808565376:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368049.067501:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787368049.067510:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368049.067550:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808565504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368049.067574:0:17204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1874190808565376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787368049.067633:0:17204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1874190808565632:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787368049.067658:0:17204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368049.067690:0:17204:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368049.067729:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808565632 00000100:00100000:1.0:1787368049.067734:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808565632 00000100:00100000:1.0:1787368049.067763:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787368049.067771:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17204:x1874190808565632:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787368049.067819:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17204:x1874190808565632:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368049.067826:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787368049.067858:0:17204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1874190808565632:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787368049.067893:0:17204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787368049.073035:0:17204:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787368049.073124:0:17204:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1787368049.073130:0:17204:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1787368049.310868:0:18217:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787368049.312498:0:18217:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787368049.562976:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787368050.096347:0:18268:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787368050.096770:0:18268:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787368050.584518:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787368050.997981:0:18316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe83b83e80 20000000:00000080:1.0:1787368050.998002:0:18316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c55be122400 uarg=0000000000000000 20000000:01000000:1.0:1787368050.998052:0:18316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787368050.998060:0:18316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787368050.998064:0:18316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787368051.000481:0:18317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787368051.002111:0:18316:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787368051.017934:0:18316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787368051.017965:0:18316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368051.017984:0:18316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031890 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368051.018421:0:18316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031993 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368051.018430:0:18316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368051.018479:0:18316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff031993 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368051.018494:0:18316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff031993 expref: 17 pid: 17154 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368051.018509:0:18316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18316:1874190808565760:0@lo:104: 00000100:00100000:1.0:1787368051.018577:0:18316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787368051.018629:0:18316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff031890 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368051.018638:0:18316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff031890 expref: 17 pid: 17157 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368051.018663:0:18316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18316:1874190808565888:0@lo:104: 00000100:00100000:1.0:1787368051.018689:0:18316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368051.018705:0:18316:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368051.019133:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808565760 00000100:00100000:3.0:1787368051.019142:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808565760 00000100:00100000:3.0:1787368051.019177:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808565888 00000100:00100000:3.0:1787368051.019180:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808565888 00000100:00100000:3.0:1787368051.019193:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368051.019202:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+4:18316:x1874190808565760:12345-0@lo:104: 00010000:00010000:3.0:1787368051.019216:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.019289:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787368051.019295:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+4:18316:x1874190808565760:12345-0@lo:104: Request processed in 94us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368051.019302:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368051.019320:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368051.019326:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+3:18316:x1874190808565888:12345-0@lo:104: 00010000:00010000:3.0:1787368051.019334:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368051.019352:0:18316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18316:1874190808565760:0@lo:104: 00010000:00010000:3.0:1787368051.019397:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787368051.019404:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+3:18316:x1874190808565888:12345-0@lo:104: Request processed in 78us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368051.019420:0:18316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18316:1874190808565888:0@lo:104: 00000100:00100000:3.0:1787368051.019421:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787368051.019450:0:18316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.019451:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787368051.019460:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.019469:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74400 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787368051.019473:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.019482:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787368051.019489:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368051.019495:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787368051.019535:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.019542:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787368051.019577:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.019585:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff031993 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03199a expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368051.019593:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808566016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368051.019597:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368051.019602:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.019620:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787368051.019624:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368051.019629:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787368051.019638:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787368051.019645:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368051.019651:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787368051.019673:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.019680:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787368051.019706:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.019713:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff031890 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031897 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368051.019728:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808566144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368051.019729:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368051.019732:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368051.019735:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368051.019761:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368051.019992:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808566016 00000100:00100000:3.0:1787368051.019998:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808566016 00010000:00010000:3.0:1787368051.020020:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031993 expref: 18 pid: 17154 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368051.020056:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808566144 00000100:00100000:3.0:1787368051.020067:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808566144 00010000:00010000:3.0:1787368051.020083:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031890 expref: 19 pid: 17157 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368051.020106:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787368051.020116:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+19:3652:x1874190808566016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368051.020134:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368051.020141:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031993 expref: 19 pid: 17154 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368051.020154:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff031993 expref: 19 pid: 17154 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368051.020157:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368051.020171:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613b800/0x66f5679bff03199a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff031993 expref: 19 pid: 17154 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368051.020172:0:17149:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787368051.020185:0:17149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787368051.020228:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368051.020238:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3ce871c-8318-4c29-9238-0157d9966155+18:3653:x1874190808566144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368051.020246:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368051.020252:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031890 expref: 18 pid: 17157 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.020262:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff031890 expref: 18 pid: 17157 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.020273:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613b000/0x66f5679bff031897 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff031890 expref: 18 pid: 17157 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.022373:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.022391:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.023418:0:17147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.023431:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.023437:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.023445:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.023461:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fa00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368051.023466:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.023474:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.023494:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.023506:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368051.023592:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3ce871c-8318-4c29-9238-0157d9966155+17:3653:x1874190808566144:12345-0@lo:103:ldlm_bl.0 Request processed in 3342us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368051.023602:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368051.023659:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808566144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368051.024874:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368051.024955:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+16:3652:x1874190808566016:12345-0@lo:103:ldlm_bl.0 Request processed in 4837us (5324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368051.024978:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368051.025094:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808566016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368051.025335:0:18316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368051.025347:0:18316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368051.025369:0:18316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bd67fa00/0x66f5679bff0319ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368051.608552:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787368052.057016:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787368052.633258:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787368052.889494:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787368052.889502:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55a0f12000 from 13 10000000:01000000:3.0:1787368052.889508:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787368052.889554:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368052.889566:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368052.889577:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368052.889617:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787368052.889694:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368052.889742:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a9386840 going to sleep for 11 seconds 00000100:00100000:0.0:1787368052.889799:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808566272 00000100:00100000:0.0:1787368052.889806:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808566272 00000100:00100000:0.0:1787368052.889863:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787368052.889873:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+16:17159:x1874190808566272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368052.889886:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368052.889898:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0319f5 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368052.889919:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0319f5 expref: 17 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368052.889929:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0319f5 expref: 17 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368052.889938:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a000, rc 0) 00000100:00100000:0.0:1787368052.889982:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808566272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368052.889989:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787368052.890046:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368052.890061:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368052.890070:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368052.890129:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368052.890156:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368052.890181:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551540 going to sleep for 11 seconds 00000100:00100000:0.0:1787368052.890194:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808566400 00000100:00100000:0.0:1787368052.890198:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808566400 00000100:00100000:0.0:1787368052.890221:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787368052.890228:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808566400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368052.890330:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808566400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368052.890336:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787368052.890393:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368052.890422:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787368052.890459:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368052.890472:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551540 going to sleep for 11 seconds 00000100:00100000:0.0:1787368052.890482:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808566528 00000100:00100000:0.0:1787368052.890486:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808566528 00000100:00100000:0.0:1787368052.890507:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787368052.890513:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808566528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787368052.890580:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808566528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368052.890587:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787368052.890624:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787368052.894212:0:18402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787368052.894925:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787368052.894949:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787368052.894961:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368052.894971:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368052.894981:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787368052.894983:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5483e3e800 from 13 10000000:01000000:1.0:1787368052.894986:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787368052.895020:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368052.895038:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368052.895048:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368052.895071:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787368052.895144:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368052.895223:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c93a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787368052.899736:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808566656 00000100:00100000:2.0:1787368052.899751:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808566656 00000100:00100000:2.0:1787368052.899850:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787368052.900454:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+17:17159:x1874190808566656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368052.900472:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368052.900491:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031a03 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368052.900517:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031a03 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368052.900527:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a03 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368052.900536:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ce00, rc 0) 00000100:00100000:2.0:1787368052.900620:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+18:17159:x1874190808566656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 761us (5475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368052.900627:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787368052.900725:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368052.900743:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368052.900753:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368052.900825:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368052.902744:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368052.904878:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a9386600 going to sleep for 11 seconds 00000100:00100000:1.0:1787368052.905176:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808566784 00000100:00100000:1.0:1787368052.905185:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808566784 00000100:00100000:1.0:1787368052.905231:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787368052.905240:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:17159:x1874190808566784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787368052.905416:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:17159:x1874190808566784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (4556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368052.905425:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787368052.906525:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368052.906578:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368052.906638:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368052.906744:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a9386600 going to sleep for 11 seconds 00000100:00100000:3.0:1787368052.906764:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808566912 00000100:00100000:3.0:1787368052.906770:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808566912 00000100:00100000:3.0:1787368052.906803:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787368052.906810:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:17159:x1874190808566912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368052.907534:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:17159:x1874190808566912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 721us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368052.907553:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787368052.907610:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808566912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787368052.910021:0:18405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787368052.912216:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787368052.912251:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787368052.912264:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368052.912276:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368053.146255:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368043/real 1787368043] req@ffff9c548278c700 x1874190808561152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368053 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368053.146288:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c548278c700 x1874190808561152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368053 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368053.146299:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368043/real 1787368043] req@ffff9c55b6042300 x1874190808561024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368053 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368053.146311:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55b6042300 x1874190808561024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368053 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787368053.146330:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368053.146346:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787368053.146350:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808561152:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787368053.146370:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5585133000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368053.146376:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787368053.146379:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808561024:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787368053.146449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368053.146460:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368053.146463:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368053.146465:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368053.146493:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368053.146496:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787368053.146499:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c5585133000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368053.146503:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1787368053.146508:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787368053.146515:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c5585133000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368053.146535:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4e300 x1874190808567424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368053.146548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368053.146552:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787368053.146553:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368053.146557:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1787368053.146560:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787368053.146563:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c548277b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368053.146575:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483c4ca80 x1874190808567552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368053.146608:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808567040:0@lo:400:kworker.0 00000100:00100000:1.0:1787368053.146675:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368053.146705:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787368053.146711:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808567680:0@lo:400:kworker.0 00000100:00100000:1.0:1787368053.146741:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368053.146778:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808567040 00000100:00100000:1.0:1787368053.146785:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808567040 00000100:00100000:1.0:1787368053.146827:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787368053.146836:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808567040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368053.146884:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808567040:12345-0@lo:400:kworker.0 Request processed in 49us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368053.146892:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787368053.146913:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808567680 00000100:00100000:1.0:1787368053.146917:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808567680 00000100:00100000:1.0:1787368053.146942:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787368053.146949:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808567680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368053.146977:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808567680:12345-0@lo:400:kworker.0 Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368053.146982:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787368053.147005:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808567424:0@lo:8:kworker.0 00000400:00000100:1.0:1787368053.147043:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808567424 offset 0 length 520: 4 00000100:00100000:1.0:1787368053.147064:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808567552:0@lo:8:kworker.0 00000400:00000100:1.0:1787368053.147177:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808567552 offset 0 length 520: 4 00010000:00080000:1.0:1787368053.147212:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c5582b33100 x1874190808567680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368053.147224:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808567680:0@lo:400:kworker.0 00000100:00100000:1.0:1787368053.147233:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808567040:0@lo:400:kworker.0 00000100:00100000:3.0:1787368053.148669:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808567168:0@lo:400:kworker.0 00000100:00100000:3.0:1787368053.148718:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368053.148754:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787368053.148760:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808567296:0@lo:400:kworker.0 00000100:00100000:3.0:1787368053.148780:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368053.148808:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808567296 00000100:00100000:3.0:1787368053.148814:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808567296 00000100:00100000:3.0:1787368053.148847:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787368053.148854:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808567296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368053.148894:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808567296:12345-0@lo:400:kworker.0 Request processed in 41us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368053.148901:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787368053.148928:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808567296:0@lo:400:kworker.0 00000100:00100000:0.0:1787368053.150201:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808567168 00000100:00100000:0.0:1787368053.150211:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808567168 00000100:00100000:0.0:1787368053.150255:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787368053.150264:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808567168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368053.150331:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808567168:12345-0@lo:400:kworker.0 Request processed in 68us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368053.150344:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787368053.150399:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c5483c4dc00 x1874190808567168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368053.150411:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808567168:0@lo:400:kworker.0 00010000:00010000:3.0:1787368053.658724:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368054.168618:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808567808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368054.168692:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368054.168784:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808567808 00000100:00100000:3.0:1787368054.168792:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808567808 00000100:00100000:3.0:1787368054.168839:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787368054.168849:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808567808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787368054.168882:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787368054.171309:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368054.171325:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808567936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368054.171394:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368054.171436:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808567936 00000100:00100000:2.0:1787368054.171443:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808567936 00000100:00100000:2.0:1787368054.171477:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787368054.171485:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808567936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368054.171515:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787368054.171556:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808567936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368054.171563:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787368054.171615:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808567936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368054.178606:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808567808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9748us (9903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368054.178621:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787368054.179202:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808567808:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787368054.681071:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787368054.684154:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787368055.193491:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368040/real 1787368040] req@ffff9c5482622a00 x1874190808559104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368055 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368055.193522:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c5482622a00 x1874190808559104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368055 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368055.193533:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368040/real 1787368040] req@ffff9c5482620380 x1874190808559232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368055 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368055.193547:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c5482620380 x1874190808559232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368055 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787368055.193568:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55a9345000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368055.193582:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787368055.193586:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808559104:0@lo:8:kworker.0 00000100:00080000:1.0:1787368055.193594:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368055.193600:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787368055.193603:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808559232:0@lo:8:kworker.0 00000100:00100000:0.0:1787368055.193695:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1787368055.193710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1787368055.193714:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808568064:0@lo:400:kworker.0 00000100:00080000:1.0:1787368055.193715:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787368055.193721:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55a9345000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368055.193727:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:1.0:1787368055.193733:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787368055.193739:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c55a9345000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368055.193761:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5582b30380 x1874190808568320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368055.193787:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787368055.193790:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368055.193794:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787368055.193797:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55867d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368055.193810:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:1.0:1787368055.193814:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787368055.193819:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c55867d7000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368055.193829:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808568064 00000100:00100000:1.0:1787368055.193836:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5582b32d80 x1874190808568448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368055.193837:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808568064 00000100:00100000:3.0:1787368055.193887:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787368055.193897:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:3651:x1874190808568064:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787368055.193952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1787368055.193958:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:3651:x1874190808568064:12345-0@lo:400:kworker.0 Request processed in 61us (171us total) trans 0 rc 0/0 00000100:00080000:1.0:1787368055.193959:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368055.193965:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368055.193970:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787368055.193974:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787368055.194004:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808568832:0@lo:400:kworker.0 00000100:00100000:3.0:1787368055.194033:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808568704:0@lo:400:kworker.0 00000100:00100000:1.0:1787368055.194050:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368055.194076:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368055.194094:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808568192:0@lo:400:kworker.0 00000100:00100000:3.0:1787368055.194118:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808568064:0@lo:400:kworker.0 00000100:00100000:1.0:1787368055.194128:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368055.194152:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808568704 00000100:00100000:1.0:1787368055.194157:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787368055.194158:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808568704 00000100:00100000:1.0:1787368055.194167:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808568576:0@lo:400:kworker.0 00000100:00100000:3.0:1787368055.194192:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808568192 00000100:00100000:1.0:1787368055.194197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368055.194198:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808568192 00000100:00100000:3.0:1787368055.194222:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787368055.194229:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808568704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368055.194239:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808568832 00000100:00100000:1.0:1787368055.194244:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808568832 00000100:00100000:3.0:1787368055.194279:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808568704:12345-0@lo:400:kworker.0 Request processed in 49us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368055.194279:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808568576 00000100:00100000:1.0:1787368055.194284:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808568576 00000100:00100000:3.0:1787368055.194290:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787368055.194307:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368055.194325:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808568832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368055.194385:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808568832:12345-0@lo:400:kworker.0 Request processed in 63us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368055.194392:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368055.194405:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368055.194412:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808568576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368055.194446:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808568576:12345-0@lo:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368055.194453:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787368055.195224:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787368055.195240:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808568192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368055.195284:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808568192:12345-0@lo:400:kworker.0 Request processed in 51us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368055.198652:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808568320:0@lo:8:kworker.0 00000400:00000100:0.0:1787368055.198720:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808568320 offset 0 length 520: 4 00000100:00100000:0.0:1787368055.198755:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808568448:0@lo:8:kworker.0 00000400:00000100:0.0:1787368055.198771:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808568448 offset 0 length 520: 4 00010000:00080000:1.0:1787368055.200138:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c5582b31c00 x1874190808568832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368055.200155:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808568832:0@lo:400:kworker.0 00010000:00080000:1.0:1787368055.200199:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c5582b31180 x1874190808568576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368055.200209:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808568576:0@lo:400:kworker.0 00000100:00100000:1.0:1787368055.200220:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808568192:0@lo:400:kworker.0 00000100:00100000:0.0:1787368055.201490:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808568704:0@lo:400:kworker.0 00000100:00100000:3.0:1787368055.206868:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787368055.708430:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787368055.967642:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787368056.730865:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787368057.719461:0:18665:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787368057.719465:0:18665:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787368057.719467:0:18665:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787368057.719569:0:18665:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c55bd40d800 00000020:01000004:2.0:1787368057.719588:0:18665:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787368057.719600:0:18665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787368057.719622:0:18665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c5482773370) 00000020:00000080:2.0:1787368057.719638:0:18665:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1787368057.754687:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787368057.868031:0:18665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787368057.872291:0:18665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787368057.873070:0:18665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787368057.873936:0:18665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787368057.874415:0:18665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787368057.874950:0:18665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787368057.875319:0:18665:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1787368057.877187:0:18665:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787368057.878519:0:18665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787368057.878533:0:18665:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787368057.878546:0:18665:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x66f5679bff031a18 00000020:01000004:2.0:1787368057.878553:0:18665:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787368057.878575:0:18665:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787368057.878579:0:18665:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787368057.878585:0:18665:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787368057.878589:0:18665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787368057.878605:0:18665:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c55b8aab370) 00000020:00000080:2.0:1787368057.878616:0:18665:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787368057.879785:0:18665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787368057.879944:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787368057.879951:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787368057.887699:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787368057.887711:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787368057.888389:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787368057.888404:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787368057.902060:0:18665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787368057.902258:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787368057.902264:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787368057.913918:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787368057.913937:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787368057.945650:0:18665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787368057.945905:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787368057.945912:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787368057.947665:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787368057.947678:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787368057.959739:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787368057.959755:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787368057.976155:0:18665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787368057.976334:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787368057.976341:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787368057.978268:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787368057.978278:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787368058.020834:0:18665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787368058.021034:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787368058.021040:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787368058.022191:0:18665:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787368058.022201:0:18665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787368058.023001:0:18665:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787368058.023028:0:18665:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787368058.023034:0:18665:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787368058.069848:0:18665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787368058.069889:0:18665:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787368058.069894:0:18665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787368058.069895:0:18665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787368058.069896:0:18665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368058.069898:0:18665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368058.069899:0:18665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368058.069900:0:18665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368058.069902:0:18665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787368058.069904:0:18665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368058.069905:0:18665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787368058.069908:0:18665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787368058.069911:0:18665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787368058.069912:0:18665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787368058.069913:0:18665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368058.069915:0:18665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368058.069916:0:18665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368058.069917:0:18665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368058.069918:0:18665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787368058.069919:0:18665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368058.069920:0:18665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787368058.069944:0:18665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787368058.069964:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808568960:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787368058.070049:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368058.070091:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787368058.070161:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808568960 00000100:00100000:0.0:1787368058.070168:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808568960 00000100:00100000:0.0:1787368058.070220:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787368058.070229:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:18665:x1874190808568960:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787368058.070257:0:17157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787368058.070260:0:17157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787368058.070271:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787368058.070593:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+18:18665:x1874190808568960:12345-0@lo:253:mount.lustre.0 Request processed in 364us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.070601:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787368058.070798:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808568960:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787368058.070811:0:18665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787368058.070814:0:18665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787368058.070815:0:18665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787368058.070816:0:18665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368058.070817:0:18665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368058.070819:0:18665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368058.070820:0:18665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368058.070821:0:18665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368058.070823:0:18665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368058.070824:0:18665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787368058.070842:0:18665:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c55bd40d800 from lustre-OST0000 10000000:01000000:1.0:1787368058.070887:0:18665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787368058.070891:0:18665:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787368058.070900:0:18665:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c5591248000 local copy 00010000:00010000:1.0:1787368058.070910:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368058.071001:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368058.071033:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368058.071065:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368058.074324:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808569088 00000100:00100000:3.0:1787368058.074337:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808569088 00000100:00100000:3.0:1787368058.074414:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787368058.074423:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+18:18665:x1874190808569088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368058.074554:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+18:18665:x1874190808569088:12345-0@lo:501:mount.lustre.0 Request processed in 132us (3519us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787368058.074562:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787368058.074612:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569088:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787368058.074636:0:18665:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787368058.074662:0:18665:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787368058.074671:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.074683:0:18665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368058.074720:0:18665:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c55bd40d800 10000000:01000000:1.0:1787368058.074732:0:18665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787368058.074738:0:18665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787368058.074741:0:18665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787368058.074746:0:18665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787368058.074749:0:18665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787368058.074778:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.074786:0:18665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.074794:0:18665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368058.074812:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368058.074847:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368058.074883:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f58780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368058.075115:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808569216 00000100:00100000:3.0:1787368058.075121:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808569216 00000100:00100000:3.0:1787368058.075164:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787368058.075173:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+18:18665:x1874190808569216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368058.075182:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368058.075195:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74400/0x66f5679bff031a2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031a26 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.075215:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74400/0x66f5679bff031a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031a26 expref: 19 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.075225:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74400/0x66f5679bff031a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a26 expref: 19 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.075233:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74400, rc 0) 00000100:00100000:3.0:1787368058.075269:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569216:12345-0@lo:101:mount.lustre.0 Request processed in 97us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368058.075275:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787368058.075398:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368058.075410:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.075418:0:18665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368058.084725:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787368058.085415:0:18665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787368058.094217:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787368058.094277:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787368058.094296:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787368058.094309:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787368058.094335:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787368058.094350:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787368058.094408:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787368058.094416:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787368058.094529:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368058.094598:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368058.094632:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787368058.094928:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808569344 00000100:00100000:0.0:1787368058.094937:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808569344 00000100:00100000:0.0:1787368058.094999:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787368058.095008:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368058.095158:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569344:12345-0@lo:501:mount.lustre.0 Request processed in 150us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.095167:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787368058.095443:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368058.095477:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368058.095517:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368058.095546:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787368058.096528:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808569472 00000100:00100000:2.0:1787368058.096545:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808569472 00000100:00100000:2.0:1787368058.096593:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787368058.096602:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569472:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368058.099799:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569472:12345-0@lo:503:mount.lustre.0 Request processed in 3191us (4274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368058.099814:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787368058.099944:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569472:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787368058.100431:0:18665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787368058.100517:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368058.100564:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368058.100604:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787368058.100723:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808569600 00000100:00100000:3.0:1787368058.100728:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808569600 00000100:00100000:3.0:1787368058.100786:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787368058.100794:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368058.101287:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569600:12345-0@lo:502:mount.lustre.0 Request processed in 492us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368058.101297:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787368058.101406:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368058.101574:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787368058.101602:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787368058.101617:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787368058.101630:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787368058.101643:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787368058.101655:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787368058.101668:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787368058.101682:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787368058.101695:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787368058.101708:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787368058.101731:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787368058.101746:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787368058.101771:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368058.101811:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368058.101844:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787368058.101899:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808569728 00000100:00100000:3.0:1787368058.101905:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808569728 00000100:00100000:3.0:1787368058.101943:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787368058.101951:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368058.102038:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569728:12345-0@lo:502:mount.lustre.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368058.102045:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787368058.102261:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368058.102304:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787368058.102313:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787368058.103719:0:18682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787368058.103729:0:18682:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787368058.103736:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368058.103738:0:18682:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787368058.103744:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787368058.103759:0:18682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c55b8aacd28) 00000020:00000080:2.0:1787368058.103783:0:18682:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787368058.103789:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787368058.103866:0:18682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55bd40d800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787368058.103874:0:18682:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787368058.103880:0:18682:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x66f5679bff031a3b 00010000:00010000:2.0:1787368058.115635:0:18682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787368058.118311:0:18682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1787368058.121458:0:18682:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787368058.125573:0:18682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787368058.125585:0:18682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368058.125592:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368058.125594:0:18682:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787368058.125598:0:18682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787368058.125601:0:18682:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1787368058.125603:0:18682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368058.125604:0:18682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368058.125606:0:18682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787368058.125608:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368058.125610:0:18682:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787368058.125620:0:18682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368058.125623:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368058.125625:0:18682:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787368058.125628:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787368058.125630:0:18682:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787368058.125632:0:18682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368058.125635:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368058.125637:0:18682:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787368058.125639:0:18682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368058.125641:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368058.125643:0:18682:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787368058.125646:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787368058.125678:0:18682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368058.125681:0:18682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368058.125682:0:18682:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787368058.125686:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787368058.127760:0:18665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787368058.127800:0:18665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787368058.127826:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.127838:0:18665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368058.127847:0:18665:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bd40d800 from 1 10000000:01000000:3.0:1787368058.127850:0:18665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787368058.127884:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.127892:0:18665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.127903:0:18665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368058.127933:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787368058.128009:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368058.128051:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808569856 00000100:00100000:3.0:1787368058.128058:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808569856 00000100:00100000:3.0:1787368058.128099:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787368058.128109:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+19:18665:x1874190808569856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368058.128121:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368058.128143:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031a42 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.128167:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031a42 expref: 20 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.128178:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a42 expref: 20 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.128185:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75a00, rc 0) 00000100:00100000:3.0:1787368058.128226:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808569856:12345-0@lo:101:mount.lustre.0 Request processed in 119us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368058.128233:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787368058.128274:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582bdf300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368058.128295:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368058.128308:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.128316:0:18665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787368058.129799:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787368058.130060:0:18665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787368058.131521:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787368058.131564:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787368058.131587:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787368058.131593:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787368058.131710:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368058.136432:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368058.136481:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582bdf480 going to sleep for 11 seconds 00000100:00100000:1.0:1787368058.139901:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808569984 00000100:00100000:1.0:1787368058.139915:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808569984 00000100:00100000:1.0:1787368058.139967:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787368058.139977:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808569984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368058.140227:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808569984:12345-0@lo:501:mount.lustre.0 Request processed in 250us (3801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368058.140234:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787368058.141910:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808569984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368058.141975:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368058.142058:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.142098:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55882c3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368058.142320:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808570112 00000100:00100000:3.0:1787368058.142327:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808570112 00000100:00100000:3.0:1787368058.142395:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787368058.142405:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808570112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368058.142518:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808570112:12345-0@lo:503:mount.lustre.0 Request processed in 113us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368058.142526:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787368058.143346:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570112:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787368058.144577:0:18665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787368058.144687:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368058.146308:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.146552:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55882c3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368058.148553:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808570240 00000100:00100000:3.0:1787368058.148564:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808570240 00000100:00100000:3.0:1787368058.148654:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787368058.148665:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808570240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368058.148931:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808570240:12345-0@lo:502:mount.lustre.0 Request processed in 267us (2626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368058.148939:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787368058.155672:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368058.155949:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787368058.155981:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787368058.156011:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787368058.156027:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787368058.156041:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787368058.156055:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787368058.156069:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787368058.156082:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787368058.156096:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787368058.156110:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787368058.156125:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787368058.156351:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368058.156461:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368058.156507:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482624900 going to sleep for 11 seconds 00000100:00100000:0.0:1787368058.156644:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808570368 00000100:00100000:0.0:1787368058.156652:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808570368 00000100:00100000:0.0:1787368058.156703:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787368058.156713:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808570368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368058.156838:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808570368:12345-0@lo:502:mount.lustre.0 Request processed in 125us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.156855:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787368058.157044:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368058.157100:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787368058.157110:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787368058.165872:0:18686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368058.165885:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368058.165888:0:18686:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787368058.165910:0:18686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55bd40d800 00000020:00000080:3.0:1787368058.165913:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368058.165920:0:18686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368058.165922:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368058.165924:0:18686:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787368058.165926:0:18686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368058.165929:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368058.165930:0:18686:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787368058.165933:0:18686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55bd40d800 00000020:00000080:3.0:1787368058.165935:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368058.166005:0:18686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368058.166009:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368058.166010:0:18686:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787368058.166013:0:18686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368058.166015:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368058.166016:0:18686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787368058.166019:0:18686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55bd40d800 00000020:00000080:3.0:1787368058.166021:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368058.166038:0:18686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368058.166040:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368058.166042:0:18686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787368058.166044:0:18686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368058.166046:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368058.166047:0:18686:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787368058.166050:0:18686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55bd40d800 00000020:00000080:3.0:1787368058.166052:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368058.166072:0:18686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368058.166075:0:18686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368058.166077:0:18686:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787368058.166079:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787368058.167869:0:18665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787368058.167912:0:18665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787368058.167929:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368058.167942:0:18665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368058.168007:0:18665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787368058.168010:0:18665:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c55bd40d800 10000000:01000000:2.0:1787368058.168013:0:18665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c55bd40d800 10000000:01000000:2.0:1787368058.168017:0:18665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787368058.168022:0:18665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55bd40d800 from 1 10000000:01000000:2.0:1787368058.168025:0:18665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787368058.168061:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368058.168081:0:18665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368058.168093:0:18665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368058.168118:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368058.168193:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368058.168227:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368058.169062:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808570496 00000100:00100000:0.0:1787368058.169071:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808570496 00000100:00100000:0.0:1787368058.169119:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787368058.169142:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+20:18665:x1874190808570496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368058.169226:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368058.169243:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613b800/0x66f5679bff031a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031a50 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.169267:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613b800/0x66f5679bff031a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031a50 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.169278:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613b800/0x66f5679bff031a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a50 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.169286:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b800, rc 0) 00000100:00100000:0.0:1787368058.169342:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808570496:12345-0@lo:101:mount.lustre.0 Request processed in 213us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.169348:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787368058.172452:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368058.172484:0:18665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.172509:0:18665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787368058.178849:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787368058.179218:0:18665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368058.179449:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787368058.179473:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787368058.179487:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787368058.179500:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787368058.179528:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787368058.179542:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787368058.179554:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787368058.179566:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787368058.179589:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787368058.179604:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787368058.179618:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787368058.179630:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787368058.179643:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787368058.179655:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787368058.179667:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787368058.179679:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787368058.179690:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787368058.179703:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787368058.179713:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787368058.179724:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787368058.181351:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787368058.181397:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787368058.181411:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787368058.181427:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787368058.181441:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787368058.181455:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787368058.181468:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787368058.181481:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787368058.181495:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787368058.181508:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787368058.181521:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787368058.181533:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787368058.181545:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787368058.181556:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787368058.181568:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787368058.181579:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787368058.181608:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787368058.181637:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787368058.181643:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787368058.187163:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368058.187247:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.187299:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55882c39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368058.190390:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808570624 00000100:00100000:3.0:1787368058.190405:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808570624 00000100:00100000:3.0:1787368058.190461:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787368058.190472:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808570624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368058.190646:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808570624:12345-0@lo:501:mount.lustre.0 Request processed in 175us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368058.190654:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787368058.191897:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368058.191950:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368058.192022:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.192048:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55882c39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368058.192068:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808570752 00000100:00100000:0.0:1787368058.192073:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808570752 00000100:00100000:0.0:1787368058.192111:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787368058.192119:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808570752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368058.192224:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808570752:12345-0@lo:503:mount.lustre.0 Request processed in 106us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.192232:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787368058.192279:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787368058.192681:0:18665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787368058.192762:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368058.192802:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.192821:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55882c39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368058.192837:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808570880 00000100:00100000:0.0:1787368058.192841:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808570880 00000100:00100000:0.0:1787368058.192867:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787368058.192875:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808570880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368058.192950:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808570880:12345-0@lo:502:mount.lustre.0 Request processed in 76us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.192957:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787368058.193018:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808570880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368058.193180:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787368058.193203:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787368058.193217:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787368058.193231:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787368058.193243:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787368058.193256:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787368058.193269:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787368058.193282:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787368058.193295:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787368058.193309:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787368058.193323:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787368058.193337:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787368058.193388:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787368058.193403:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787368058.193416:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787368058.193429:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787368058.193442:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787368058.193455:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787368058.193471:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787368058.193483:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787368058.193496:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787368058.193509:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787368058.193522:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787368058.193536:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787368058.193549:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787368058.193562:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787368058.193575:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787368058.193589:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787368058.193619:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787368058.193635:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787368058.193648:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787368058.193672:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787368058.193686:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787368058.193701:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787368058.193711:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787368058.193722:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787368058.193733:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787368058.193744:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787368058.193755:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787368058.193767:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787368058.193779:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787368058.193791:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787368058.193801:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787368058.193812:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787368058.193836:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787368058.193851:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787368058.193863:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787368058.193877:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787368058.193911:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808571008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368058.193956:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.193977:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55882c39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368058.194012:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808571008 00000100:00100000:0.0:1787368058.194017:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808571008 00000100:00100000:0.0:1787368058.194046:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787368058.194055:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808571008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368058.194133:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808571008:12345-0@lo:502:mount.lustre.0 Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.194141:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787368058.194190:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808571008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368058.194326:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787368058.194352:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787368058.194397:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808571136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368058.194431:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.194446:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55882c39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368058.194459:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808571136 00000100:00100000:0.0:1787368058.194462:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808571136 00000100:00100000:0.0:1787368058.194485:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787368058.194491:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808571136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368058.194553:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808571136:12345-0@lo:502:mount.lustre.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.194560:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787368058.194597:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808571136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368058.194631:0:18665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787368058.194638:0:18665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787368058.207607:0:18689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787368058.207623:0:18689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c55b8aa99b8) 00000020:00000080:2.0:1787368058.207647:0:18689:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787368058.207724:0:18689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55bd40d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787368058.207728:0:18689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bd40d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787368058.207731:0:18689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bd40d800 3 00010000:00080000:2.0:1787368058.207774:0:18689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c54810f8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1787368058.235055:0:18689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787368058.235270:0:18689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787368058.235317:0:18689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787368058.235331:0:18689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x66f5679bff031a65 00000100:00080000:1.0:1787368058.235342:0:18689:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787368058.235348:0:18689:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c54810f8800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368058.235408:0:18689:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5582b31180 x1874190808571264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368058.235438:0:18689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787368058.236890:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808571264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368058.236963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787368058.238937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368058.238943:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368058.238945:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368058.238948:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368058.238968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368058.238971:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368058.238973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368058.238976:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787368058.239028:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808571392:0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368058.239121:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368058.239127:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808571520:0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239152:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368058.239182:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808571776:0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368058.239220:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368058.239224:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808571648:0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239244:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368058.239274:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808571392 00000100:00100000:2.0:1787368058.239280:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808571392 00000100:00100000:2.0:1787368058.239315:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808571648 00000100:00100000:2.0:1787368058.239319:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808571648 00000100:00100000:2.0:1787368058.239334:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787368058.239342:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808571392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239412:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808571392:12345-0@lo:400:kworker.0 Request processed in 70us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368058.239420:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787368058.239435:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787368058.239441:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808571648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239470:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808571648:12345-0@lo:400:kworker.0 Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368058.239476:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787368058.239508:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808571264 00000100:00100000:2.0:1787368058.239512:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808571264 00000100:00100000:2.0:1787368058.239531:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808571520 00000100:00100000:2.0:1787368058.239534:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808571520 00000100:00100000:2.0:1787368058.239548:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808571776 00000100:00100000:2.0:1787368058.239550:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808571776 00000100:00100000:2.0:1787368058.239562:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787368058.239568:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808571520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239599:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808571520:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368058.239605:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787368058.239616:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787368058.239622:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808571776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239648:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808571776:12345-0@lo:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368058.239654:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787368058.239664:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787368058.239668:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808571264:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787368058.239688:0:17162:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:2.0:1787368058.239718:0:17162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x66f5679bff031a6c 00000004:00100000:2.0:1787368058.239733:0:17162:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787368058.239762:0:17162:0:(import.c:65:import_set_state_nolock()) ffff9c54810f9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787368058.239799:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874190808571264:12345-0@lo:38:llog_process_th.0 Request processed in 129us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368058.239806:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787368058.239842:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c5482623100 x1874190808571520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368058.239856:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808571520:0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239874:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808571392:0@lo:400:kworker.0 00000100:00100000:2.0:1787368058.239896:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808571648:0@lo:400:kworker.0 00010000:00080000:2.0:1787368058.239905:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c5482622300 x1874190808571776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368058.239913:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808571776:0@lo:400:kworker.0 00010000:00080000:0.0:1787368058.250017:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c5582b31180 x1874190808571264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368058.250034:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368058.250270:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787368058.250662:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787368058.250669:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787368058.250673:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54810f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787368058.250682:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808571264:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1787368058.256416:0:18689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787368058.256439:0:18689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c55b5540000) 00000020:00000080:0.0:1787368058.256463:0:18689:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787368058.256541:0:18689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55bd40d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787368058.256545:0:18689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bd40d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787368058.256547:0:18689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bd40d800 3 00010000:00080000:0.0:1787368058.256577:0:18689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5482227800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368058.259575:0:18689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787368058.259796:0:18689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787368058.259841:0:18689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787368058.259853:0:18689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x66f5679bff031a7a 00000100:00080000:0.0:1787368058.259863:0:18689:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368058.259869:0:18689:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c5482227800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368058.259900:0:18689:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b6042680 x1874190808571904/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368058.259939:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808571904:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368058.260015:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368058.260862:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808571904 00000100:00100000:1.0:1787368058.260871:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808571904 00000100:00100000:1.0:1787368058.260902:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787368058.260908:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808571904:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787368058.260936:0:17163:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000100:00080000:0.0:1787368058.261172:0:18689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787368058.261739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368058.261744:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368058.261747:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368058.261750:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368058.261753:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368058.261755:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368058.261757:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368058.261760:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1787368058.261875:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x66f5679bff031a81 00000004:00100000:1.0:1787368058.261891:0:17163:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:0.0:1787368058.261918:0:18689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00080000:1.0:1787368058.261924:0:17163:0:(import.c:65:import_set_state_nolock()) ffff9c5483085000 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1787368058.261975:0:18665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:1.0:1787368058.262003:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874190808571904:12345-0@lo:38:llog_process_th.0 Request processed in 1093us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368058.262012:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:0.0:1787368058.262015:0:18665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787368058.262027:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787368058.262070:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55b6042680 x1874190808571904/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368058.262081:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787368058.262089:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787368058.262103:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787368058.262107:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787368058.262110:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5482227800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787368058.262116:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808571904:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1787368058.262858:0:18665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787368058.262911:0:18665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787368058.262913:0:18665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787368058.262915:0:18665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787368058.262920:0:18665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787368058.262921:0:18665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787368058.262922:0:18665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787368058.262923:0:18665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787368058.262925:0:18665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787368058.262926:0:18665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787368058.262929:0:18665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787368058.262931:0:18665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787368058.262932:0:18665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787368058.262933:0:18665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787368058.262934:0:18665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787368058.262935:0:18665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787368058.262936:0:18665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787368058.262937:0:18665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787368058.262938:0:18665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787368058.262939:0:18665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787368058.262959:0:18665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787368058.262975:0:18665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808572032:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787368058.263047:0:18665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.263083:0:18665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a9386840 going to sleep for 11 seconds 00000100:00100000:0.0:1787368058.263110:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808572032 00000100:00100000:0.0:1787368058.263115:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808572032 00000100:00100000:0.0:1787368058.263150:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787368058.263157:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808572032:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787368058.263178:0:17155:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787368058.263190:0:17155:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787368058.271652:0:17155:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787368058.271670:0:17155:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787368058.271894:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787368058.271900:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787368058.271923:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.271941:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0319cb expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.271949:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0319d9 expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.271957:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.272004:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0319d9 expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.272018:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0319d9 expref: 21 pid: 17155 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368058.272051:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808572160:0@lo:104: 00000100:00100000:3.0:1787368058.272114:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.272164:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808572160 00000100:00100000:0.0:1787368058.272188:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808572160 00000100:00100000:0.0:1787368058.272275:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787368058.272387:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808572160:12345-0@lo:104: 00010000:00010000:0.0:1787368058.272402:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.272875:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0319cb expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.272887:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0319cb expref: 21 pid: 17154 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368058.272896:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808572288:0@lo:104: 00010000:00010000:0.0:1787368058.274971:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787368058.274984:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808572160:12345-0@lo:104: Request processed in 2598us (2867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.275006:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787368058.275098:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368058.275105:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.275115:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368058.275119:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.275128:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368058.275135:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368058.275141:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787368058.275184:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.275192:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787368058.281245:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368058.281293:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582bdf900 going to sleep for 11 seconds 00000100:00100000:3.0:1787368058.281317:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808572160:0@lo:104: 00000100:00100000:3.0:1787368058.281372:0:17145:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787368058.281384:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808572288 00000100:00100000:3.0:1787368058.281389:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808572288 00000100:00100000:3.0:1787368058.281430:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787368058.281437:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b62f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808572288:12345-0@lo:104: 00010000:00010000:3.0:1787368058.281453:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368058.281498:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787368058.281503:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b62f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808572288:12345-0@lo:104: Request processed in 66us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368058.281509:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787368058.281546:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787368058.281572:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808572288:0@lo:104: 00010000:00010000:3.0:1787368058.281592:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.282489:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.282502:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55b613a800/0x66f5679bff0319d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0319e0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368058.282547:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808572416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368058.282590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.286503:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:18665:x1874190808572032:12345-0@lo:253:mount.lustre.0 Request processed in 23336us (23456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.286517:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787368058.286588:0:18665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:18665:1874190808572032:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787368058.286604:0:18665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787368058.286607:0:18665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787368058.287287:0:18665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787368058.287289:0:18665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787368058.287291:0:18665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787368058.287292:0:18665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787368058.287293:0:18665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787368058.287295:0:18665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787368058.287297:0:18665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787368058.287298:0:18665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787368058.287314:0:18665:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787368058.287629:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808572416 00000100:00100000:1.0:1787368058.287636:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808572416 00010000:00010000:1.0:1787368058.287668:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0319d9 expref: 21 pid: 17155 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368058.287710:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787368058.287718:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+21:3653:x1874190808572416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787368058.287783:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368058.287786:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368058.287788:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368058.288338:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368058.288348:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0319d9 expref: 21 pid: 17155 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.288386:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0319d9 expref: 21 pid: 17155 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.288406:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613a600/0x66f5679bff0319e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0319d9 expref: 21 pid: 17155 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.288420:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368058.288491:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+20:3653:x1874190808572416:12345-0@lo:103:ldlm_bl.0 Request processed in 773us (5899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368058.288500:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787368058.289586:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808572416:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1787368058.293417:0:18665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1787368058.295876:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368058.295883:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368058.295885:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368058.296878:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.296893:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ee00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368058.296909:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.296919:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368058.296928:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368058.296934:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787368058.297001:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.297009:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368058.297049:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.297057:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff0319cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0319d2 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368058.297077:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368058.297079:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368058.297081:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368058.297098:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368058.297121:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808572544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368058.297191:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368058.297293:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808572544 00000100:00100000:0.0:1787368058.297301:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808572544 00010000:00010000:0.0:1787368058.297328:0:18318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0319cb expref: 20 pid: 17154 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368058.297378:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787368058.297387:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c558a1ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3ce871c-8318-4c29-9238-0157d9966155+20:3653:x1874190808572544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787368058.297406:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368058.297412:0:18318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0319cb expref: 20 pid: 17154 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297423:0:18318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0319cb expref: 20 pid: 17154 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297438:0:18318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613aa00/0x66f5679bff0319d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0319cb expref: 20 pid: 17154 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297451:0:18318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297460:0:18318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787368058.297474:0:18318:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.025575183s 00010000:00010000:0.0:1787368058.297478:0:18318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297485:0:18318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297492:0:18318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297499:0:18318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297504:0:18318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368058.297508:0:18318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297520:0:18318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297538:0:18318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368058.297547:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368058.297582:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c558a1ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3ce871c-8318-4c29-9238-0157d9966155+19:3653:x1874190808572544:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368058.297590:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787368058.297650:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808572544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368058.297712:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368058.297720:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368058.297732:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75400/0x66f5679bff031a88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787368058.302514:0:18665:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787368058.302524:0:18665:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787368058.302560:0:18665:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787368058.302601:0:18665:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787368058.302622:0:18665:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787368058.302650:0:18665:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787368058.303600:0:18665:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787368058.303830:0:18665:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787368058.779347:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368059.291834:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808572800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368059.292029:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368059.292069:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368059.292074:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808572672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368059.292097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368059.292125:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808572800 00000100:00100000:2.0:1787368059.292133:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808572800 00000100:00100000:2.0:1787368059.292179:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808572672 00000100:00100000:2.0:1787368059.292182:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808572672 00000100:00100000:2.0:1787368059.292199:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787368059.292206:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808572800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368059.292239:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787368059.292288:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808572800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368059.292296:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787368059.292313:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787368059.292319:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808572672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787368059.292334:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787368059.292386:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808572672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368059.292393:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787368059.292437:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808572672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368059.292465:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808572800:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1787368059.385293:0:18746:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787368059.386038:0:18746:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787368059.800455:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787368059.800464:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55a0f12000 from 9 10000000:01000000:2.0:1787368059.800469:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787368059.800516:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368059.800529:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368059.800545:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368059.800575:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808572928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787368059.800651:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368059.800692:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67240 going to sleep for 11 seconds 00000100:00100000:0.0:1787368059.800940:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808572928 00000100:00100000:0.0:1787368059.800947:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808572928 00000100:00100000:0.0:1787368059.801006:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787368059.801015:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+19:17159:x1874190808572928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368059.801029:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368059.801050:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031a8f expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368059.801072:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031a8f expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368059.801083:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a8f expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368059.801092:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613ac00, rc 0) 00000100:00100000:0.0:1787368059.801150:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+20:17159:x1874190808572928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368059.801170:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787368059.801337:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808572928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368059.801375:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368059.801385:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368059.801671:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808573056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787368059.801706:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368059.801946:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787368059.802233:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808573056 00000100:00100000:0.0:1787368059.802238:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808573056 00000100:00100000:0.0:1787368059.802278:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787368059.802286:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+20:17159:x1874190808573056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787368059.802303:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787368059.802322:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787368059.802325:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787368059.802690:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+20:17159:x1874190808573056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 403us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368059.802698:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787368059.802855:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808573056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787368059.802917:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787368059.802938:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368059.802948:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368059.802959:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787368059.802961:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c5483e3e800 from 9 10000000:01000000:2.0:1787368059.802964:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787368059.802997:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368059.803011:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368059.803020:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368059.803035:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808573184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787368059.803077:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368059.803107:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787368059.803154:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808573184 00000100:00100000:0.0:1787368059.803159:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808573184 00000100:00100000:0.0:1787368059.803189:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787368059.803196:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+20:17159:x1874190808573184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368059.803206:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368059.803216:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031a9d expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368059.803235:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031a9d expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368059.803244:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a9d expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368059.803252:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a400, rc 0) 00000100:00100000:0.0:1787368059.803281:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:17159:x1874190808573184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368059.803295:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1787368059.803301:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368059.803323:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808573184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368059.803335:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368059.803375:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368059.803417:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808573312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787368059.804163:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368059.804193:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1787368059.804194:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808573312 00000100:00100000:2.0:1787368059.804199:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808573312 00000100:00100000:2.0:1787368059.804255:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787368059.804261:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:17159:x1874190808573312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787368059.804274:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787368059.804287:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787368059.804289:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787368059.804388:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:17159:x1874190808573312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368059.804395:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787368059.804562:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808573312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787368059.804613:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787368059.804620:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368059.804629:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368060.825230:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368061.848474:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787368062.303115:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787368062.875555:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787368063.385229:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368063.385237:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368063.385241:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368063.385244:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787368063.385263:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808573440:0@lo:400:kworker.0 00000100:00080000:2.0:1787368063.385276:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368063.385280:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368063.385296:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368063.385301:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787368063.385345:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368063.385350:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808573568:0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.385414:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808573952:0@lo:400:kworker.0 00000100:00100000:2.0:1787368063.385420:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368063.385450:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808574080:0@lo:400:kworker.0 00000100:00100000:2.0:1787368063.385486:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808573696:0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.385514:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368063.385517:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808573824:0@lo:400:kworker.0 00000100:00100000:2.0:1787368063.394045:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368063.394097:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808573568 00000100:00100000:2.0:1787368063.394104:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808573568 00000100:00100000:2.0:1787368063.394140:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808573824 00000100:00100000:2.0:1787368063.394143:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808573824 00000100:00100000:2.0:1787368063.394159:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787368063.394168:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808573568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.394193:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808573440 00000100:00100000:1.0:1787368063.394200:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808573440 00000100:00100000:2.0:1787368063.394223:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808573568:12345-0@lo:400:kworker.0 Request processed in 56us (8806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368063.394231:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787368063.394238:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787368063.395189:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808573952 00000100:00100000:0.0:1787368063.395198:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808573952 00000100:00100000:1.0:1787368063.399122:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+21:3653:x1874190808573440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.399239:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+21:3653:x1874190808573440:12345-0@lo:400:kworker.0 Request processed in 4991us (13897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368063.399251:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787368063.399308:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368063.399396:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808573568:0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.399429:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808574080 00000100:00100000:1.0:1787368063.399437:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808574080 00000100:00100000:0.0:1787368063.399520:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787368063.399546:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787368063.399844:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368063.399866:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808574208:0@lo:400:kworker.0 00000100:00100000:0.0:1787368063.399911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368063.399934:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808573952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368063.400021:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808573952:12345-0@lo:400:kworker.0 Request processed in 491us (14508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368063.402469:0:17163:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787368063.402487:0:17163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787368063.402768:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787368063.402790:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808573824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368063.402875:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808573824:12345-0@lo:400:kworker.0 Request processed in 94us (8844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368063.402883:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787368063.402941:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808573824:0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.403145:0:17164:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787368063.403154:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808573696 00000100:00100000:1.0:1787368063.403159:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808573696 00000100:00100000:1.0:1787368063.403181:0:17164:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787368063.403187:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808574208 00000100:00100000:1.0:1787368063.403189:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808574208 00000100:00100000:1.0:1787368063.403281:0:17164:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787368063.403289:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787368063.403296:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808574080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.404210:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808574080:12345-0@lo:400:kworker.0 Request processed in 910us (4897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368063.404219:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787368063.404238:0:17164:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787368063.404247:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787368063.404253:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808573696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.404301:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808573696:12345-0@lo:400:kworker.0 Request processed in 48us (4457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368063.404307:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787368063.404398:0:17164:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787368063.404407:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787368063.404414:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808574208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.404444:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808574208:12345-0@lo:400:kworker.0 Request processed in 30us (4531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368063.404450:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787368063.404491:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55be7f0e00 x1874190808574080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368063.404504:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808574080:0@lo:400:kworker.0 00010000:00080000:1.0:1787368063.404537:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55be7f3b80 x1874190808573952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368063.404546:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808573952:0@lo:400:kworker.0 00000100:00100000:1.0:1787368063.404557:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808573440:0@lo:400:kworker.0 00000100:00100000:0.0:1787368063.409085:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787368063.409166:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482622300 x1874190808573696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368063.409182:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808573696:0@lo:400:kworker.0 00010000:00080000:0.0:1787368063.409196:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55be7f2300 x1874190808574208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368063.409205:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808574208:0@lo:400:kworker.0 00000100:00080000:3.0:1787368063.415188:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787368063.899676:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368064.414093:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808574336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368064.414173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368064.414229:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808574336 00000100:00100000:2.0:1787368064.414237:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808574336 00000100:00100000:2.0:1787368064.414278:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787368064.414287:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808574336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787368064.414320:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787368064.414385:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808574336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368064.414392:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787368064.414447:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808574336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368064.416678:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787368064.416705:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808574464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787368064.416770:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368064.433088:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808574464 00000100:00100000:2.0:1787368064.433102:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808574464 00000100:00100000:2.0:1787368064.433204:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787368064.433214:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808574464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368064.433249:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787368064.434854:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808574464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1635us (18077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368064.434867:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787368064.436044:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808574464:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787368064.926216:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787368065.015620:0:19037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1787368065.180269:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1787368065.835926:0:19089:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787368065.836230:0:19089:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787368065.947006:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787368066.554799:0:19139:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787368066.555070:0:19139:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787368066.969342:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368067.996340:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368068.504471:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368053/real 1787368053] req@ffff9c5483c4e300 x1874190808567424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368068 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368068.504499:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c5483c4e300 x1874190808567424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368068 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368068.504510:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368053/real 1787368053] req@ffff9c5483c4ca80 x1874190808567552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368068 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368068.504539:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c5483c4ca80 x1874190808567552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368068 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787368068.504560:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5585133000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787368068.504568:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787368068.504572:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808567424:0@lo:8:kworker.0 00000100:00080000:2.0:1787368068.504577:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787368068.504581:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787368068.504584:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808567552:0@lo:8:kworker.0 00000100:00080000:3.0:1787368068.504703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368068.504718:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368068.504722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368068.504725:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368068.504744:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368068.504747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787368068.504749:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c5585133000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368068.504754:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:3.0:1787368068.504759:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787368068.504765:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c5585133000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368068.504787:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c548278ce00 x1874190808575104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787368068.504810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368068.504814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787368068.504816:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368068.504820:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:3.0:1787368068.504824:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787368068.504827:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c548277b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368068.504842:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c548278e300 x1874190808575232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368068.504889:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808574976:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.504981:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.505028:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787368068.505035:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808574592:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505074:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.505094:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808575360:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505120:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.505144:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808574720:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505166:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.505185:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808575488:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505206:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.505224:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787368068.505229:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808574848:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505248:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.505260:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808575616:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505310:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.505339:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808574976 00000100:00100000:3.0:1787368068.505345:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808574976 00000100:00100000:3.0:1787368068.505405:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808574720 00000100:00100000:3.0:1787368068.505408:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808574720 00000100:00100000:3.0:1787368068.505423:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787368068.505431:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808574976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505480:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808574976:12345-0@lo:400:kworker.0 Request processed in 49us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368068.505487:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787368068.505503:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787368068.505509:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808574720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505539:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808574720:12345-0@lo:400:kworker.0 Request processed in 31us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368068.505545:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787368068.505561:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808575360 00000100:00100000:3.0:1787368068.505564:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808575360 00000100:00100000:3.0:1787368068.505580:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808575488 00000100:00100000:3.0:1787368068.505582:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808575488 00000100:00100000:3.0:1787368068.505601:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808574848 00000100:00100000:3.0:1787368068.505605:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808574848 00000100:00100000:3.0:1787368068.505614:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808575616 00000100:00100000:3.0:1787368068.505616:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808575616 00000100:00100000:3.0:1787368068.505630:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368068.505635:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808575360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505664:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808575360:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368068.505670:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368068.505691:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787368068.505697:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808575488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505727:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808575488:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368068.505732:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787368068.505744:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787368068.505750:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808574848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505774:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808574848:12345-0@lo:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368068.505779:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787368068.505789:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787368068.505794:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808575616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.505813:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808575616:12345-0@lo:400:kworker.0 Request processed in 20us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368068.505818:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787368068.505835:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787368068.505838:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787368068.505849:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808575104:0@lo:8:kworker.0 00000100:00100000:3.0:1787368068.505874:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.505893:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808575232:0@lo:8:kworker.0 00000100:00100000:3.0:1787368068.505917:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787368068.505968:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c548278f800 x1874190808574848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368068.505980:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808574848:0@lo:400:kworker.0 00010000:00080000:3.0:1787368068.505991:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c548278f100 x1874190808575616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368068.506007:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808575616:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.506019:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808574720:0@lo:400:kworker.0 00010000:00080000:3.0:1787368068.506027:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c548278c380 x1874190808575488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368068.506035:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808575488:0@lo:400:kworker.0 00010000:00080000:3.0:1787368068.506064:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c548278dc00 x1874190808575360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368068.506072:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808575360:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.506081:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808574976:0@lo:400:kworker.0 00000100:00100000:3.0:1787368068.506119:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808575104 00000100:00100000:3.0:1787368068.506123:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808575104 00000100:00100000:3.0:1787368068.506136:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808575232 00000100:00100000:3.0:1787368068.506138:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808575232 00000100:00100000:3.0:1787368068.506147:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787368068.506152:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808575104:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787368068.506175:0:18670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:3.0:1787368068.506199:0:18670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff031aab 00002000:00100000:3.0:1787368068.506211:0:18670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c5483629000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787368068.506215:0:18670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787368068.506218:0:18670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787368068.506422:0:18670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787368068.506451:0:18670:0:(import.c:65:import_set_state_nolock()) ffff9c548362d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787368068.506495:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874190808575104:12345-0@lo:8:kworker.0 Request processed in 341us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368068.506511:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787368068.506526:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787368068.506530:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808575232:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787368068.506542:0:18670:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787368068.508246:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808574592 00000100:00100000:2.0:1787368068.508259:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808574592 00000100:00100000:2.0:1787368068.508323:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787368068.508333:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:3653:x1874190808574592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368068.508433:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:3653:x1874190808574592:12345-0@lo:400:kworker.0 Request processed in 103us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368068.508440:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787368068.508504:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808574592:0@lo:400:kworker.0 00010000:00080000:3.0:1787368068.547682:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c548278ce00 x1874190808575104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787368088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368068.547698:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787368068.547708:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787368068.547717:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787368068.547722:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787368068.547726:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5585133000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787368068.547750:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787368068.547756:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808575104:0@lo:8:kworker.0 00000004:00080000:1.0:1787368068.547765:0:17903:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787368068.547819:0:17905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000004:00080000:1.0:1787368068.547855:0:17903:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 525835498448ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787368068.547856:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1874190808575872:0@lo:7:osp-pre-0-1.0 00080000:00080000:1.0:1787368068.547864:0:17903:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787368068.547933:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.547961:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368068.547975:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808575744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787368068.548001:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.548038:0:18671:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787368068.548045:0:18671:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787368068.548069:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808575744 00000100:00100000:3.0:1787368068.548074:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808575744 00000100:00080000:2.0:1787368068.548100:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787368068.548139:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787368068.548148:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808575744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787368068.548183:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787368068.549056:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874190808575744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 905us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368068.549067:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787368068.549180:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836b9180 x1874190808575744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368068.549201:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808575744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787368068.549342:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808575232:12345-0@lo:8:kworker.0 Request processed in 42808us (43421us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787368068.549350:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787368068.549397:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368068.549402:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787368068.549406:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808575232:0@lo:8:kworker.0 00000100:00100000:3.0:1787368068.549501:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808575872 00000100:00100000:3.0:1787368068.549506:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808575872 00000100:00100000:3.0:1787368068.549548:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787368068.549557:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17905:x1874190808575872:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787368068.556721:0:17895:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1787368068.562765:0:18670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787368068.562777:0:18670:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787368068.563169:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17905:x1874190808575872:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13609us (15246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368068.563185:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787368068.566708:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836b8a80 x1874190808575872/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787368084 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368068.566728:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1874190808575872:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787368068.566744:0:17905:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787368068.566790:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1874190808576000:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787368068.566858:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368068.566937:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787368068.572154:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808576000 00000100:00100000:1.0:1787368068.572170:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808576000 00000100:00100000:1.0:1787368068.572484:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787368068.572496:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17905:x1874190808576000:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787368068.572528:0:18672:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1787368068.572626:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17905:x1874190808576000:12345-0@lo:5:osp-pre-0-1.0 Request processed in 122us (5756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368068.572636:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787368068.573490:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836b8a80 x1874190808576000/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787368084 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368068.573507:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1874190808576000:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787368068.573523:0:17905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787368068.573570:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1874190808576128:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787368068.573620:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368068.573654:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd71ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787368068.574083:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808576128 00000100:00100000:2.0:1787368068.574090:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808576128 00000100:00100000:2.0:1787368068.574137:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787368068.574146:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17905:x1874190808576128:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787368068.574178:0:19223:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1787368068.610563:0:18666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787368068.610583:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787368068.610851:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17905:x1874190808576128:12345-0@lo:5:osp-pre-0-1.0 Request processed in 36701us (37226us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787368068.610869:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787368068.611022:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b6043b80 x1874190808576128/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787368084 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368068.611045:0:17905:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787368068.611052:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1874190808576128:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787368068.611078:0:17905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1787368068.611130:0:17905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17905:1874190808576256:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787368068.611165:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368068.611188:0:17905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368068.611240:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808576256 00000100:00100000:2.0:1787368068.611246:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808576256 00000100:00100000:2.0:1787368068.611285:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368068.611294:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1874190808576256:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787368068.611338:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1874190808576256:12345-0@lo:900:osp-pre-0-1.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368068.611345:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787368068.611394:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55be7f0380 x1874190808576256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787368084 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368068.611404:0:17905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17905:1874190808576256:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1787368069.016660:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368069.529421:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808576512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368069.529488:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368069.529548:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808576512 00000100:00100000:2.0:1787368069.529555:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808576512 00000100:00100000:2.0:1787368069.529608:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787368069.529616:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808576512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368069.529654:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787368069.529699:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808576512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368069.529706:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787368069.529750:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808576512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368069.531201:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368069.531224:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808576384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368069.531289:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368069.531337:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808576384 00000100:00100000:2.0:1787368069.531344:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808576384 00000100:00100000:2.0:1787368069.531399:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787368069.531408:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808576384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787368069.531436:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787368069.531476:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808576384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368069.531483:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787368069.531521:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808576384:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787368070.042167:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368071.066937:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368072.089308:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787368072.537288:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787368073.116844:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787368073.555580:0:19485:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787368073.555585:0:19485:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787368073.555586:0:19485:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787368073.555699:0:19485:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c5483083000 00000020:01000004:1.0:1787368073.555714:0:19485:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787368073.555727:0:19485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787368073.555914:0:19485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c55912499b8) 00000020:00000080:1.0:1787368073.555932:0:19485:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787368073.598083:0:19485:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787368073.600387:0:19485:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787368073.600722:0:19485:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787368073.601118:0:19485:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787368073.601305:0:19485:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787368073.601649:0:19485:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787368073.602063:0:19485:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1787368073.604665:0:19485:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787368073.604899:0:19485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787368073.604912:0:19485:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787368073.604924:0:19485:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x66f5679bff031ab9 00000020:01000004:0.0:1787368073.604931:0:19485:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787368073.604961:0:19485:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787368073.604965:0:19485:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787368073.604972:0:19485:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787368073.604999:0:19485:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787368073.605004:0:19485:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787368073.614347:0:19485:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787368073.614450:0:19485:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787368073.614459:0:19485:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787368073.614461:0:19485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787368073.614462:0:19485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368073.614463:0:19485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368073.614464:0:19485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368073.614465:0:19485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368073.614466:0:19485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368073.614468:0:19485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368073.614469:0:19485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787368073.614472:0:19485:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787368073.614474:0:19485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787368073.614475:0:19485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787368073.614476:0:19485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368073.614477:0:19485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368073.614478:0:19485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368073.614479:0:19485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368073.614480:0:19485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368073.614481:0:19485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368073.614481:0:19485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787368073.614506:0:19485:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787368073.614525:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808576640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787368073.614608:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.614669:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787368073.614738:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808576640 00000100:00100000:2.0:1787368073.614812:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808576640 00000100:00100000:2.0:1787368073.614902:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787368073.614912:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+21:19485:x1874190808576640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787368073.614940:0:17157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787368073.614944:0:17157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787368073.614957:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787368073.615318:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+21:19485:x1874190808576640:12345-0@lo:253:mount.lustre.0 Request processed in 407us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.615336:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787368073.615445:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808576640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787368073.615456:0:19485:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787368073.615458:0:19485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787368073.615459:0:19485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787368073.615460:0:19485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368073.615461:0:19485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368073.615462:0:19485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368073.615463:0:19485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368073.615464:0:19485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368073.615466:0:19485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368073.615467:0:19485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787368073.615485:0:19485:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c5483083000 from lustre-OST0001 10000000:01000000:1.0:1787368073.615512:0:19485:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787368073.615515:0:19485:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787368073.615528:0:19485:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c5591248000 local copy 00010000:00010000:1.0:1787368073.615538:0:19485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368073.615614:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808576768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368073.615643:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.615970:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368073.616094:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808576768 00000100:00100000:0.0:1787368073.616099:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808576768 00000100:00100000:0.0:1787368073.616129:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787368073.616136:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:19485:x1874190808576768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368073.616214:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:19485:x1874190808576768:12345-0@lo:501:mount.lustre.0 Request processed in 78us (570us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787368073.616222:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787368073.616286:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808576768:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787368073.616301:0:19485:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787368073.616316:0:19485:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787368073.616322:0:19485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.616332:0:19485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368073.616383:0:19485:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c5483083000 10000000:01000000:1.0:1787368073.616387:0:19485:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787368073.616392:0:19485:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787368073.616395:0:19485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787368073.616398:0:19485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787368073.616401:0:19485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787368073.616420:0:19485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.616427:0:19485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.616435:0:19485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368073.616454:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808576896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368073.616476:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.616490:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368073.616597:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808576896 00000100:00100000:0.0:1787368073.616601:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808576896 00000100:00100000:0.0:1787368073.616619:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787368073.616623:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:19485:x1874190808576896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368073.616631:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368073.616642:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613ba00/0x66f5679bff031ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031ac0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368073.616662:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613ba00/0x66f5679bff031ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031ac0 expref: 22 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368073.616671:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613ba00/0x66f5679bff031ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031ac0 expref: 22 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368073.616679:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613ba00, rc 0) 00000100:00100000:0.0:1787368073.616719:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808576896:12345-0@lo:101:mount.lustre.0 Request processed in 94us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.616725:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787368073.616846:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808576896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368073.616859:0:19485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.616868:0:19485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368073.618569:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787368073.620670:0:19485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787368073.622970:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787368073.623024:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787368073.623114:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787368073.623131:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787368073.623145:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787368073.623158:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787368073.623182:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787368073.623188:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787368073.623295:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808577024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368073.623468:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.623562:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368073.623608:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808577024 00000100:00100000:0.0:1787368073.623616:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808577024 00000100:00100000:0.0:1787368073.623718:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787368073.623729:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808577024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368073.623895:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808577024:12345-0@lo:501:mount.lustre.0 Request processed in 158us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.623915:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787368073.623986:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808577024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368073.624018:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808577152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368073.624067:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.624313:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368073.624610:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808577152 00000100:00100000:3.0:1787368073.624616:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808577152 00000100:00100000:3.0:1787368073.624646:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787368073.624653:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808577152:12345-0@lo:503:mount.lustre.0 00000100:00080000:3.0:1787368073.624831:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368073.624836:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368073.624838:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368073.624840:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368073.624894:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368073.624898:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787368073.624901:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368073.624906:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1787368073.624911:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787368073.624916:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c548277b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368073.624935:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c54836bad80 x1874190808577792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368073.624977:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808577536:0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.625013:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.625039:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808578176:0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.625063:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.625081:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787368073.625087:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808577408:0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.625119:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.625136:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808578048:0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.625154:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.625178:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808578176 00000100:00100000:3.0:1787368073.625183:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808578176 00000100:00100000:3.0:1787368073.625216:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808577408 00000100:00100000:3.0:1787368073.625219:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808577408 00000100:00100000:3.0:1787368073.625232:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808578048 00000100:00100000:3.0:1787368073.625234:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808578048 00000100:00100000:3.0:1787368073.625247:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787368073.625254:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808578176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.625290:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808578176:12345-0@lo:400:kworker.0 Request processed in 37us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368073.625297:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787368073.625313:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787368073.625319:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808577408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.625345:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808577408:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368073.625351:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787368073.625389:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787368073.625395:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808578048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.625423:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808578048:12345-0@lo:400:kworker.0 Request processed in 28us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368073.625428:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787368073.625456:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836b9c00 x1874190808577408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368073.625480:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808577408:0@lo:400:kworker.0 00010000:00080000:3.0:1787368073.625492:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836b8700 x1874190808578048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368073.625500:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808578048:0@lo:400:kworker.0 00010000:00080000:3.0:1787368073.625509:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836b9500 x1874190808578176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368073.625517:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808578176:0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.625539:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808577792:0@lo:8:kworker.0 00000100:00100000:3.0:1787368073.625567:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.625594:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808577792 00000100:00100000:3.0:1787368073.625597:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808577792 00000100:00100000:3.0:1787368073.625622:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787368073.625628:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874190808577792:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787368073.625645:0:18671:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787368073.631591:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808577280:0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.631670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368073.632447:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808577920:0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.632481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368073.632549:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787368073.632557:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808577664:0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.632582:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368073.632603:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808578304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368073.632624:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.632682:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808577920 00000100:00100000:1.0:1787368073.632689:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808577920 00000100:00100000:1.0:1787368073.632732:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787368073.632751:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808577920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368073.632804:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808577920:12345-0@lo:400:kworker.0 Request processed in 54us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368073.632811:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787368073.634882:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808577536 00000100:00100000:0.0:1787368073.634906:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808577536 00000100:00100000:0.0:1787368073.634971:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808577280 00000100:00100000:0.0:1787368073.634975:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808577280 00000100:00100000:0.0:1787368073.634994:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787368073.635003:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808577536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368073.635100:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808577536:12345-0@lo:400:kworker.0 Request processed in 98us (10086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.635108:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787368073.635127:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787368073.635134:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808577280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368073.635164:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808577280:12345-0@lo:400:kworker.0 Request processed in 32us (3494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.635170:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787368073.635219:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808577536:0@lo:400:kworker.0 00000100:00080000:0.0:1787368073.635879:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787368073.635895:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787368073.636823:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808577664 00000100:00100000:2.0:1787368073.636832:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808577664 00000100:00100000:2.0:1787368073.636937:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787368073.636946:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808577664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.637006:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808577664:12345-0@lo:400:kworker.0 Request processed in 62us (4423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.637013:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787368073.637062:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787368073.637202:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874190808577792:12345-0@lo:8:kworker.0 Request processed in 11572us (11633us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787368073.637210:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787368073.637245:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368073.637249:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787368073.637253:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808577792:0@lo:8:kworker.0 00000100:00100000:0.0:1787368073.637725:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808577152:12345-0@lo:503:mount.lustre.0 Request processed in 13070us (13655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.637734:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787368073.637802:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808577152:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787368073.638252:0:19485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787368073.638374:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368073.638446:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.638485:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808578432 00000100:00100000:0.0:1787368073.638490:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808578432 00000100:00100000:0.0:1787368073.638526:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787368073.638534:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808578432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368073.638655:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787368073.639089:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808578432:12345-0@lo:502:mount.lustre.0 Request processed in 496us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.639097:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787368073.639144:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578432:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368073.639325:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787368073.639348:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787368073.639381:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787368073.639392:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787368073.639405:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787368073.639416:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787368073.639427:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787368073.639437:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787368073.639449:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787368073.639471:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368073.639508:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.639535:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808578560 00000100:00100000:0.0:1787368073.639539:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808578560 00000100:00100000:0.0:1787368073.639568:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787368073.639575:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808578560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368073.639642:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808578560:12345-0@lo:502:mount.lustre.0 Request processed in 66us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.639658:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787368073.639692:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787368073.639706:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368073.639835:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787368073.639844:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000100:00100000:2.0:1787368073.640527:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808578304 00000100:00100000:2.0:1787368073.640534:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808578304 00000100:00100000:2.0:1787368073.640612:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368073.640621:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808578304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787368073.640644:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787368073.640692:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808578304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (8066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.640698:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787368073.641258:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836b9880 x1874190808577664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368073.641271:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808577664:0@lo:400:kworker.0 00010000:00080000:2.0:1787368073.641282:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5582b31500 x1874190808578304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368073.641296:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808578304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368073.641307:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808577280:0@lo:400:kworker.0 00010000:00080000:2.0:1787368073.641318:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836baa00 x1874190808577920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368073.641325:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808577920:0@lo:400:kworker.0 00000020:01000000:2.0:1787368073.641706:0:19489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787368073.641713:0:19489:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787368073.641720:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368073.641722:0:19489:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787368073.641731:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787368073.641813:0:19489:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c55b8aa8000) 00000020:00000080:2.0:1787368073.641839:0:19489:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787368073.641846:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787368073.641937:0:19489:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5483083000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787368073.641944:0:19489:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787368073.641958:0:19489:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x66f5679bff031ad5 00010000:00010000:2.0:1787368073.646273:0:19489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787368073.646815:0:19489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1787368073.648247:0:19489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787368073.649708:0:19489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787368073.649720:0:19489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368073.649735:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368073.649816:0:19489:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787368073.649822:0:19489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368073.649828:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368073.649829:0:19489:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787368073.649833:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787368073.649834:0:19489:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787368073.649837:0:19489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368073.649840:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368073.649841:0:19489:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787368073.649844:0:19489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368073.649846:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368073.649847:0:19489:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787368073.649851:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787368073.649879:0:19489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368073.649893:0:19489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368073.649895:0:19489:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787368073.649898:0:19489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787368073.652320:0:19485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787368073.652391:0:19485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787368073.652410:0:19485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.652422:0:19485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368073.652450:0:19485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5483083000 from 1 10000000:01000000:1.0:1787368073.652453:0:19485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787368073.652487:0:19485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.652495:0:19485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.652506:0:19485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368073.652527:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368073.652588:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.652630:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368073.652698:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808578688 00000100:00100000:2.0:1787368073.652704:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808578688 00000100:00100000:2.0:1787368073.652754:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787368073.652762:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+22:19485:x1874190808578688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368073.652773:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368073.652783:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031adc expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368073.652803:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031adc expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368073.652813:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031adc expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368073.652821:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ca00, rc 0) 00000100:00100000:2.0:1787368073.652858:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808578688:12345-0@lo:101:mount.lustre.0 Request processed in 97us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.652865:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787368073.653094:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368073.653107:0:19485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.653116:0:19485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368073.653974:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787368073.654242:0:19485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787368073.654823:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787368073.654850:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787368073.654864:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787368073.654868:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787368073.654945:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368073.655000:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.655147:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368073.658242:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808578816 00000100:00100000:0.0:1787368073.658257:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808578816 00000100:00100000:0.0:1787368073.658310:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787368073.658321:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808578816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368073.658508:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808578816:12345-0@lo:501:mount.lustre.0 Request processed in 188us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.658516:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787368073.658614:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368073.658661:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368073.658725:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.658766:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787368073.658900:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808578944 00000100:00100000:2.0:1787368073.658905:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808578944 00000100:00100000:2.0:1787368073.658932:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787368073.658938:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808578944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368073.659042:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808578944:12345-0@lo:503:mount.lustre.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.659049:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787368073.659208:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808578944:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787368073.659644:0:19485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787368073.659731:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368073.659859:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.659897:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787368073.660116:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808579072 00000100:00100000:2.0:1787368073.660122:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808579072 00000100:00100000:2.0:1787368073.660195:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787368073.660204:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808579072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368073.660302:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808579072:12345-0@lo:502:mount.lustre.0 Request processed in 98us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.660310:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787368073.660394:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787368073.660601:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787368073.660628:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787368073.660644:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787368073.660660:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787368073.660676:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787368073.660692:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787368073.660706:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787368073.660721:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787368073.660753:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787368073.660769:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787368073.660784:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787368073.660808:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368073.660848:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.661651:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787368073.663749:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808579200 00000100:00100000:0.0:1787368073.663760:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808579200 00000100:00100000:1.0:1787368073.663842:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787368073.663854:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808579200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368073.664157:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808579200:12345-0@lo:502:mount.lustre.0 Request processed in 180us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368073.664166:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787368073.664318:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787368073.664414:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787368073.664426:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787368073.665138:0:19493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368073.665147:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368073.665158:0:19493:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787368073.665165:0:19493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c5483083000 00000020:00000080:3.0:1787368073.665168:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368073.665175:0:19493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368073.665178:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368073.665179:0:19493:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787368073.665182:0:19493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368073.665184:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368073.665185:0:19493:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787368073.665188:0:19493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c5483083000 00000020:00000080:3.0:1787368073.665190:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368073.665247:0:19493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368073.665251:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368073.665252:0:19493:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787368073.665254:0:19493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368073.665257:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368073.665258:0:19493:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787368073.665261:0:19493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c5483083000 00000020:00000080:3.0:1787368073.665263:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368073.665280:0:19493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368073.665283:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368073.665284:0:19493:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787368073.665287:0:19493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787368073.665289:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368073.665290:0:19493:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787368073.665293:0:19493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c5483083000 00000020:00000080:3.0:1787368073.665295:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787368073.665317:0:19493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787368073.665320:0:19493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787368073.665321:0:19493:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787368073.665323:0:19493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787368073.669458:0:19485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787368073.669503:0:19485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787368073.669521:0:19485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368073.669535:0:19485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368073.669604:0:19485:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787368073.669608:0:19485:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c5483083000 10000000:01000000:0.0:1787368073.669611:0:19485:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c5483083000 10000000:01000000:0.0:1787368073.669615:0:19485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787368073.669620:0:19485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c5483083000 from 1 10000000:01000000:0.0:1787368073.669623:0:19485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787368073.669665:0:19485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368073.669674:0:19485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368073.669685:0:19485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368073.669709:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787368073.669916:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.669961:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787368073.670007:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808579328 00000100:00100000:3.0:1787368073.670015:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808579328 00000100:00100000:3.0:1787368073.670068:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787368073.670086:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:19485:x1874190808579328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368073.670099:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368073.670110:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75c00/0x66f5679bff031af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031aea expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.670133:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75c00/0x66f5679bff031af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031aea expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.670145:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75c00/0x66f5679bff031af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031aea expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.670153:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75c00, rc 0) 00000100:00100000:3.0:1787368073.670191:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579328:12345-0@lo:101:mount.lustre.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368073.670198:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787368073.670332:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368073.670345:0:19485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368073.670383:0:19485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787368073.671687:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787368073.671944:0:19485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368073.672198:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787368073.672222:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787368073.672235:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787368073.672247:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787368073.672259:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787368073.672273:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787368073.672287:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787368073.672299:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787368073.672310:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787368073.672333:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787368073.672423:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787368073.672438:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787368073.672448:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787368073.672459:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787368073.672470:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787368073.672480:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787368073.672491:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787368073.672504:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787368073.672515:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787368073.672526:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787368073.672536:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787368073.672547:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787368073.672557:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787368073.672568:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787368073.672579:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787368073.672589:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787368073.672611:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787368073.672622:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787368073.672632:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787368073.672643:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787368073.672653:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787368073.672663:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787368073.672674:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787368073.672684:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787368073.672694:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787368073.672705:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787368073.672716:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787368073.672729:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787368073.673444:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787368073.673462:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787368073.673473:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787368073.673484:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787368073.673517:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787368073.673535:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787368073.673549:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787368073.673563:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787368073.673583:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787368073.673588:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787368073.673670:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368073.673730:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.680198:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368073.688422:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808579456 00000100:00100000:1.0:1787368073.688436:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808579456 00000100:00100000:1.0:1787368073.688504:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787368073.688514:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368073.688679:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579456:12345-0@lo:501:mount.lustre.0 Request processed in 166us (14948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368073.688697:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787368073.691989:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368073.692255:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368073.692324:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.692402:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368073.692510:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808579584 00000100:00100000:1.0:1787368073.692517:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808579584 00000100:00100000:1.0:1787368073.692570:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787368073.692579:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579584:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368073.693843:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579584:12345-0@lo:503:mount.lustre.0 Request processed in 1261us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368073.693854:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787368073.697685:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579584:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787368073.698934:0:19485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787368073.699022:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368073.699243:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.699288:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787368073.699346:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808579712 00000100:00100000:3.0:1787368073.699383:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808579712 00000100:00100000:3.0:1787368073.699426:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787368073.699436:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368073.699546:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579712:12345-0@lo:502:mount.lustre.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368073.699553:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787368073.699660:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368073.699859:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787368073.699896:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787368073.699913:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787368073.699927:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787368073.699941:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787368073.699955:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787368073.699970:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787368073.699985:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787368073.700010:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787368073.700024:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787368073.700185:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787368073.700203:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787368073.700216:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787368073.700228:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787368073.700240:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787368073.700251:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787368073.700262:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787368073.700275:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787368073.700287:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787368073.700315:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787368073.700329:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787368073.700340:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787368073.700351:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787368073.700409:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787368073.700422:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787368073.700435:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787368073.700448:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787368073.700461:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787368073.700473:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787368073.700486:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787368073.700498:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787368073.700510:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787368073.700522:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787368073.700535:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787368073.700548:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787368073.700573:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787368073.700588:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787368073.700600:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787368073.700610:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787368073.700621:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787368073.700633:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787368073.700656:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787368073.700669:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787368073.700682:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787368073.700694:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787368073.700707:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787368073.700720:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787368073.700732:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787368073.700854:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368073.700926:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368073.700960:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787368073.701164:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808579840 00000100:00100000:0.0:1787368073.701171:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808579840 00000100:00100000:0.0:1787368073.701220:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787368073.701229:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368073.701344:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579840:12345-0@lo:502:mount.lustre.0 Request processed in 116us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.701371:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787368073.701824:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368073.702007:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787368073.702289:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787368073.702329:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368073.702642:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.702682:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787368073.703906:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808579968 00000100:00100000:2.0:1787368073.703917:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808579968 00000100:00100000:2.0:1787368073.703976:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787368073.703985:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368073.704269:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808579968:12345-0@lo:502:mount.lustre.0 Request processed in 284us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.704278:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787368073.712588:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808579968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368073.712711:0:19485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787368073.712725:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787368073.721528:0:19498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787368073.721546:0:19498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c55b5544d28) 00000020:00000080:0.0:1787368073.721573:0:19498:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787368073.721670:0:19498:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5483083000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787368073.721674:0:19498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c5483083000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787368073.721677:0:19498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5483083000 3 00010000:00080000:0.0:1787368073.721721:0:19498:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5482222000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368073.728283:0:19498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787368073.728581:0:19498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787368073.728628:0:19498:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787368073.728641:0:19498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x66f5679bff031aff 00000100:00080000:0.0:1787368073.728652:0:19498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368073.728658:0:19498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c5482222000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368073.728701:0:19498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b6041c00 x1874190808580096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368073.728725:0:19498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787368073.729021:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808580096:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787368073.729099:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.729801:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808580096 00000100:00100000:0.0:1787368073.729807:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808580096 00000100:00100000:0.0:1787368073.729841:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787368073.729849:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874190808580096:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787368073.729874:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:0.0:1787368073.729933:0:17164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x66f5679bff031b06 00000004:00100000:0.0:1787368073.729950:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787368073.729981:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9c5483208800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368073.730042:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874190808580096:12345-0@lo:38:llog_process_th.0 Request processed in 193us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.730064:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787368073.730107:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b6041c00 x1874190808580096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368073.730119:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368073.730126:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787368073.730134:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787368073.730138:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787368073.730141:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5482222000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787368073.730146:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808580096:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787368073.730683:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368073.730688:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368073.730691:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368073.730700:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368073.730722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368073.730725:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787368073.730728:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368073.730732:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 530 00000100:00080000:3.0:1787368073.730743:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787368073.730748:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c548277b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368073.730763:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c54836bb100 x1874190808580864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368073.730803:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808580480:0@lo:400:kworker.0 00000100:00100000:1.0:1787368073.730844:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368073.730957:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808580224:0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.730993:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368073.731022:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808580736:0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.731059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368073.731082:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368073.731087:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808580608:0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.731120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368073.731151:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808580352:0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.731173:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368073.731203:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808580736 00000100:00100000:2.0:1787368073.731209:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808580736 00000100:00100000:2.0:1787368073.731245:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368073.731253:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808580736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.731295:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808580736:12345-0@lo:400:kworker.0 Request processed in 42us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.731302:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368073.731322:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808580608 00000100:00100000:2.0:1787368073.731326:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808580608 00000100:00100000:2.0:1787368073.731345:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808580352 00000100:00100000:2.0:1787368073.731347:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808580352 00000100:00100000:2.0:1787368073.731380:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787368073.731386:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808580608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.731417:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808580608:12345-0@lo:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.731423:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787368073.731433:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787368073.731439:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808580352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.731467:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808580352:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.731472:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787368073.731504:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808580608:0@lo:400:kworker.0 00010000:00080000:2.0:1787368073.731514:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836baa00 x1874190808580736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368073.731531:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808580736:0@lo:400:kworker.0 00000100:00100000:2.0:1787368073.731563:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808580352:0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.732329:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808580224 00000100:00100000:3.0:1787368073.732335:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808580224 00000100:00100000:3.0:1787368073.732384:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787368073.732391:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808580224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368073.732436:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808580224:12345-0@lo:400:kworker.0 Request processed in 46us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368073.732443:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787368073.732473:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808580992:0@lo:400:kworker.0 00000100:00100000:0.0:1787368073.732705:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808580864:0@lo:8:kworker.0 00000100:00100000:0.0:1787368073.732809:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787368073.732938:0:19498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787368073.732954:0:19498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c55912fcd28) 00000020:00000080:0.0:1787368073.732976:0:19498:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787368073.733145:0:19498:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5483083000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787368073.733149:0:19498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c5483083000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787368073.733151:0:19498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5483083000 3 00010000:00080000:0.0:1787368073.733179:0:19498:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5483209800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.104@tcp at head 00000100:00100000:1.0:1787368073.734047:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808581120:0@lo:400:kworker.0 00000100:00100000:1.0:1787368073.734090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.734239:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.735160:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808580480 00000100:00100000:0.0:1787368073.735170:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808580480 00000100:00100000:0.0:1787368073.735213:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808581120 00000100:00100000:0.0:1787368073.735216:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808581120 00000100:00100000:0.0:1787368073.735229:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808580992 00000100:00100000:0.0:1787368073.735232:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808580992 00000100:00100000:0.0:1787368073.735247:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787368073.735256:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808580480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368073.735328:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808580480:12345-0@lo:400:kworker.0 Request processed in 72us (4483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.735346:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787368073.735378:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787368073.735385:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808581120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368073.735416:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808581120:12345-0@lo:400:kworker.0 Request processed in 33us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.735422:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787368073.735433:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787368073.735438:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808580992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368073.735471:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808580992:12345-0@lo:400:kworker.0 Request processed in 32us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.735476:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787368073.735519:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836bad80 x1874190808581120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368073.735535:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808581120:0@lo:400:kworker.0 00010000:00080000:0.0:1787368073.735548:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c548278f100 x1874190808580480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368073.735557:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808580480:0@lo:400:kworker.0 00010000:00080000:0.0:1787368073.735591:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836b9880 x1874190808580992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368073.735601:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808580992:0@lo:400:kworker.0 00000100:00100000:1.0:1787368073.737424:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808580864 00000100:00100000:1.0:1787368073.737435:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808580864 00000100:00100000:1.0:1787368073.737472:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368073.737480:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874190808580864:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787368073.737562:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874190808580864:12345-0@lo:8:kworker.0 Request processed in 82us (4754us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787368073.737569:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368073.737604:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548278c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808580224:0@lo:400:kworker.0 00000100:00100000:1.0:1787368073.737620:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787368073.737629:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808581248:0@lo:400:kworker.0 00000100:00100000:1.0:1787368073.737659:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.737816:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368073.737823:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787368073.737827:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787368073.737840:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808580864:0@lo:8:kworker.0 00000100:00100000:0.0:1787368073.737861:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808581248 00000100:00100000:0.0:1787368073.737864:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808581248 00000100:00100000:0.0:1787368073.737944:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787368073.737952:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808581248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368073.737998:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808581248:12345-0@lo:400:kworker.0 Request processed in 47us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.738005:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787368073.743509:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836bbb80 x1874190808581248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368073.743529:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808581248:0@lo:400:kworker.0 00010000:00010000:2.0:1787368073.747392:0:19498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787368073.754391:0:19498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787368073.754443:0:19498:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787368073.754457:0:19498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x66f5679bff031b14 00000100:00080000:2.0:1787368073.754468:0:19498:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787368073.754474:0:19498:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c5483209800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368073.754510:0:19498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55be7f2a00 x1874190808581376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787368073.754535:0:19498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787368073.754560:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368073.754565:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368073.754568:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368073.754570:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787368073.757068:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808581376:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368073.757149:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368073.757350:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808581376 00000100:00100000:0.0:1787368073.757385:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808581376 00000100:00100000:0.0:1787368073.757418:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787368073.757426:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874190808581376:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787368073.757467:0:18960:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:0.0:1787368073.757497:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x66f5679bff031b1b 00000004:00100000:0.0:1787368073.757512:0:18960:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787368073.757542:0:18960:0:(import.c:65:import_set_state_nolock()) ffff9c548320f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368073.757591:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874190808581376:12345-0@lo:38:llog_process_th.0 Request processed in 164us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368073.757598:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787368073.757641:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55be7f2a00 x1874190808581376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368073.757651:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368073.757658:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787368073.757666:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787368073.757676:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787368073.757678:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5483209800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787368073.757685:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808581376:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787368073.763543:0:19498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1787368073.763630:0:19485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787368073.763672:0:19485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787368073.763705:0:19485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.763718:0:19485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787368073.763771:0:19485:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787368073.763773:0:19485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787368073.763775:0:19485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368073.763776:0:19485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368073.763777:0:19485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368073.763778:0:19485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368073.763779:0:19485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368073.763781:0:19485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368073.763783:0:19485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787368073.763787:0:19485:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787368073.763789:0:19485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787368073.763790:0:19485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787368073.764223:0:19485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368073.764224:0:19485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368073.764226:0:19485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368073.764227:0:19485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368073.764228:0:19485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368073.764229:0:19485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368073.764230:0:19485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787368073.764260:0:19485:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787368073.764279:0:19485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808581504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787368073.765294:0:19485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.765348:0:19485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787368073.765408:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808581504 00000100:00100000:2.0:1787368073.765417:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808581504 00000100:00100000:2.0:1787368073.765465:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787368073.765476:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808581504:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787368073.765516:0:17157:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787368073.765531:0:17157:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787368073.776065:0:17157:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787368073.776088:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787368073.776190:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787368073.776195:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787368073.776218:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.776237:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a8f expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.776245:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a9d expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.776265:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.776305:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff031a9d expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.776318:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff031a9d expref: 24 pid: 17155 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368073.776333:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808581632:0@lo:104: 00000100:00100000:3.0:1787368073.776439:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787368073.776482:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff031a8f expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.776491:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff031a8f expref: 24 pid: 17154 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368073.776500:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808581760:0@lo:104: 00000100:00100000:3.0:1787368073.776521:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368073.776621:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787368073.776862:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:19485:x1874190808581504:12345-0@lo:253:mount.lustre.0 Request processed in 11387us (11569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368073.776873:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787368073.777601:0:19485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3ce871c-8318-4c29-9238-0157d9966155:19485:1874190808581504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787368073.777615:0:19485:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787368073.777618:0:19485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787368073.777620:0:19485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787368073.777621:0:19485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368073.777622:0:19485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368073.777623:0:19485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368073.777624:0:19485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368073.777626:0:19485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787368073.777628:0:19485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368073.777649:0:19485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787368073.777662:0:19485:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787368073.780508:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808581632 00000100:00100000:1.0:1787368073.780526:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808581632 00000100:00100000:1.0:1787368073.780572:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808581760 00000100:00100000:1.0:1787368073.780576:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808581760 00000100:00100000:1.0:1787368073.780592:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368073.780601:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+4:17178:x1874190808581632:12345-0@lo:104: 00010000:00010000:1.0:1787368073.780633:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.780753:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787368073.780759:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+4:17178:x1874190808581632:12345-0@lo:104: Request processed in 160us (4320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368073.780766:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368073.780782:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787368073.780788:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808581760:12345-0@lo:104: 00010000:00010000:1.0:1787368073.780796:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.780828:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787368073.780833:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:17178:x1874190808581760:12345-0@lo:104: Request processed in 46us (4312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368073.780838:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787368073.780860:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787368073.780865:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.780873:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c200 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368073.780877:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.780894:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368073.780902:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368073.780914:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787368073.780952:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.780959:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368073.780977:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.780984:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff031a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031aa4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.780997:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368073.781000:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.781005:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241de00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368073.781008:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.781015:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368073.781021:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368073.781026:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787368073.781054:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.781060:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368073.781085:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.781093:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241de00/0x66f5679bff031a8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031a96 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.781108:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368073.781111:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368073.781113:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368073.781119:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808582016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368073.781122:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787368073.781135:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808581888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368073.781172:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.781205:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808582016 00000100:00100000:1.0:1787368073.781210:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808582016 00010000:00010000:1.0:1787368073.781231:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031a8f expref: 24 pid: 17154 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368073.781241:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368073.782685:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808581888 00000100:00100000:1.0:1787368073.782695:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808581888 00010000:00010000:1.0:1787368073.782727:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031a9d expref: 25 pid: 17155 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368073.782767:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368073.782775:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3ce871c-8318-4c29-9238-0157d9966155+25:3653:x1874190808582016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368073.782790:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368073.782795:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031a8f expref: 25 pid: 17154 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.782806:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff031a8f expref: 25 pid: 17154 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.782824:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368073.782899:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3ce871c-8318-4c29-9238-0157d9966155+25:3653:x1874190808582016:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368073.782908:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368073.782924:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787368073.782930:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3ce871c-8318-4c29-9238-0157d9966155+24:3651:x1874190808581888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368073.782938:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368073.782942:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031a9d expref: 24 pid: 17155 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.782951:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff031a9d expref: 24 pid: 17155 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.782962:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.782969:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787368073.782983:0:17149:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.025575183s 00010000:00010000:1.0:1787368073.782987:0:17149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.782994:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.782999:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.783006:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.783022:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368073.783026:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.783034:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.783042:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368073.783052:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368073.783081:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3ce871c-8318-4c29-9238-0157d9966155+24:3651:x1874190808581888:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368073.783088:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787368073.784138:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808582016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368073.784961:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808581888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368073.789582:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368073.789915:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613a400/0x66f5679bff031aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff031a9d expref: 23 pid: 17155 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368073.789937:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808581632:0@lo:104: 00010000:00010000:3.0:1787368073.789955:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613ac00/0x66f5679bff031a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff031a8f expref: 22 pid: 17154 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368073.789964:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1874190808581760:0@lo:104: 00010000:00010000:3.0:1787368073.789990:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.790001:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.790007:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368073.790013:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1787368073.792443:0:19485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787368073.795901:0:19485:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787368073.795911:0:19485:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787368073.795947:0:19485:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787368073.795984:0:19485:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787368073.796002:0:19485:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1787368073.796019:0:19485:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1787368073.797941:0:19485:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787368073.798177:0:19485:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787368074.137107:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787368074.644674:0:19551:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787368074.645265:0:19551:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787368074.649291:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808582144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368074.649379:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368074.649404:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808582144 00000100:00100000:0.0:1787368074.649413:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808582144 00000100:00100000:0.0:1787368074.649465:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787368074.649475:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808582144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787368074.649507:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787368074.649553:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808582144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368074.649560:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787368074.649868:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808582272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787368074.649911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368074.650290:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808582272 00000100:00100000:1.0:1787368074.650296:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808582272 00000100:00100000:1.0:1787368074.650335:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787368074.650344:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808582272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787368074.650386:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787368074.650438:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808582272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368074.650444:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787368074.650506:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808582272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368074.650596:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808582144:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787368075.160537:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787368075.299259:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787368075.299267:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55a0f12000 from 10 10000000:01000000:2.0:1787368075.299273:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787368075.299318:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.299330:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.299342:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368075.302907:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808582400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787368075.302975:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368075.303022:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb5949c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368075.303234:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808582400 00000100:00100000:3.0:1787368075.303250:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808582400 00000100:00100000:3.0:1787368075.303307:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787368075.303317:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+22:17159:x1874190808582400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368075.303333:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368075.303350:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031b29 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.303409:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031b29 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.303420:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031b29 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.303428:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75800, rc 0) 00000100:00100000:3.0:1787368075.303470:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808582400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368075.303476:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787368075.304388:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808582400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368075.304419:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.304430:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368075.304508:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808582528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787368075.304551:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368075.304579:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb5949c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368075.304724:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808582528 00000100:00100000:0.0:1787368075.304729:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808582528 00000100:00100000:0.0:1787368075.304769:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787368075.304777:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808582528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787368075.304801:0:17157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787368075.304815:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787368075.304818:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787368075.304911:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808582528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.304920:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787368075.304993:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808582528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787368075.305094:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787368075.305102:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.305110:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368075.305120:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787368075.305122:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c5483e3e800 from 10 10000000:01000000:2.0:1787368075.305125:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787368075.305146:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.305164:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.305173:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368075.305185:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808582656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787368075.305212:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368075.305236:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb5949c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368075.305277:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808582656 00000100:00100000:0.0:1787368075.305281:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808582656 00000100:00100000:0.0:1787368075.305316:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787368075.305323:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808582656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368075.305331:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368075.305342:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613a800/0x66f5679bff031b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031b37 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.305380:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a800/0x66f5679bff031b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031b37 expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.305390:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613a800/0x66f5679bff031b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031b37 expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.305398:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a800, rc 0) 00000100:00100000:0.0:1787368075.305433:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:17159:x1874190808582656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.305438:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787368075.305557:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808582656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368075.305576:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.305594:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368075.305637:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808582784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787368075.305681:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368075.305710:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd5cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1787368075.305837:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808582784 00000100:00100000:0.0:1787368075.305842:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808582784 00000100:00100000:0.0:1787368075.305929:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787368075.305937:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+24:17159:x1874190808582784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787368075.305958:0:17154:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787368075.305971:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787368075.305974:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787368075.306043:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+24:17159:x1874190808582784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.306051:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787368075.306804:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808582784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787368075.306861:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787368075.306869:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.306890:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787368075.421180:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787368075.800426:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368055/real 1787368055] req@ffff9c5582b30380 x1874190808568320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368075 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368075.800455:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c5582b30380 x1874190808568320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368075 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368075.800466:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368055/real 1787368055] req@ffff9c5582b32d80 x1874190808568448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368075 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368075.800479:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c5582b32d80 x1874190808568448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368075 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787368075.800499:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55a9345000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787368075.800517:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787368075.800521:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808568320:0@lo:8:kworker.0 00000100:00080000:0.0:1787368075.800527:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787368075.800531:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787368075.800534:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808568448:0@lo:8:kworker.0 00000100:00080000:0.0:1787368075.800627:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368075.800631:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787368075.800634:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c55a9345000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368075.800639:0:15931:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1787368075.800648:0:15931:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787368075.800655:0:15931:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c55a9345000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368075.800675:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483711500 x1874190808583168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368075.800688:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368075.800691:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787368075.800693:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c55867d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368075.800696:0:15931:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1787368075.800699:0:15931:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787368075.800702:0:15931:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c55867d7000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368075.800712:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483710700 x1874190808583296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368075.800738:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368075.800741:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787368075.800743:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368075.800747:0:15931:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c548277b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368075.800758:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483710a80 x1874190808583808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368075.802041:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808582912:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802163:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808583680:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802186:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802203:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808584320:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802263:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787368075.802271:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808583552:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802298:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802316:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808584192:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802338:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802385:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808583040:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802407:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802425:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808583936:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802442:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802457:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808584448:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802485:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802501:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787368075.802507:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808583424:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802531:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802545:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808584064:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802566:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.802597:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808582912 00000100:00100000:0.0:1787368075.802604:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808582912 00000100:00100000:0.0:1787368075.802652:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787368075.802661:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808582912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802717:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808582912:12345-0@lo:400:kworker.0 Request processed in 58us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.802724:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787368075.802755:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808583680 00000100:00100000:0.0:1787368075.802759:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808583680 00000100:00100000:0.0:1787368075.802801:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368075.802933:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808583680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.802974:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808583680:12345-0@lo:400:kworker.0 Request processed in 159us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.802981:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368075.803004:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808584320 00000100:00100000:0.0:1787368075.803007:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808584320 00000100:00100000:0.0:1787368075.803027:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808584192 00000100:00100000:0.0:1787368075.803030:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808584192 00000100:00100000:0.0:1787368075.803041:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808583936 00000100:00100000:0.0:1787368075.803043:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808583936 00000100:00100000:0.0:1787368075.803052:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808584448 00000100:00100000:0.0:1787368075.803054:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808584448 00000100:00100000:0.0:1787368075.803063:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808583424 00000100:00100000:0.0:1787368075.803065:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808583424 00000100:00100000:0.0:1787368075.803075:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808584064 00000100:00100000:0.0:1787368075.803077:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808584064 00000100:00100000:0.0:1787368075.803090:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787368075.803095:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808584320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.803127:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808584320:12345-0@lo:400:kworker.0 Request processed in 31us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.803133:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787368075.803148:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787368075.803157:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808584192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.803187:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808584192:12345-0@lo:400:kworker.0 Request processed in 32us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.803193:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787368075.803209:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787368075.803217:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808583936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.803347:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808583936:12345-0@lo:400:kworker.0 Request processed in 131us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.803379:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787368075.803392:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483712d80 x1874190808583936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368075.803402:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787368075.803412:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808583936:0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.803415:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808584448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.803460:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808584448:12345-0@lo:400:kworker.0 Request processed in 49us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.803466:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787368075.803478:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787368075.803483:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808583424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.803511:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808583424:12345-0@lo:400:kworker.0 Request processed in 28us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.803517:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787368075.803527:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787368075.803533:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808584064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.803556:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808584064:12345-0@lo:400:kworker.0 Request processed in 24us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.803561:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787368075.803580:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808583552 00000100:00100000:0.0:1787368075.803583:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808583552 00000100:00100000:0.0:1787368075.803612:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808583040 00000100:00100000:0.0:1787368075.803616:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808583040 00000100:00100000:0.0:1787368075.803628:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787368075.803634:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808583552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.803664:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808583552:12345-0@lo:400:kworker.0 Request processed in 30us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.803679:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787368075.803692:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787368075.803698:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808583040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368075.803722:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808583040:12345-0@lo:400:kworker.0 Request processed in 25us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.803728:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787368075.803757:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787368075.803761:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787368075.803764:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787368075.803785:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808583168:0@lo:8:kworker.0 00000100:00100000:0.0:1787368075.803935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.803975:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808583296:0@lo:8:kworker.0 00000100:00100000:0.0:1787368075.804014:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.804038:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808583808:0@lo:8:kworker.0 00000100:00100000:0.0:1787368075.804062:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.804096:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808583168 00000100:00100000:0.0:1787368075.804100:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808583168 00000100:00100000:0.0:1787368075.804116:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808583296 00000100:00100000:0.0:1787368075.804119:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808583296 00000100:00100000:0.0:1787368075.804127:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808583808 00000100:00100000:0.0:1787368075.804130:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808583808 00000100:00100000:0.0:1787368075.804139:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787368075.804144:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808583168:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787368075.804161:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787368075.804167:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874190808583296:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787368075.804169:0:18670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00010000:00080000:1.0:1787368075.804192:0:18672:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1787368075.804199:0:18670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff031b45 00000020:00000080:1.0:1787368075.804214:0:18672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff031b4c 00002000:00100000:0.0:1787368075.804215:0:18670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c548320b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787368075.804224:0:18672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c54824e2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787368075.804228:0:18670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00080000:1.0:1787368075.804229:0:18672:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787368075.804233:0:18670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00100000:1.0:1787368075.804234:0:18672:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787368075.804307:0:18670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787368075.804330:0:18670:0:(import.c:65:import_set_state_nolock()) ffff9c548320d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368075.804401:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874190808583168:12345-0@lo:8:kworker.0 Request processed in 255us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.804409:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787368075.804431:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787368075.804437:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808583808:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787368075.804455:0:18670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00010000:00080000:3.0:1787368075.804463:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483713100 x1874190808583424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368075.804477:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808583424:0@lo:400:kworker.0 00000020:00000080:0.0:1787368075.804478:0:18670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff031b53 00002000:00100000:0.0:1787368075.804490:0:18670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c5483209000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 1 00010000:00080000:3.0:1787368075.804494:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483712a00 x1874190808584064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1787368075.804495:0:18670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787368075.804500:0:18670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787368075.804509:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808584064:0@lo:400:kworker.0 00002000:00080000:1.0:1787368075.804513:0:18672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1787368075.804521:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808583040:0@lo:400:kworker.0 00000100:00080000:1.0:1787368075.804530:0:18672:0:(import.c:65:import_set_state_nolock()) ffff9c54824e0800 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1787368075.804538:0:18670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00010000:00080000:3.0:1787368075.804541:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483713800 x1874190808584448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368075.804551:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808584448:0@lo:400:kworker.0 00000100:00080000:0.0:1787368075.804560:0:18670:0:(import.c:65:import_set_state_nolock()) ffff9c5483208000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368075.804567:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1874190808583296:12345-0@lo:8:kworker.0 Request processed in 397us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368075.804574:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787368075.804589:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808583552:0@lo:400:kworker.0 00010000:00080000:3.0:1787368075.804606:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483710380 x1874190808584192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368075.804608:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874190808583808:12345-0@lo:8:kworker.0 Request processed in 168us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.804618:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368075.804630:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808584192:0@lo:400:kworker.0 00000100:00100000:3.0:1787368075.804646:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808582912:0@lo:400:kworker.0 00010000:00080000:3.0:1787368075.804656:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483710000 x1874190808583680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368075.804662:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808583680:0@lo:400:kworker.0 00010000:00080000:3.0:1787368075.804671:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483711f80 x1874190808584320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368075.804677:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808584320:0@lo:400:kworker.0 00010000:00080000:2.0:1787368075.805552:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483711500 x1874190808583168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787368100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368075.805563:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787368075.805571:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787368075.805578:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787368075.805583:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787368075.805585:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55a9345000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787368075.805638:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787368075.805644:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808583168:0@lo:8:kworker.0 00010000:00080000:2.0:1787368075.805657:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483710700 x1874190808583296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787368100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368075.805663:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787368075.805668:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787368075.805672:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787368075.805675:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787368075.805677:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787368075.805695:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787368075.805699:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808583296:0@lo:8:kworker.0 00010000:00080000:2.0:1787368075.805713:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483710a80 x1874190808583808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787368100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787368075.805723:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787368075.805727:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787368075.805744:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787368075.805746:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787368075.805757:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787368075.805761:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808583808:0@lo:8:kworker.0 00000004:00080000:2.0:1787368075.805819:0:17189:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787368075.805838:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1874190808584704:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787368075.805844:0:17186:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787368075.805895:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368075.805919:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb5940c0 going to sleep for 11 seconds 00000004:00080000:0.0:1787368075.805935:0:17186:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 533093578348ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787368075.805943:0:17186:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787368075.805973:0:17906:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787368075.806010:0:17906:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 533093654404ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787368075.806015:0:17906:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787368075.806164:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808584576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787368075.806195:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368075.806241:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808584576 00000100:00100000:0.0:1787368075.806248:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808584576 00000100:00100000:0.0:1787368075.806295:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368075.806305:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808584576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787368075.806327:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787368075.806391:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808584576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368075.806397:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787368075.806419:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787368075.806439:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f2300 x1874190808584576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368075.806454:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808584576:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1787368075.808319:0:17187:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1787368075.808343:0:17187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1874190808584960:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787368075.808404:0:17907:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787368075.808417:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368075.808419:0:17907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1874190808585216:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787368075.808439:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368075.808444:0:17907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368075.808459:0:17907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd5cc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787368075.808466:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808584832:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787368075.808471:0:17188:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787368075.808488:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368075.808509:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787368075.808514:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808585088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787368075.808531:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787368075.808544:0:17188:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 533096187958ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787368075.808550:0:17188:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787368075.808555:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808584832 00000100:00100000:3.0:1787368075.808561:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808584832 00000100:00100000:1.0:1787368075.808566:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808584704 00000100:00100000:1.0:1787368075.808569:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808584704 00000100:00100000:3.0:1787368075.808593:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808585088 00000100:00100000:1.0:1787368075.808596:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808584960 00000100:00100000:3.0:1787368075.808597:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808585088 00000100:00100000:1.0:1787368075.808598:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808584960 00000100:00100000:1.0:1787368075.808607:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808585216 00000100:00100000:1.0:1787368075.808609:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808585216 00000100:00100000:3.0:1787368075.808612:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368075.808619:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874190808584832:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787368075.808619:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787368075.808625:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17189:x1874190808584704:12345-0@lo:5:osp-pre-1-0.0 00002000:00000024:3.0:1787368075.808647:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787368075.808684:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874190808584832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368075.808691:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368075.808706:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368075.808713:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874190808585088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787368075.808721:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368075.808840:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874190808585088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368075.808847:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368075.808877:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787368075.808885:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17187:x1874190808584960:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1787368075.809082:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5582b30700 x1874190808585088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368075.809101:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808585088:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787368075.809113:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836bbb80 x1874190808584832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368075.809125:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808584832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787368075.809156:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787368075.809161:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787368075.809573:0:17895:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1787368075.810659:0:18671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787368075.810668:0:18671:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787368075.810674:0:18671:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00080000:1.0:1787368075.813217:0:18672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787368075.813229:0:18672:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787368075.813235:0:18672:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:3.0:1787368075.814918:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787368075.824945:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.824956:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.824974:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.824979:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.824986:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.825004:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787368075.825410:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787368075.825790:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.825800:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.825826:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368075.825899:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368075.825906:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.825924:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.825928:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.825937:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.825955:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.825963:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff031b5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.825982:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.825983:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.825985:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.827741:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.827752:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.827767:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.827771:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.827777:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.827790:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.827800:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.827808:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.828472:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787368075.829055:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.829063:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.829187:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.829191:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.829197:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.829210:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.829220:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.829227:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.830447:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787368075.830844:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787368075.830854:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.830866:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241de00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.830883:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.830895:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.830923:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.830931:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065346f0a/0x66f5679bff031b61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.830952:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368075.830955:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.830962:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.830966:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.830975:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.830985:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.830993:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c75d0aa9/0x66f5679bff031b68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.831006:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.831007:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.831134:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.831247:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.831254:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831334:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.831345:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.831351:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831389:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831398:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831405:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831422:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368075.831655:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368075.831661:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.831669:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580031400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.831673:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.831681:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.831753:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.831761:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56ec98a/0x66f5679bff031b6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.831775:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.831777:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.831778:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.831843:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.831848:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831856:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.831860:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.831864:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831884:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831892:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831905:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.831952:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368075.832200:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368075.832205:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.832212:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580031a00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.832216:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.832236:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.832247:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.832255:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000729a9030/0x66f5679bff031b76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787368075.832336:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.832342:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.832350:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.832371:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.832375:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.832385:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.832393:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.832400:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.832416:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368075.832598:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368075.832603:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.832610:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030e00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.832614:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.832622:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.832633:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.832640:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b117c6b3/0x66f5679bff031b7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.832663:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.832665:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.832666:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.832672:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.835422:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.835436:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.835460:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.835465:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.835472:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.835486:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.835497:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.835505:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.835525:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368075.835833:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368075.835841:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.835851:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.835855:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.835865:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.835892:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.835901:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064f4c7b/0x66f5679bff031b84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.835923:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.835926:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.835927:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.837525:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.837537:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.837552:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.837556:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.837562:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.837575:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.837601:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.837610:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.837636:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787368075.838101:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.838108:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838117:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.838121:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.838125:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838135:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838142:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838149:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838175:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787368075.838463:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.838469:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838478:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.838482:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.838486:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838496:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838503:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838511:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.838520:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787368075.838774:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787368075.838782:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838796:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580031c00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.838800:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838809:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838825:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838831:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008768eaf1/0x66f5679bff031b8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838849:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787368075.838852:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838857:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.838859:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838866:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838886:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838900:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b845bd9f/0x66f5679bff031b92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838915:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368075.838918:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838925:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030c00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368075.838929:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838937:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838948:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838955:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3dffe3c/0x66f5679bff031b99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.838969:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.838972:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.838973:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.838981:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.839168:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.839174:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.839183:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.839191:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.839196:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.839206:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.839215:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.839222:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.839243:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787368075.839926:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368075.839934:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.839944:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368075.839948:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.839957:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.839975:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.839993:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031ba0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.840010:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368075.840011:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368075.840013:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.841408:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787368075.841972:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787368075.841981:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.841996:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787368075.842001:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368075.842007:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.842020:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.842036:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.842044:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.842060:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.842253:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.842261:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.842271:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.842275:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.842286:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.842302:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.842320:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff031ba7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.842336:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.842338:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.842339:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787368075.842669:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787368075.842682:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.842692:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787368075.842696:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368075.842701:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.842719:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.842727:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.842735:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.842756:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.842777:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.842784:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.842793:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ae00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.842803:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.842813:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.842827:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.842835:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afa1a60/0x66f5679bff031bae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.842849:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.842850:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.842852:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.843632:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.843640:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.843651:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.843654:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.843658:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.843670:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.843678:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.843691:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.843716:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368075.844169:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.844176:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844185:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.844187:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.844191:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844199:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844207:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844214:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844234:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787368075.844380:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368075.844387:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844394:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fe00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.844398:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844407:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844422:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844429:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186b4e3a/0x66f5679bff031bb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844444:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.844447:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844459:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ec00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.844462:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844469:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844480:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844486:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2eb102/0x66f5679bff031bbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.844498:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.844500:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.844502:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.844798:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.844803:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844817:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.844820:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.844824:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844833:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844841:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844848:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.844878:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.845125:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.845131:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845139:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.845143:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845151:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845169:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845176:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031bc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845189:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.845191:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.845193:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.845295:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.845300:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845308:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.845312:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.845316:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845326:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845345:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845351:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845396:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.845621:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.845626:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845633:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.845636:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845643:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845653:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845661:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072d8f0be/0x66f5679bff031bca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.845688:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.845690:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.845692:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.845810:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.845820:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845829:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.845832:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.845836:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845845:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845854:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845860:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.845897:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787368075.846196:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368075.846203:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846210:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368075.846213:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846221:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846240:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846248:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603c30ad/0x66f5679bff031bd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846263:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368075.846265:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368075.846267:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787368075.846351:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787368075.846379:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846388:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787368075.846391:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368075.846396:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846406:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846415:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846423:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846452:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787368075.846460:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368075.846464:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846471:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368075.846474:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846483:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846494:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846502:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c55e5e68/0x66f5679bff031bd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.846516:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368075.846517:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368075.846519:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.846726:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.846818:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.846844:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.846854:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.846857:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.846861:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.846881:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.846890:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.846897:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.846949:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368075.847417:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.847424:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.847433:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.847443:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.847448:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.847459:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.847468:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.847476:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787368075.847938:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787368075.847945:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.847953:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1787368075.847961:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368075.847966:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.847976:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.847984:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368075.847992:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848050:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787368075.848057:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848066:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.848070:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848079:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848093:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848100:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000501e8da9/0x66f5679bff031bdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848117:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368075.848121:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848127:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.848137:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848146:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848159:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848166:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.848169:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848174:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ac00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.848177:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848184:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848192:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.848199:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.848200:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.848202:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.851148:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787368075.851163:0:18672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031be6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787368075.851719:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.851727:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851741:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.851746:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.851752:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851764:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851782:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851789:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851807:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.851817:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.851823:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851830:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ee00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.851833:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851842:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851858:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851866:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001478548e/0x66f5679bff031bf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.851890:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.851897:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.851899:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.852948:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.853141:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.853149:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853163:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.853167:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.853172:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853184:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853193:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853201:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853223:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.853520:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.853528:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.853536:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.853539:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.853548:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.853562:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.853570:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4aa4c38/0x66f5679bff031bfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.853587:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.853589:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.853590:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.853757:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.853762:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853770:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.853774:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.853778:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853800:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853809:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853816:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.853836:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.854100:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.854106:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.854114:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.854118:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.854133:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.854144:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.854152:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3a79ec/0x66f5679bff031c02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.854168:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.854170:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.854171:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.854245:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.854251:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854260:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.854263:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.854267:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854277:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854285:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854303:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854318:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.854326:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.854330:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854337:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.854340:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854348:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854387:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854394:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009782adf0/0x66f5679bff031c09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854407:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.854408:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.854410:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.854725:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.854738:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854746:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.854749:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.854753:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854762:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854770:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854778:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.854799:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.855038:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.855045:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855053:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.855056:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855065:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855076:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855095:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f6d2838/0x66f5679bff031c10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855109:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.855111:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.855113:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.855226:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.855232:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855239:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.855243:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.855247:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855255:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855270:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855276:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855295:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.855539:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.855544:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855552:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.855556:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855564:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855575:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855582:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b575d52f/0x66f5679bff031c17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.855596:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.855597:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.855599:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.855671:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.855676:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855684:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.855687:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.855691:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855700:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855708:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855715:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855740:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.855748:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.855752:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855759:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.855763:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855770:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855782:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855789:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c450424f/0x66f5679bff031c1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.855802:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.855804:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.855805:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.856117:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.856124:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.856133:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.856142:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.856146:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.856155:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.856162:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.856169:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.856218:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787368075.858143:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787368075.858155:0:18671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff031bed lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.858231:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.858240:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.858249:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.858253:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.858263:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.858281:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.858301:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f569a549/0x66f5679bff031c25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.858317:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.858319:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.858320:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.859005:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.859013:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859035:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.859039:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.859045:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859057:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859066:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859073:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859088:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.859095:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.859104:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859111:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82c00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.859115:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859123:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859133:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859140:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096923eda/0x66f5679bff031c2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859152:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.859154:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.859155:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.859732:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.859739:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859748:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.859751:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.859755:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859777:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859785:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859791:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859806:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.859813:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.859816:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859823:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.859826:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859833:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859844:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859851:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075cc6746/0x66f5679bff031c33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.859880:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.859882:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.859884:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.861961:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.861973:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.861988:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.861992:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.861997:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862011:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862033:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862040:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862055:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.862065:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.862079:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862098:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83c00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.862102:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862111:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862126:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862134:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d5756b7/0x66f5679bff031c3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862150:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.862151:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.862153:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.862636:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.862642:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862651:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.862654:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.862658:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862667:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862682:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862701:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862716:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.862724:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.862728:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862736:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82a00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.862739:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862746:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862758:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862766:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac04c57a/0x66f5679bff031c41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.862780:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.862787:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.862788:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.864249:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.864261:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864276:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.864280:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.864286:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864296:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864305:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864312:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864331:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.864345:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.864350:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864372:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83e00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.864376:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864398:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864412:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864418:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004de26898/0x66f5679bff031c48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864434:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.864436:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.864437:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.864907:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.864913:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864922:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.864925:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.864929:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864938:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864946:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864960:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864974:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.864983:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.864987:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.864994:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa83a00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.864997:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.865005:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.865125:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.865223:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.865232:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b0d568/0x66f5679bff031c4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.865247:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.865248:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.865250:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.865894:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.865910:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.865920:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.865924:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.865928:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.865939:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.865948:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.865955:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.865970:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.865978:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.865982:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.865990:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82e00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.865994:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.866002:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787368075.866185:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.866191:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866200:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.866203:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.866207:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866216:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866224:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866231:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866245:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.866251:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.866255:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866261:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.866264:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866284:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866295:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866302:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a5e3de1/0x66f5679bff031c5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866318:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.866319:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.866321:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.866626:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.866632:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866642:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.866645:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.866649:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866658:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866666:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.866685:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.866922:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.866932:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f931263/0x66f5679bff031c56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.866945:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.866947:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.866948:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.867460:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.868925:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.868935:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.868948:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.868952:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.868962:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.868979:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.868986:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004053ad50/0x66f5679bff031c64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.869030:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.869032:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.869034:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.869343:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.869351:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.869384:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.869389:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.869394:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.869406:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.869414:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.869420:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.869440:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.869608:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.869613:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.869621:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672a00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.869625:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.869632:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.869643:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.869650:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b342347/0x66f5679bff031c6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.869663:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.869664:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.869666:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.872305:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.872317:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872339:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.872343:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.872349:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872408:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872418:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872427:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872479:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368075.872863:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.872878:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872887:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.872891:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.872895:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872905:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872926:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872932:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.872945:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787368075.873318:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368075.873327:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873347:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.873374:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873386:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873404:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873412:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090355c40/0x66f5679bff031c72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873431:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.873435:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873441:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672c00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.873445:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873452:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873461:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873474:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054710cb9/0x66f5679bff031c79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873488:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.873490:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.873491:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.873498:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.873549:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.873555:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873563:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.873566:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.873571:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873580:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873589:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873597:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.873614:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.873967:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.873973:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.873981:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.873985:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.873993:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.874005:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.874012:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cbd24b8/0x66f5679bff031c80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.874039:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.874047:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.874048:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.874231:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.874237:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874245:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.874247:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.874251:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874261:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874269:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874275:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874287:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.874294:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.874297:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874303:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55afa82000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.874307:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874324:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874335:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874342:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c089d7/0x66f5679bff031c87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874386:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.874388:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.874390:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.874427:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.874433:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874441:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.874444:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.874448:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874456:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874463:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874480:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874492:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.874499:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.874502:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874509:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.874513:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874521:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874532:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874539:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff031c8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.874554:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.874555:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.874557:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.875186:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.875192:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875201:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.875204:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.875208:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875216:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875223:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875230:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875244:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.875252:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.875256:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875261:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.875265:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875284:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875296:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875302:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000704429ad/0x66f5679bff031c95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875317:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.875319:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.875320:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368075.875662:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.875668:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875676:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.875679:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.875683:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875693:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875701:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875718:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875732:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.875741:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.875744:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875752:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.875755:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875763:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875774:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875782:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028be7baf/0x66f5679bff031c9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.875795:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.875797:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.875799:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.876165:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.876179:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876187:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.876190:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.876193:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876203:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876211:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876219:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876232:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.876240:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.876244:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876250:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.876254:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876261:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876278:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876286:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000501e8da9/0x66f5679bff031ca3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876301:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.876303:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.876305:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.876593:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.876599:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876608:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.876611:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.876616:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876625:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876634:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876641:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.876666:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.876816:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.876821:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.876834:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.876837:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.876845:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.876856:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.876862:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d8f0be/0x66f5679bff031caa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.876888:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.876890:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.876891:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368075.877562:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.877569:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.877582:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1787368075.877585:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368075.877589:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.877600:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.877608:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.877615:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.877630:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787368075.877678:0:18671:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1787368075.877764:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17187:x1874190808584960:12345-0@lo:5:osp-pre-0-0.0 Request processed in 68877us (69344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368075.877774:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368075.877804:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368075.877815:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17907:x1874190808585216:12345-0@lo:7:osp-pre-1-1.0 00010000:00010000:1.0:1787368075.878036:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.878043:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.878051:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.878055:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.878064:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.878158:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.878166:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96dbe09/0x66f5679bff031cb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.878181:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.878182:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.878184:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368075.879201:0:17187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1874190808584960:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787368075.879228:0:17187:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1787368075.879267:0:17187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1874190808585344:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787368075.879310:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368075.879336:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9c6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1787368075.879425:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368075.879432:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.879443:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1787368075.879447:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368075.879452:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.879465:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.879474:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.879482:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.879496:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787368075.879980:0:19223:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787368075.879989:0:19223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:2.0:1787368075.880017:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.880024:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.880032:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.880036:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.880045:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.880059:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.880065:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff031cb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368075.880483:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808585344 00000100:00100000:3.0:1787368075.880489:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808585344 00010000:00010000:2.0:1787368075.880747:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.880749:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.880751:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368075.883766:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787368075.883782:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17187:x1874190808585344:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787368075.883824:0:19618:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:1.0:1787368075.889808:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368075.889822:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.889838:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787368075.889843:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368075.889850:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.889863:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.889888:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.889897:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.889936:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.890929:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.890940:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.890961:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.890967:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.890978:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.890996:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.891005:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028be7baf/0x66f5679bff031cbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.891418:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.891421:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.891422:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787368075.892313:0:18666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787368075.892391:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787368075.893146:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17187:x1874190808585344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9364us (13831us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787368075.893157:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787368075.893199:0:17187:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787368075.893206:0:17187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1874190808585344:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787368075.893221:0:17187:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00010000:3.0:1787368075.893490:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368075.893499:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.893513:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1787368075.893518:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368075.893524:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.893536:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.893546:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.893553:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.893567:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368075.893914:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368075.893923:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.893931:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368075.893936:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.893945:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.893960:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.893968:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000729d71b2/0x66f5679bff031cc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368075.893985:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.893987:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368075.893989:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787368075.894172:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368075.894179:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.894187:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1787368075.894191:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368075.894195:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.894218:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.894226:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.894232:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.894245:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787368075.895583:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368075.895711:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.895720:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.895743:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.895747:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.895757:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.895774:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.895782:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b21405d/0x66f5679bff031ccd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.895797:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.895799:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.895800:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368075.897290:0:18672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.897312:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1787368075.897316:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368075.897322:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.897335:0:18672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.897346:0:18672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.897388:0:18672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368075.897411:0:18672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368075.897520:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368075.897526:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.897538:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030c00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368075.897545:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.897554:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.897582:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.897592:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3dffe3c/0x66f5679bff031cd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368075.897615:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.897616:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368075.897618:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787368075.897685:0:18672:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1787368075.897779:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17189:x1874190808584704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89150us (91882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368075.897789:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787368075.898587:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1874190808584704:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787368075.898616:0:17189:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787368075.898662:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1874190808585472:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787368075.898702:0:17189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368075.898728:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586792900 going to sleep for 11 seconds 00000100:00100000:2.0:1787368075.898745:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808585472 00000100:00100000:2.0:1787368075.898750:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808585472 00000100:00100000:2.0:1787368075.898795:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787368075.898804:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17189:x1874190808585472:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787368075.898838:0:19223:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00080000:3.0:1787368075.900939:0:18671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787368075.900948:0:18671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787368075.901028:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17907:x1874190808585216:12345-0@lo:7:osp-pre-1-1.0 Request processed in 23208us (92574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368075.901039:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787368075.901191:0:17907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1874190808585216:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787368075.901205:0:17907:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787368075.901239:0:17907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1874190808585600:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787368075.901271:0:17907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368075.901305:0:17907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd4b0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787368075.901383:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808585600 00000100:00100000:2.0:1787368075.901389:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808585600 00000100:00100000:2.0:1787368075.901432:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787368075.901442:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17907:x1874190808585600:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787368075.901467:0:19618:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787368075.901508:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17907:x1874190808585600:12345-0@lo:5:osp-pre-1-1.0 Request processed in 68us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368075.901514:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787368075.901811:0:17907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1874190808585600:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787368075.901821:0:17907:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787368075.901846:0:17907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1874190808585728:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787368075.901881:0:17907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368075.901904:0:17907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd4b0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787368075.901919:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808585728 00000100:00100000:1.0:1787368075.901923:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808585728 00000100:00100000:1.0:1787368075.901951:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787368075.901958:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17907:x1874190808585728:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787368075.901983:0:18672:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000001:00080000:3.0:1787368075.912820:0:19486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1787368075.912864:0:19486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787368075.912881:0:19486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787368075.914419:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17189:x1874190808585472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15609us (15709us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787368075.914431:0:17189:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787368075.914432:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368075.914439:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1874190808585472:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787368075.914453:0:17189:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1787368075.928453:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17907:x1874190808585728:12345-0@lo:5:osp-pre-1-1.0 Request processed in 26488us (26564us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787368075.928467:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787368075.934373:0:17907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1874190808585728:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787368075.934394:0:17907:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787368075.935102:0:17907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17907:1874190808585856:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787368075.935166:0:17907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368075.935207:0:17907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787368075.935423:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808585856 00000100:00100000:3.0:1787368075.935430:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808585856 00000100:00100000:2.0:1787368075.935567:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787368075.935576:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1874190808585856:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787368075.935717:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1874190808585856:12345-0@lo:900:osp-pre-1-1.0 Request processed in 141us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368075.935725:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787368075.941742:0:17907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55be7f1500 x1874190808585856/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787368091 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368075.941762:0:17907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17907:1874190808585856:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787368076.185510:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368077.209393:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368078.232549:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368078.747149:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808585984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368078.747287:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368078.747381:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808585984 00000100:00100000:3.0:1787368078.747390:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808585984 00000100:00100000:3.0:1787368078.747445:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787368078.747455:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808585984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787368078.747497:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787368078.747615:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808585984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368078.747623:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787368078.747649:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368078.747976:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808585984:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787368079.258268:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368079.768798:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808586112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368079.768889:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368079.769004:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808586112 00000100:00100000:0.0:1787368079.769013:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808586112 00000100:00100000:0.0:1787368079.769064:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787368079.769074:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808586112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787368079.769107:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787368079.769155:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808586112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368079.769162:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787368079.769204:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808586112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368079.769718:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787368079.769730:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808586240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368079.769765:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368079.771974:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808586240 00000100:00100000:3.0:1787368079.771989:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808586240 00000100:00100000:3.0:1787368079.772060:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787368079.772072:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808586240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787368079.772109:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787368079.772195:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808586240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368079.772212:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787368079.772984:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808586240:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787368080.060661:0:19842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787368080.286908:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787368081.062915:0:19894:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787368081.063149:0:19894:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787368081.304694:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808586752:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.304769:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.304817:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808587264:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.304853:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.304880:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808587776:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.304904:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.304929:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787368081.304935:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808586368:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.304961:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.304980:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808586880:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305000:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.305015:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808587392:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305036:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787368081.305161:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368081.305178:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808586368 00000100:00100000:1.0:1787368081.305185:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808586368 00000100:00100000:1.0:1787368081.305232:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787368081.305241:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:3651:x1874190808586368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.305285:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:3651:x1874190808586368:12345-0@lo:400:kworker.0 Request processed in 46us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368081.305291:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787368081.305388:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808587904:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305413:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.305447:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808586368:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305470:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808586496:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305493:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.305508:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808587008:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305527:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.305540:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808587520:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305578:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.305590:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808588032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787368081.305610:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.305628:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787368081.305634:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808586624:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305654:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.305668:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808587136:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305687:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.305705:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808587648:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368081.305749:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808587776 00000100:00100000:0.0:1787368081.305753:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808587776 00000100:00100000:0.0:1787368081.305783:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808586880 00000100:00100000:0.0:1787368081.305786:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808586880 00000100:00100000:0.0:1787368081.305798:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808587392 00000100:00100000:0.0:1787368081.305800:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808587392 00000100:00100000:0.0:1787368081.305810:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808587904 00000100:00100000:0.0:1787368081.305812:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808587904 00000100:00100000:0.0:1787368081.305822:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808587520 00000100:00100000:0.0:1787368081.305824:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808587520 00000100:00100000:0.0:1787368081.305847:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808587648 00000100:00100000:0.0:1787368081.305850:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808587648 00000100:00100000:0.0:1787368081.305864:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787368081.305871:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808587776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305909:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808587776:12345-0@lo:400:kworker.0 Request processed in 38us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368081.305916:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787368081.305929:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787368081.305942:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808586880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.305969:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808586880:12345-0@lo:400:kworker.0 Request processed in 29us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368081.305976:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787368081.305987:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787368081.305992:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808587392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.306012:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808587392:12345-0@lo:400:kworker.0 Request processed in 21us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368081.306018:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787368081.306028:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787368081.306033:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808587904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.306298:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787368081.306308:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808587520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.306347:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808587520:12345-0@lo:400:kworker.0 Request processed in 41us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368081.306377:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787368081.306393:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787368081.306400:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808587648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.306429:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808587648:12345-0@lo:400:kworker.0 Request processed in 30us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368081.306435:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787368081.306455:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808586496 00000100:00100000:1.0:1787368081.306458:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808586496 00000100:00100000:1.0:1787368081.306482:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808587008 00000100:00100000:1.0:1787368081.306485:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808587008 00000100:00100000:1.0:1787368081.306500:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787368081.306507:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808586496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.306538:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808586496:12345-0@lo:400:kworker.0 Request processed in 32us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368081.306554:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787368081.306568:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787368081.306574:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808587008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.306604:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808587008:12345-0@lo:400:kworker.0 Request processed in 31us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368081.306610:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787368081.306647:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd626d80 x1874190808587648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368081.306660:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808587648:0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.306672:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808586496:0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.306682:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808587008:0@lo:400:kworker.0 00010000:00080000:1.0:1787368081.306691:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd625500 x1874190808587520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368081.306700:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808587520:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.307166:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808587904:12345-0@lo:400:kworker.0 Request processed in 1131us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368081.307174:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787368081.307201:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808586752 00000100:00100000:0.0:1787368081.307205:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808586752 00000100:00100000:0.0:1787368081.307239:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808587264 00000100:00100000:0.0:1787368081.307242:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808587264 00000100:00100000:0.0:1787368081.307254:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808586624 00000100:00100000:0.0:1787368081.307257:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808586624 00000100:00100000:0.0:1787368081.307268:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808587136 00000100:00100000:0.0:1787368081.307271:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808587136 00000100:00100000:0.0:1787368081.307283:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787368081.307289:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808586752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.307319:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808586752:12345-0@lo:400:kworker.0 Request processed in 31us (2552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368081.307325:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787368081.307344:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787368081.307350:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1874190808587264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.307400:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1874190808587264:12345-0@lo:400:kworker.0 Request processed in 51us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368081.307406:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787368081.307417:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787368081.307422:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808586624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.307450:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808586624:12345-0@lo:400:kworker.0 Request processed in 28us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368081.307456:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787368081.307465:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787368081.307471:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808587136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.307497:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808587136:12345-0@lo:400:kworker.0 Request processed in 26us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368081.307503:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787368081.307532:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd624700 x1874190808586880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368081.307544:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808586880:0@lo:400:kworker.0 00010000:00080000:0.0:1787368081.307556:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd626a00 x1874190808587392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368081.307564:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808587392:0@lo:400:kworker.0 00010000:00080000:0.0:1787368081.307574:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa74a80 x1874190808587904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368081.307583:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808587904:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.307603:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808586752:0@lo:400:kworker.0 00000100:00100000:0.0:1787368081.307615:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808587264:0@lo:400:kworker.0 00010000:00080000:0.0:1787368081.307626:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa76d80 x1874190808587776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368081.307633:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808587776:0@lo:400:kworker.0 00000100:00100000:3.0:1787368081.307773:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808588032 00000100:00100000:3.0:1787368081.307779:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808588032 00000100:00100000:3.0:1787368081.307822:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787368081.307839:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808588032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787368081.307862:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368081.307911:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808588032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368081.307918:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787368081.307935:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787368081.307948:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787368081.307951:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787368081.307954:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787368081.307999:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808588160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787368081.308039:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368081.308068:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808588160 00000100:00100000:3.0:1787368081.308072:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808588160 00000100:00100000:3.0:1787368081.308092:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787368081.308098:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808588160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787368081.308108:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368081.308136:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874190808588160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368081.308142:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787368081.308172:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808588160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787368081.308217:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808588288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787368081.308260:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368081.308312:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808588288 00000100:00100000:3.0:1787368081.308317:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808588288 00000100:00100000:3.0:1787368081.308346:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787368081.308352:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808588288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787368081.308381:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787368081.308414:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808588288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368081.308420:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787368081.308444:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808588288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787368081.309243:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808586624:0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.309258:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808587136:0@lo:400:kworker.0 00000100:00100000:1.0:1787368081.309277:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808588032:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787368081.824630:0:19486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:2.0:1787368082.137703:0:19944:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787368082.141066:0:19944:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787368082.329516:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368082.435643:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.437392:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788577664 00000100:00100000:0.0:1787368082.437406:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788577664 00000100:00100000:0.0:1787368082.437451:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:0.0:1787368082.437459:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1874190788577664:12345-192.168.203.4@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787368082.437487:0:17157:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from dcb621a7-65af-4d97-83fc-1ccec1c65d9c@192.168.203.4@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:0.0:1787368082.437526:0:17157:0:(genops.c:1385:class_connect()) connect: client dcb621a7-65af-4d97-83fc-1ccec1c65d9c, cookie 0x66f5679bff031cdb 00000100:00080000:0.0:1787368082.437953:0:17157:0:(import.c:65:import_set_state_nolock()) ffff9c548320c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368082.438027:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+5:2401:x1874190788577664:12345-192.168.203.4@tcp:250:mount.lustre.0 Request processed in 567us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.438035:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:0.0:1787368082.449956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368082.450085:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788577792 00000100:00100000:1.0:1787368082.450094:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788577792 00000100:00100000:1.0:1787368082.450150:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:1.0:1787368082.450169:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+5:14919:x1874190788577792:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787368082.450185:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368082.450201:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673600/0x66f5679bff031ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea93 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368082.450227:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673600/0x66f5679bff031ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea93 expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368082.450238:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673600/0x66f5679bff031ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea93 expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368082.450247:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673600, rc 0) 00000100:00100000:1.0:1787368082.450309:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+6:14919:x1874190788577792:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 142us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368082.450316:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:1.0:1787368082.451940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.452026:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788577920 00000100:00100000:0.0:1787368082.452034:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788577920 00000100:00100000:0.0:1787368082.452083:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:0.0:1787368082.452093:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+6:14919:x1874190788577920:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787368082.452203:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+6:14919:x1874190788577920:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 110us (270us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787368082.452223:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:3.0:1787368082.454046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368082.454149:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788578048 00000100:00100000:2.0:1787368082.454157:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788578048 00000100:00100000:2.0:1787368082.454214:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:2.0:1787368082.454236:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+6:14919:x1874190788578048:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787368082.454251:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368082.454268:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bd67f400/0x66f5679bff031ce9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ea9a expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368082.454919:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bd67f400/0x66f5679bff031ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea9a expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368082.455033:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bd67f400/0x66f5679bff031ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea9a expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368082.455042:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f400, rc 0) 00000100:00100000:0.0:1787368082.455204:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+7:14919:x1874190788578048:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 969us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.455212:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:2.0:1787368082.456988:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368082.457067:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788578176 00000100:00100000:1.0:1787368082.457075:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788578176 00000100:00100000:1.0:1787368082.457135:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:1.0:1787368082.457144:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+7:14919:x1874190788578176:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787368082.457290:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14919:x1874190788578176:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 138us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368082.457299:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:1.0:1787368082.459183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.459262:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788578304 00000100:00100000:0.0:1787368082.459271:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788578304 00000100:00100000:0.0:1787368082.459332:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:0.0:1787368082.459342:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14919:x1874190788578304:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787368082.459543:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14919:x1874190788578304:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 202us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.459552:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:3.0:1787368082.462501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.463035:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788578432 00000100:00100000:0.0:1787368082.463048:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788578432 00000100:00100000:0.0:1787368082.463181:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:0.0:1787368082.463194:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14938:x1874190788578432:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787368082.463412:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14938:x1874190788578432:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 219us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.463422:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:2.0:1787368082.487470:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368082.487604:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788578560 00000100:00100000:1.0:1787368082.487613:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788578560 00000100:00100000:1.0:1787368082.487675:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:1.0:1787368082.487699:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14938:x1874190788578560:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787368082.487875:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14938:x1874190788578560:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 176us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368082.487894:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:2.0:1787368082.505811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.507078:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788578688 00000100:00100000:0.0:1787368082.507088:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788578688 00000100:00100000:0.0:1787368082.507151:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:0.0:1787368082.507162:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14938:x1874190788578688:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787368082.507313:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14938:x1874190788578688:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 153us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.507331:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:3.0:1787368082.516693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.516794:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788578816 00000100:00100000:0.0:1787368082.516804:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788578816 00000100:00100000:0.0:1787368082.516874:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:0.0:1787368082.516893:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:14919:x1874190788578816:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787368082.516910:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368082.516926:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613ae00/0x66f5679bff031cf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eacb expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368082.516953:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613ae00/0x66f5679bff031cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eacb expref: 9 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368082.516963:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613ae00/0x66f5679bff031cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eacb expref: 9 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368082.516977:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613ae00, rc 0) 00000100:00100000:0.0:1787368082.517040:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+9:14919:x1874190788578816:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 156us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.517047:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:2.0:1787368082.520438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368082.520525:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788578944 00000100:00100000:1.0:1787368082.520535:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788578944 00000100:00100000:1.0:1787368082.520583:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:1.0:1787368082.520592:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+9:14919:x1874190788578944:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787368082.520616:0:17154:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787368082.520640:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787368082.520644:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787368082.520648:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787368082.520650:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787368082.520653:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787368082.527098:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+9:14919:x1874190788578944:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 6494us (6656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.527114:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:3.0:1787368082.534165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368082.534241:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788579072 00000100:00100000:2.0:1787368082.534250:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788579072 00000100:00100000:2.0:1787368082.534307:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:2.0:1787368082.534317:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+9:14919:x1874190788579072:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787368082.534332:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368082.534348:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ead2 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368082.541113:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ead2 expref: 10 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368082.541135:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ead2 expref: 10 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368082.541160:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f800, rc 0) 00000100:00100000:3.0:1787368082.541246:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:14919:x1874190788579072:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 6928us (7089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368082.541256:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:2.0:1787368082.544560:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.552171:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788579200 00000100:00100000:0.0:1787368082.552185:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788579200 00000100:00100000:0.0:1787368082.552248:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:0.0:1787368082.552259:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:14919:x1874190788579200:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787368082.552473:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be73b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:14919:x1874190788579200:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 215us (7920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.552481:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:1.0:1787368082.555607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368082.555676:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788579328 00000100:00100000:3.0:1787368082.555684:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788579328 00000100:00100000:3.0:1787368082.555732:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:3.0:1787368082.555742:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:14919:x1874190788579328:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787368082.555892:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:14919:x1874190788579328:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 150us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368082.555900:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:3.0:1787368082.559649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368082.559831:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788579456 00000100:00100000:1.0:1787368082.559842:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788579456 00000100:00100000:1.0:1787368082.559891:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:1.0:1787368082.559900:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:14942:x1874190788579456:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787368082.560049:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:14942:x1874190788579456:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 148us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368082.560057:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:2.0:1787368082.569856:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.570010:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788579584 00000100:00100000:0.0:1787368082.570021:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788579584 00000100:00100000:0.0:1787368082.570076:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:0.0:1787368082.570086:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:14942:x1874190788579584:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787368082.570250:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:14942:x1874190788579584:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 165us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.570260:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:2.0:1787368082.576619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368082.576712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368082.577073:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788579712 00000100:00100000:1.0:1787368082.577086:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788579712 00000100:00100000:1.0:1787368082.577137:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788579968 00000100:00100000:1.0:1787368082.577141:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788579968 00000100:00100000:1.0:1787368082.577169:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1787368082.577186:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874190788579712:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787368082.577216:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1787368082.577270:0:17164:0:(genops.c:1385:class_connect()) connect: client 2d5a7807-1963-49fe-bc72-734aca1edb48, cookie 0x66f5679bff031cfe 00000004:00100000:1.0:1787368082.577297:0:17164:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787368082.577549:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9c54824e3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368082.577617:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2401:x1874190788579712:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 431us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368082.577624:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1787368082.577643:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1787368082.577647:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874190788579968:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787368082.577663:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1787368082.577695:0:17164:0:(genops.c:1385:class_connect()) connect: client 2d5a7807-1963-49fe-bc72-734aca1edb48, cookie 0x66f5679bff031d05 00000004:00100000:1.0:1787368082.577706:0:17164:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787368082.577843:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9c54824e4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368082.577869:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2401:x1874190788579968:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 220us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368082.577876:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1787368082.583563:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368082.583606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.583894:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788580224 00000100:00100000:0.0:1787368082.583904:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788580224 00000100:00100000:0.0:1787368082.583981:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788579840 00000100:00100000:0.0:1787368082.583985:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788579840 00000100:00100000:0.0:1787368082.584009:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1787368082.584018:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+7:14919:x1874190788580224:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787368082.584054:0:18960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787368082.584131:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+7:14919:x1874190788580224:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 113us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.584138:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1787368082.584155:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1787368082.584161:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+6:0:x1874190788579840:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787368082.584170:0:18960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787368082.584189:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+6:0:x1874190788579840:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 28us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.584211:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00080000:3.0:1787368082.584272:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787368082.594920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368082.594960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368082.595116:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788580352 00000100:00100000:2.0:1787368082.595125:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788580352 00000100:00100000:2.0:1787368082.595180:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788580096 00000100:00100000:2.0:1787368082.595182:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788580096 00000100:00100000:2.0:1787368082.595226:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1787368082.595237:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:14919:x1874190788580352:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787368082.595320:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:14919:x1874190788580352:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 85us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368082.595328:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1787368082.595344:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:2.0:1787368082.595351:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:0:x1874190788580096:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787368082.595400:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787368082.595449:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:0:x1874190788580096:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 98us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368082.595455:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00080000:1.0:1787368082.597094:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787368082.604669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368082.604710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368082.604785:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368082.604863:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788580736 00000100:00100000:0.0:1787368082.604871:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788580736 00000100:00100000:0.0:1787368082.604933:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1787368082.604943:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:14919:x1874190788580736:12345-192.168.203.4@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787368082.605020:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:14919:x1874190788580736:12345-192.168.203.4@tcp:900:mount.lustre.0 Request processed in 79us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368082.605027:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1787368082.610548:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788580480 00000100:00100000:1.0:1787368082.610563:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788580480 00000100:00100000:3.0:1787368082.612114:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788580608 00000100:00100000:3.0:1787368082.612126:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788580608 00000100:00100000:3.0:1787368082.612172:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1787368082.612180:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874190788580608:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787368082.612214:0:18670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:3.0:1787368082.612242:0:18670:0:(genops.c:1385:class_connect()) connect: client 2d5a7807-1963-49fe-bc72-734aca1edb48, cookie 0x66f5679bff031d0c 00002000:00100000:3.0:1787368082.612253:0:18670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2d5a7807-1963-49fe-bc72-734aca1edb48/ffff9c548362b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787368082.612264:0:18670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787368082.614065:0:18670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787368082.614125:0:18670:0:(import.c:65:import_set_state_nolock()) ffff9c5483628000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787368082.614250:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2401:x1874190788580608:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 2068us (9463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368082.614259:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1787368082.616970:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1787368082.616983:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874190788580480:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787368082.617020:0:19223:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1787368082.617077:0:19223:0:(genops.c:1385:class_connect()) connect: client 2d5a7807-1963-49fe-bc72-734aca1edb48, cookie 0x66f5679bff031d13 00002000:00100000:1.0:1787368082.617089:0:19223:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2d5a7807-1963-49fe-bc72-734aca1edb48/ffff9c54824e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787368082.617100:0:19223:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787368082.617268:0:19223:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787368082.617302:0:19223:0:(import.c:65:import_set_state_nolock()) ffff9c54824e1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368082.617377:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2401:x1874190788580480:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 393us (12664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368082.617385:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1787368082.618859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368082.619048:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788580864 00000100:00100000:1.0:1787368082.619057:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788580864 00000100:00100000:1.0:1787368082.619200:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1787368082.619211:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:14919:x1874190788580864:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787368082.620867:0:17165:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1572us 00000004:00200000:2.0:1787368082.638214:0:17165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787368082.638481:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:14919:x1874190788580864:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 19265us (19748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368082.638496:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000040:00080000:0.0:1787368082.777074:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787368082.787451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368082.787554:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788580992 00000100:00100000:2.0:1787368082.787563:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788580992 00000100:00100000:2.0:1787368082.787635:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1787368082.787661:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:14966:x1874190788580992:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:2.0:1787368082.787684:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368082.787708:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031d1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb03 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368082.787773:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031d21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368082.787788:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368082.787816:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368082.787869:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787368082.787872:0:17163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368082.787915:0:17163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368082.787942:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031d1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb03 expref: 8 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368082.787961:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031d21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb03 expref: 7 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368082.787969:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1100) 00010000:00010000:2.0:1787368082.787972:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787368082.787975:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f200, rc 0) 00000100:00100000:2.0:1787368082.788058:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+7:14966:x1874190788580992:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 400us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368082.788100:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00010000:00010000:2.0:1787368083.352771:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368083.864657:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808588416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787368083.864726:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368083.864835:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808588416 00000100:00100000:3.0:1787368083.864844:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808588416 00000100:00100000:3.0:1787368083.864909:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368083.864922:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808588416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787368083.864951:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787368083.865063:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808588416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368083.865072:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787368083.865380:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787368083.865635:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808588416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787368084.377710:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368084.888835:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808588544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368084.888911:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368084.889036:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808588544 00000100:00100000:0.0:1787368084.889045:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808588544 00000100:00100000:0.0:1787368084.889106:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787368084.889116:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808588544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787368084.889160:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787368084.889206:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808588544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368084.889213:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787368084.889499:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808588544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787368084.890130:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808588672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368084.890181:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368084.890508:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808588672 00000100:00100000:2.0:1787368084.890515:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808588672 00000100:00100000:2.0:1787368084.890561:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787368084.890571:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808588672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368084.890596:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787368084.890653:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808588672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368084.890660:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787368084.890696:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808588672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368084.892551:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368084.892743:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788581120 00000100:00100000:0.0:1787368084.892751:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788581120 00000100:00100000:0.0:1787368084.892831:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1787368084.892841:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+7:15018:x1874190788581120:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:0.0:1787368084.892867:0:18960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787368084.892959:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+7:15018:x1874190788581120:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 113us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368084.892978:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00080000:1.0:1787368084.893157:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787368084.899749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368084.899896:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788581248 00000100:00100000:2.0:1787368084.899905:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788581248 00000100:00100000:2.0:1787368084.900037:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1787368084.900048:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:15018:x1874190788581248:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1787368084.900081:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787368084.900186:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:15018:x1874190788581248:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 139us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368084.900194:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00080000:1.0:1787368084.901380:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787368084.904334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368084.906419:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788581376 00000100:00100000:0.0:1787368084.906434:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788581376 00000100:00100000:0.0:1787368084.906532:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1787368084.906826:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d5a7807-1963-49fe-bc72-734aca1edb48+6:15018:x1874190788581376:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:0.0:1787368084.906851:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787368084.906945:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d5a7807-1963-49fe-bc72-734aca1edb48+6:15018:x1874190788581376:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 138us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368084.907416:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00080000:1.0:1787368084.907848:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787368084.913461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368084.914051:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788581504 00000100:00100000:3.0:1787368084.914061:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788581504 00000100:00100000:3.0:1787368084.914186:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1787368084.914197:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d5a7807-1963-49fe-bc72-734aca1edb48+6:15018:x1874190788581504:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:3.0:1787368084.914230:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368084.914314:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d5a7807-1963-49fe-bc72-734aca1edb48+6:15018:x1874190788581504:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 119us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368084.914322:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00080000:1.0:1787368084.919369:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787368085.094316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368085.095276:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788581632 00000100:00100000:0.0:1787368085.095288:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788581632 00000100:00100000:0.0:1787368085.095387:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:0.0:1787368085.095399:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:15048:x1874190788581632:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787368085.095415:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368085.095433:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613a600/0x66f5679bff031d28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb0a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368085.095461:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a600/0x66f5679bff031d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb0a expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368085.095473:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613a600/0x66f5679bff031d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb0a expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368085.095482:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a600, rc 0) 00000100:00100000:0.0:1787368085.095549:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15048:x1874190788581632:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 152us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.095567:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:0.0:1787368085.102522:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368085.105284:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788581760 00000100:00100000:1.0:1787368085.105298:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788581760 00000100:00100000:1.0:1787368085.105459:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:1.0:1787368085.105470:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15048:x1874190788581760:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787368085.105637:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15048:x1874190788581760:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 168us (3125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368085.105645:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:2.0:1787368085.110697:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368085.111121:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788581888 00000100:00100000:0.0:1787368085.111133:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788581888 00000100:00100000:0.0:1787368085.111298:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:0.0:1787368085.111309:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15048:x1874190788581888:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787368085.111479:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15048:x1874190788581888:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 171us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.111487:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:3.0:1787368085.120350:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368085.120599:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788582016 00000100:00100000:0.0:1787368085.120609:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788582016 00000100:00100000:0.0:1787368085.120669:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:0.0:1787368085.120679:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15056:x1874190788582016:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787368085.120833:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15056:x1874190788582016:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 154us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.120841:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:2.0:1787368085.157483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368085.157630:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788582144 00000100:00100000:3.0:1787368085.157640:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788582144 00000100:00100000:3.0:1787368085.157714:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:3.0:1787368085.157724:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15056:x1874190788582144:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787368085.157894:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15056:x1874190788582144:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 171us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368085.157902:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:2.0:1787368085.166085:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368085.166553:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788582272 00000100:00100000:1.0:1787368085.166563:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788582272 00000100:00100000:1.0:1787368085.166615:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:1.0:1787368085.166626:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15056:x1874190788582272:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787368085.166775:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15056:x1874190788582272:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 150us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368085.166783:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:1.0:1787368085.176220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368085.176387:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788582400 00000100:00100000:0.0:1787368085.176397:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788582400 00000100:00100000:0.0:1787368085.176455:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:0.0:1787368085.176466:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:15048:x1874190788582400:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787368085.176481:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368085.176498:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613aa00/0x66f5679bff031d2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb3b expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368085.176524:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613aa00/0x66f5679bff031d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb3b expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368085.176548:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613aa00/0x66f5679bff031d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb3b expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368085.176557:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613aa00, rc 0) 00000100:00100000:0.0:1787368085.176616:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:15048:x1874190788582400:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 152us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.176623:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:2.0:1787368085.181055:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368085.181165:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788582528 00000100:00100000:1.0:1787368085.181176:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788582528 00000100:00100000:1.0:1787368085.181234:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:1.0:1787368085.181245:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:15048:x1874190788582528:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787368085.181270:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787368085.181293:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787368085.181297:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787368085.181301:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787368085.181304:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787368085.181306:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1787368085.186164:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:15048:x1874190788582528:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 4909us (5106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368085.186179:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:3.0:1787368085.189790:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368085.190221:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788582656 00000100:00100000:1.0:1787368085.190231:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788582656 00000100:00100000:1.0:1787368085.190337:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:1.0:1787368085.190348:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:15048:x1874190788582656:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787368085.190382:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368085.190400:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb42 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368085.190427:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb42 expref: 13 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368085.190505:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb42 expref: 13 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368085.190515:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672a00, rc 0) 00000100:00100000:1.0:1787368085.190715:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:15048:x1874190788582656:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 368us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368085.190722:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:2.0:1787368085.195230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368085.195340:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788582784 00000100:00100000:1.0:1787368085.195351:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788582784 00000100:00100000:1.0:1787368085.195429:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:1.0:1787368085.195512:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:15048:x1874190788582784:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787368085.195664:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:15048:x1874190788582784:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 225us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368085.195673:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:2.0:1787368085.202473:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368085.203969:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788582912 00000100:00100000:1.0:1787368085.203983:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788582912 00000100:00100000:1.0:1787368085.204063:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:1.0:1787368085.204086:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:15048:x1874190788582912:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787368085.204226:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:15048:x1874190788582912:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 142us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368085.204234:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:3.0:1787368085.212696:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368085.212890:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788583040 00000100:00100000:0.0:1787368085.212900:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788583040 00000100:00100000:0.0:1787368085.212962:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:0.0:1787368085.212972:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:15059:x1874190788583040:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787368085.213135:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:15059:x1874190788583040:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 164us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.213144:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:2.0:1787368085.216453:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368085.216556:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788583168 00000100:00100000:0.0:1787368085.216566:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788583168 00000100:00100000:0.0:1787368085.216624:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:0.0:1787368085.216635:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:15059:x1874190788583168:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787368085.216778:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:15059:x1874190788583168:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 144us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.216786:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:2.0:1787368085.234536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368085.234710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368085.234802:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788583296 00000100:00100000:1.0:1787368085.234820:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788583296 00000100:00100000:1.0:1787368085.234866:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788583552 00000100:00100000:1.0:1787368085.234869:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788583552 00000100:00100000:1.0:1787368085.234898:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1787368085.234907:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874190788583296:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787368085.234937:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 90bfb389-29f4-40ca-b84c-07db457328e3@192.168.203.4@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1787368085.234981:0:17164:0:(genops.c:1385:class_connect()) connect: client 90bfb389-29f4-40ca-b84c-07db457328e3, cookie 0x66f5679bff031d3d 00000004:00100000:1.0:1787368085.235008:0:17164:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787368085.235116:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9c55acb25800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368085.235181:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+6:2401:x1874190788583296:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 273us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368085.235188:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1787368085.235207:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1787368085.235211:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874190788583552:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787368085.235229:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 90bfb389-29f4-40ca-b84c-07db457328e3@192.168.203.4@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1787368085.235269:0:17164:0:(genops.c:1385:class_connect()) connect: client 90bfb389-29f4-40ca-b84c-07db457328e3, cookie 0x66f5679bff031d44 00000004:00100000:1.0:1787368085.235282:0:17164:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787368085.235322:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9c55acb27000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368085.235348:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+6:2401:x1874190788583552:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 134us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368085.235396:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1787368085.258510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368085.258551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368085.258596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368085.258700:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788583424 00000100:00100000:0.0:1787368085.258711:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788583424 00000100:00100000:0.0:1787368085.258777:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788583680 00000100:00100000:0.0:1787368085.258781:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788583680 00000100:00100000:0.0:1787368085.258821:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788583808 00000100:00100000:0.0:1787368085.258825:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788583808 00000100:00100000:0.0:1787368085.258840:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1787368085.258849:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+7:0:x1874190788583424:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787368085.258880:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787368085.258943:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+7:0:x1874190788583424:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 94us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.258950:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1787368085.258968:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1787368085.258974:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:0:x1874190788583680:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787368085.258985:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787368085.259013:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:0:x1874190788583680:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 39us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.259018:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1787368085.259031:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1787368085.259037:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:15048:x1874190788583808:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787368085.259047:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787368085.259069:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:15048:x1874190788583808:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.259075:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00080000:3.0:1787368085.261998:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787368085.262007:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787368085.262190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368085.262477:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368085.262513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368085.262568:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788584192 00000100:00100000:3.0:1787368085.262576:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788584192 00000100:00100000:3.0:1787368085.262647:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1787368085.262658:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2404:x1874190788584192:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368085.262727:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2404:x1874190788584192:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368085.262734:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1787368085.271788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368085.271842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368085.271925:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788584320 00000100:00100000:3.0:1787368085.271935:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788584320 00000100:00100000:3.0:1787368085.271999:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1787368085.272009:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2404:x1874190788584320:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368085.272073:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2404:x1874190788584320:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368085.272081:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1787368085.277002:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788583936 00000100:00100000:0.0:1787368085.277018:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788583936 00000100:00100000:0.0:1787368085.277178:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788584064 00000100:00100000:0.0:1787368085.277183:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788584064 00000100:00100000:3.0:1787368085.277230:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:3.0:1787368085.277243:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2404:x1874190788583936:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368085.277339:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2404:x1874190788583936:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 99us (15153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368085.277347:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:3.0:1787368085.277389:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:3.0:1787368085.277396:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2404:x1874190788584064:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368085.277770:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2404:x1874190788584064:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 373us (15255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368085.277778:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1787368085.282030:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788584448 00000100:00100000:1.0:1787368085.282046:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788584448 00000100:00100000:1.0:1787368085.282107:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1787368085.282118:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+6:15048:x1874190788584448:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787368085.282208:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+6:15048:x1874190788584448:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 91us (10365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368085.282217:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:3.0:1787368085.286568:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368085.286610:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368085.286688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368085.286772:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788584832 00000100:00100000:0.0:1787368085.286780:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788584832 00000100:00100000:0.0:1787368085.286852:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:0.0:1787368085.286862:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:90bfb389-29f4-40ca-b84c-07db457328e3+6:15048:x1874190788584832:12345-192.168.203.4@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787368085.286956:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:90bfb389-29f4-40ca-b84c-07db457328e3+6:15048:x1874190788584832:12345-192.168.203.4@tcp:900:mount.lustre.0 Request processed in 94us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368085.286964:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1787368085.287133:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788584576 00000100:00100000:2.0:1787368085.287138:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788584576 00000100:00100000:2.0:1787368085.287163:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788584704 00000100:00100000:2.0:1787368085.287166:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788584704 00000100:00100000:2.0:1787368085.287187:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1787368085.287193:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1874190788584576:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787368085.287219:0:19618:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 90bfb389-29f4-40ca-b84c-07db457328e3@192.168.203.4@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1787368085.287257:0:19618:0:(genops.c:1385:class_connect()) connect: client 90bfb389-29f4-40ca-b84c-07db457328e3, cookie 0x66f5679bff031d4b 00002000:00100000:2.0:1787368085.287269:0:19618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 90bfb389-29f4-40ca-b84c-07db457328e3/ffff9c55acb15000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787368085.287278:0:19618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787368085.287386:0:19618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787368085.287413:0:19618:0:(import.c:65:import_set_state_nolock()) ffff9c55acb11000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787368085.287450:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90bfb389-29f4-40ca-b84c-07db457328e3+6:2401:x1874190788584576:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 256us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368085.287458:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1787368085.287471:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1787368085.287476:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1874190788584704:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787368085.287500:0:19618:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 90bfb389-29f4-40ca-b84c-07db457328e3@192.168.203.4@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1787368085.287517:0:19618:0:(genops.c:1385:class_connect()) connect: client 90bfb389-29f4-40ca-b84c-07db457328e3, cookie 0x66f5679bff031d52 00002000:00100000:2.0:1787368085.287521:0:19618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 90bfb389-29f4-40ca-b84c-07db457328e3/ffff9c55acb10000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787368085.287527:0:19618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787368085.287564:0:19618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787368085.287579:0:19618:0:(import.c:65:import_set_state_nolock()) ffff9c55acb12000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787368085.287603:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90bfb389-29f4-40ca-b84c-07db457328e3+6:2401:x1874190788584704:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 125us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368085.287609:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:3.0:1787368085.289441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368085.289567:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788584960 00000100:00100000:2.0:1787368085.289575:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788584960 00000100:00100000:2.0:1787368085.289667:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1787368085.289677:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:15048:x1874190788584960:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787368085.289753:0:17166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787368085.289844:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:15048:x1874190788584960:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 167us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368085.289852:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00010000:00010000:0.0:1787368085.401162:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368085.489680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368085.489764:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788585088 00000100:00100000:3.0:1787368085.489774:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788585088 00000100:00100000:3.0:1787368085.489886:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1787368085.489898:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+6:15082:x1874190788585088:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:3.0:1787368085.489922:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368085.489959:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031d59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb73 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368085.490025:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368085.490039:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368085.490065:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787368085.490125:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787368085.490130:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787368085.490152:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368085.490177:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031d59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb73 expref: 8 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368085.490196:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb73 expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368085.490206:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1100) 00010000:00010000:3.0:1787368085.490209:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787368085.490212:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031c00, rc 0) 00000100:00100000:3.0:1787368085.490285:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+7:15082:x1874190788585088:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 389us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368085.490293:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000040:00080000:0.0:1787368085.656977:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787368086.424704:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368086.424728:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808588800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787368086.424795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368086.424922:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808588800 00000100:00100000:3.0:1787368086.424931:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808588800 00000100:00100000:3.0:1787368086.425014:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787368086.425025:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808588800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787368086.425046:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368086.425105:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808588800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368086.425130:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787368086.425172:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787368086.425194:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808588800:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787368086.425589:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787368086.425600:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368086.425724:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808588928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787368086.425756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368086.425909:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808589056:0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.425951:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368086.425975:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808589568:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.426314:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808589312:0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.426852:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368086.426909:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808589568 00000100:00100000:2.0:1787368086.426916:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808589568 00000100:00100000:2.0:1787368086.426974:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787368086.427005:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808589568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368086.427082:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808588928 00000100:00100000:0.0:1787368086.427086:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808588928 00000100:00100000:0.0:1787368086.427122:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787368086.427129:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808588928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787368086.427147:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787368086.427270:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368086.427299:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808589824:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.427326:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368086.427343:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808590336:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.427671:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368086.427886:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787368086.427896:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808589440:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.427922:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368086.427945:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808589952:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.427965:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368086.427982:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808590464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787368086.428015:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368086.428045:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808590080:0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.428079:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368086.428098:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787368086.428105:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808589184:0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.428135:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368086.428137:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808589056 00000100:00100000:1.0:1787368086.428144:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808589056 00000100:00100000:3.0:1787368086.428157:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808589696:0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.428186:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368086.428198:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787368086.428209:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808590208:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.428219:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:3653:x1874190808589056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.428237:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368086.428272:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808589312 00000100:00100000:3.0:1787368086.428277:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808589312 00000100:00100000:1.0:1787368086.428278:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:3653:x1874190808589056:12345-0@lo:400:kworker.0 Request processed in 61us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368086.428288:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787368086.428316:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808589696 00000100:00100000:3.0:1787368086.428320:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808589696 00000100:00100000:1.0:1787368086.428323:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808589824 00000100:00100000:1.0:1787368086.428329:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808589824 00000100:00100000:3.0:1787368086.428349:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368086.428373:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808589312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.428422:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808589312:12345-0@lo:400:kworker.0 Request processed in 65us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368086.428428:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368086.428442:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368086.428448:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808589696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.428477:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808589696:12345-0@lo:400:kworker.0 Request processed in 29us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368086.428483:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368086.428501:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808589184 00000100:00100000:3.0:1787368086.428504:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808589184 00000100:00100000:3.0:1787368086.428521:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787368086.428527:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808589184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.428557:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808589184:12345-0@lo:400:kworker.0 Request processed in 30us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368086.428563:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787368086.428585:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787368086.428592:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:3.0:1787368086.428639:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787368086.428643:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787368086.429029:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808590336 00000100:00100000:1.0:1787368086.429035:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808590336 00000100:00100000:1.0:1787368086.429055:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808589440 00000100:00100000:1.0:1787368086.429058:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808589440 00000100:00100000:1.0:1787368086.429070:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808589952 00000100:00100000:1.0:1787368086.429073:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808589952 00000100:00100000:1.0:1787368086.429085:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808590080 00000100:00100000:1.0:1787368086.429087:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808590080 00000100:00100000:1.0:1787368086.429098:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808590208 00000100:00100000:1.0:1787368086.429101:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808590208 00000100:00100000:1.0:1787368086.429114:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787368086.429120:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808589824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.429271:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808589824:12345-0@lo:400:kworker.0 Request processed in 149us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368086.429279:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787368086.429293:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787368086.429299:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808590336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.429327:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808590336:12345-0@lo:400:kworker.0 Request processed in 29us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368086.429333:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787368086.429343:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787368086.429629:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808589440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.429669:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808589440:12345-0@lo:400:kworker.0 Request processed in 43us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368086.429676:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787368086.429687:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787368086.429859:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808589952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.429893:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808589952:12345-0@lo:400:kworker.0 Request processed in 200us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368086.429899:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787368086.429916:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787368086.429920:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787368086.429924:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808590080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787368086.429926:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787368086.429958:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808590080:12345-0@lo:400:kworker.0 Request processed in 37us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368086.429964:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787368086.429975:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787368086.429981:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808590208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.430072:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808590208:12345-0@lo:400:kworker.0 Request processed in 91us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368086.430079:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787368086.430267:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808589440:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.430282:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808589952:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.430300:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808589312:0@lo:400:kworker.0 00000100:00100000:3.0:1787368086.430304:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808590464 00000100:00100000:3.0:1787368086.430310:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808590464 00000100:00100000:1.0:1787368086.430316:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808589824:0@lo:400:kworker.0 00000100:00100000:2.0:1787368086.430331:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808589568:12345-0@lo:400:kworker.0 Request processed in 3334us (3476us total) trans 0 rc 0/0 00010000:00080000:1.0:1787368086.430337:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc693480 x1874190808590336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368086.430343:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787368086.430433:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368086.430441:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808590464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787368086.430457:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368086.430492:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808590464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368086.430506:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787368086.430621:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808590336:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.430653:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808590464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787368086.430675:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808589184:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.430685:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808589696:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.430877:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808590208:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.430891:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808589056:0@lo:400:kworker.0 00000100:00100000:1.0:1787368086.430900:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808589568:0@lo:400:kworker.0 00010000:00080000:1.0:1787368086.430912:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bc692300 x1874190808590080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368086.430920:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808590080:0@lo:400:kworker.0 00000100:00100000:0.0:1787368086.440656:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808588928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13518us (14888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368086.440672:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787368086.445492:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808588928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787368087.448888:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787368088.314409:0:20043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1787368088.476745:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 90bfb389-29f4-40ca-b84c-07db457328e3 00000001:00100000:3.0:1787368088.476759:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2d5a7807-1963-49fe-bc72-734aca1edb48 00000001:00100000:2.0:1787368088.476875:0:19486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 90bfb389-29f4-40ca-b84c-07db457328e3 00000001:00100000:2.0:1787368088.476882:0:19486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d5a7807-1963-49fe-bc72-734aca1edb48 00010000:00010000:0.0:1787368088.478843:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787368088.482763:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 90bfb389-29f4-40ca-b84c-07db457328e3 00000001:00100000:0.0:1787368088.482774:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2d5a7807-1963-49fe-bc72-734aca1edb48 00000001:00100000:2.0:1787368088.482963:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 90bfb389-29f4-40ca-b84c-07db457328e3 00000001:00100000:2.0:1787368088.482969:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2d5a7807-1963-49fe-bc72-734aca1edb48 00000100:00100000:2.0:1787368088.993642:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808590592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368088.993715:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368088.993815:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808590592 00000100:00100000:0.0:1787368088.993823:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808590592 00000100:00100000:0.0:1787368088.993893:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787368088.993903:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808590592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787368088.993931:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787368088.993978:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808590592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368088.993985:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787368088.994040:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808590592:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787368088.994175:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787368089.496629:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368090.009054:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368090.009076:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808590720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368090.009141:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368090.009240:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808590720 00000100:00100000:3.0:1787368090.009247:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808590720 00000100:00100000:3.0:1787368090.009300:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787368090.009309:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808590720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787368090.009341:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787368090.009408:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808590720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368090.009415:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787368090.009455:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808590720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368090.009716:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808590848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787368090.009744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368090.009801:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808590848 00000100:00100000:3.0:1787368090.009805:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808590848 00000100:00100000:3.0:1787368090.009828:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787368090.009835:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808590848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787368090.009852:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787368090.009885:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808590848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368090.009891:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787368090.009918:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808590848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787368090.421010:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368090.421057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368090.421084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368090.421103:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368090.421127:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368090.421153:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788585728 00000100:00100000:3.0:1787368090.421162:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788585728 00000100:00100000:1.0:1787368090.421216:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788585472 00000100:00100000:1.0:1787368090.421222:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788585472 00000100:00100000:1.0:1787368090.421287:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788585984 00000100:00100000:1.0:1787368090.421291:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788585984 00000100:00100000:3.0:1787368090.421310:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788586240 00000100:00100000:3.0:1787368090.421315:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788586240 00000100:00100000:1.0:1787368090.421324:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1787368090.421335:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788585472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368090.421346:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1787368090.421374:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788585728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368090.421433:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788585472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 99us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368090.421442:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1787368090.421455:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788585728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368090.421463:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:3.0:1787368090.421467:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:1.0:1787368090.421475:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788585984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368090.421485:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1787368090.421494:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788586240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368090.421524:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788585984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368090.421531:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788586240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368090.421537:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:3.0:1787368090.421544:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00080000:1.0:1787368090.421560:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787368090.421566:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787368090.421781:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788585216 00000100:00100000:0.0:1787368090.421786:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788585216 00000100:00100000:0.0:1787368090.421819:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:0.0:1787368090.421827:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2404:x1874190788585216:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368090.421852:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2404:x1874190788585216:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368090.421858:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:1.0:1787368090.425217:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368090.425281:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368090.425305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368090.425326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368090.425353:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788585600 00000100:00100000:1.0:1787368090.425375:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788585600 00000100:00100000:1.0:1787368090.425422:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788586112 00000100:00100000:1.0:1787368090.425426:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788586112 00000100:00100000:1.0:1787368090.425451:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1787368090.425460:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788585600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368090.425518:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788585600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 59us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368090.425526:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1787368090.425541:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1787368090.425547:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788586112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368090.425570:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788586112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368090.425577:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1787368090.425594:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788585344 00000100:00100000:1.0:1787368090.425598:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788585344 00000100:00100000:1.0:1787368090.425622:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788585856 00000100:00100000:1.0:1787368090.425633:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788585856 00000100:00100000:1.0:1787368090.425758:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:1.0:1787368090.425779:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2404:x1874190788585344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368090.425809:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2404:x1874190788585344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368090.425816:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:1.0:1787368090.425829:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:1.0:1787368090.425835:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+6:2404:x1874190788585856:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368090.425858:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+6:2404:x1874190788585856:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368090.425865:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00080000:1.0:1787368090.425880:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787368090.425885:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787368090.520864:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787368091.277867:0:20190:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3a6e4fa0 20000000:00000080:1.0:1787368091.277882:0:20190:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c55acb2b800 uarg=0000000000000000 20000000:01000000:1.0:1787368091.277921:0:20190:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787368091.277927:0:20190:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787368091.277931:0:20190:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787368091.278416:0:20191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1787368091.278563:0:20190:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787368091.289276:0:20190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787368091.289306:0:20190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289324:0:20190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0319f5 expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289331:0:20190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a03 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289393:0:20190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031a42 expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289400:0:20190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031adc expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289410:0:20190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ead2 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289418:0:20190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb42 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289426:0:20190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289469:0:20190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb42 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289485:0:20190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb42 expref: 12 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.289500:0:20190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ceea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808590976:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368091.289599:0:20190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ead2 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289608:0:20190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ead2 expref: 12 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.289618:0:20190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591104:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368091.289657:0:20190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff031adc expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.289665:0:20190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff031adc expref: 23 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.289674:0:20190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591232:0@lo:104: 00000100:00100000:1.0:1787368091.289711:0:20190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787368091.289741:0:20190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff031a42 expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368091.289958:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808591232 00000100:00100000:0.0:1787368091.289966:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808591232 00000100:00100000:0.0:1787368091.290069:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787368091.290078:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+3:20190:x1874190808591232:12345-0@lo:104: 00010000:00010000:0.0:1787368091.290090:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.290137:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787368091.290143:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+3:20190:x1874190808591232:12345-0@lo:104: Request processed in 67us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368091.290165:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787368091.290190:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368091.290195:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.290203:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fa00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368091.290207:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.290215:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368091.290229:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368091.290234:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787368091.290260:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.290267:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787368091.290285:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.290293:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff031adc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031ae3 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.290308:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368091.290309:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368091.290311:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368091.290424:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808591488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368091.290452:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368091.290491:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808591488 00000100:00100000:0.0:1787368091.290495:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808591488 00010000:00010000:0.0:1787368091.290513:0:18318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031adc expref: 24 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368091.290533:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787368091.290539:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808591488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787368091.290549:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368091.290554:0:18318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031adc expref: 24 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.292064:0:20190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff031a42 expref: 23 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.292089:0:20190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591360:0@lo:104: 00000100:00100000:1.0:1787368091.292138:0:20190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787368091.292603:0:18318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff031adc expref: 24 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.292628:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368091.292671:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808591488:12345-0@lo:103:ldlm_bl.0 Request processed in 2132us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368091.292680:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787368091.292713:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808591360 00000100:00100000:0.0:1787368091.292718:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808591360 00000100:00100000:0.0:1787368091.292781:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787368091.292791:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+3:20190:x1874190808591360:12345-0@lo:104: 00010000:00010000:0.0:1787368091.292804:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.292844:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787368091.292849:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3ce871c-8318-4c29-9238-0157d9966155+3:20190:x1874190808591360:12345-0@lo:104: Request processed in 61us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368091.292855:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787368091.292924:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368091.292930:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.292937:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74e00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368091.292941:0:18696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.292948:0:18696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368091.292969:0:18696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.293074:0:20190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff031a03 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.293085:0:20190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff031a03 expref: 23 pid: 17154 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.293096:0:20190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591616:0@lo:104: 00000100:00100000:1.0:1787368091.293127:0:20190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787368091.293151:0:20190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0319f5 expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.293159:0:20190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0319f5 expref: 23 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.293178:0:20190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591744:0@lo:104: 00000100:00100000:1.0:1787368091.293200:0:20190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368091.293213:0:20190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5484513d80 going to sleep for 11 seconds 00010000:00010000:1.0:1787368091.293232:0:20190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241ca00/0x66f5679bff031ae3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff031adc expref: 23 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.293243:0:20190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591232:0@lo:104: 00000100:00100000:1.0:1787368091.293250:0:20190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591360:0@lo:104: 00000100:00100000:2.0:1787368091.293570:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808591488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368091.293864:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808591616 00000100:00100000:1.0:1787368091.293870:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808591616 00000100:00100000:1.0:1787368091.293893:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808591744 00000100:00100000:1.0:1787368091.293896:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808591744 00000100:00100000:3.0:1787368091.294523:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368091.294545:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368091.294591:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787368091.294605:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+4:20190:x1874190808591616:12345-0@lo:104: 00010000:00010000:1.0:1787368091.294619:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368091.294719:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788586368 00000100:00100000:2.0:1787368091.294723:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788586368 00010000:00010000:2.0:1787368091.294744:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb42 expref: 13 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368091.294784:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788586496 00000100:00100000:2.0:1787368091.294787:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788586496 00010000:00010000:2.0:1787368091.294798:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ead2 expref: 14 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368091.294839:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1787368091.294846:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+14:2402:x1874190788586368:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368091.294857:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368091.294862:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb42 expref: 14 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.294872:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb42 expref: 14 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.294889:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368091.294935:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+14:2402:x1874190788586368:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 89us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.294942:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1787368091.294958:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1787368091.294965:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2402:x1874190788586496:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368091.294972:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368091.295043:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ead2 expref: 13 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.295052:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ead2 expref: 13 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.295062:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368091.295082:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2402:x1874190788586496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 118us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.295088:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00010000:00010000:1.0:1787368091.295699:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787368091.295708:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+4:20190:x1874190808591616:12345-0@lo:104: Request processed in 1106us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368091.295716:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787368091.295735:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787368091.295743:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:20190:x1874190808591744:12345-0@lo:104: 00010000:00010000:1.0:1787368091.295771:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.295817:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787368091.295830:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3ce871c-8318-4c29-9238-0157d9966155+3:20190:x1874190808591744:12345-0@lo:104: Request processed in 89us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368091.295836:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787368091.295876:0:20190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672a00/0x66f5679bff031d36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb42 expref: 12 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.295889:0:20190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ceea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808590976:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368091.295901:0:20190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bd67f800/0x66f5679bff031cf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ead2 expref: 11 pid: 17157 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.295920:0:20190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591104:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368091.295932:0:20190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591616:0@lo:104: 00000100:00100000:1.0:1787368091.295940:0:20190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20190:1874190808591744:0@lo:104: 00010000:00010000:1.0:1787368091.295969:0:20190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296154:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368091.296160:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296168:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368091.296171:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296179:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368091.296186:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368091.296192:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787368091.296224:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296231:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787368091.296251:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296258:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ea00/0x66f5679bff031a03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031a0a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296268:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368091.296272:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296277:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368091.296279:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296293:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368091.296299:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368091.296303:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787368091.296318:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296323:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787368091.296329:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296334:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e75600/0x66f5679bff0319f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0319fc expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.296342:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368091.296343:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368091.296344:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368091.297143:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368091.297325:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808591872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368091.297461:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.297510:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368091.297517:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808592000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368091.297541:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787368091.297895:0:18696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787368091.297935:0:18696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.297944:0:18696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787368091.298086:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.298096:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e74e00/0x66f5679bff031a42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff031a49 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.298119:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368091.298121:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368091.298124:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368091.298138:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808592128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368091.298170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368091.301194:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808591872 00000100:00100000:1.0:1787368091.301212:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808591872 00000100:00100000:3.0:1787368091.301265:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808592000 00000100:00100000:3.0:1787368091.301269:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808592000 00010000:00010000:3.0:1787368091.301303:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0319f5 expref: 24 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368091.301378:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808592128 00000100:00100000:3.0:1787368091.301382:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808592128 00010000:00010000:3.0:1787368091.301396:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031a42 expref: 25 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368091.301412:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787368091.301420:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483d47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+25:3653:x1874190808592000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368091.301434:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368091.301440:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0319f5 expref: 25 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368091.301451:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0319f5 expref: 25 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368091.301469:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613a000/0x66f5679bff0319fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0319f5 expref: 25 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368091.301483:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368091.301532:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787368091.301547:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483d47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+24:3653:x1874190808592000:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (4002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368091.301547:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3ce871c-8318-4c29-9238-0157d9966155+24:3651:x1874190808592128:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368091.301563:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787368091.301563:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368091.301573:0:18318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031a42 expref: 24 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.301585:0:18318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff031a42 expref: 23 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.301608:0:18318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75a00/0x66f5679bff031a49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff031a42 expref: 23 pid: 17155 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368091.301619:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368091.301677:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808592000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368091.301759:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031a03 expref: 22 pid: 17154 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368091.301801:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787368091.301807:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b3ce871c-8318-4c29-9238-0157d9966155+22:3651:x1874190808592128:12345-0@lo:103:ldlm_bl.0 Request processed in 265us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368091.301819:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787368091.301822:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3ce871c-8318-4c29-9238-0157d9966155+22:3653:x1874190808591872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368091.301833:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368091.301838:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff031a03 expref: 21 pid: 17154 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.301847:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff031a03 expref: 21 pid: 17154 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.301857:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241ce00/0x66f5679bff031a0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff031a03 expref: 21 pid: 17154 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.301868:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.301876:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.301891:0:17149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.301898:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.301905:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368091.302057:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808592128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368091.302126:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.302132:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368091.302136:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.302150:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.302265:0:20190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368091.302274:0:20190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.302848:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.302859:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672400/0x66f5679bff031d67 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368091.302878:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368091.303055:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3ce871c-8318-4c29-9238-0157d9966155+20:3653:x1874190808591872:12345-0@lo:103:ldlm_bl.0 Request processed in 1237us (5592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.303064:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787368091.304031:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808591872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368091.544600:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808592256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787368091.544670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.544738:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808592256 00000100:00100000:2.0:1787368091.544744:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808592256 00000100:00100000:2.0:1787368091.544808:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787368091.544817:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808592256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787368091.544844:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787368091.544897:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808592256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.544904:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787368091.544953:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808592256:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787368091.545555:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787368091.545950:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808592640:0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.545994:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368091.546021:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808593152:0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546044:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368091.546062:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808593664:0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546082:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368091.546101:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787368091.546106:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808592768:0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546141:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368091.546158:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808593280:0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546177:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368091.546202:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808592640 00000100:00100000:1.0:1787368091.546207:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808592640 00000100:00100000:1.0:1787368091.546235:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808593152 00000100:00100000:1.0:1787368091.546237:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808593152 00000100:00100000:1.0:1787368091.546246:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808593664 00000100:00100000:1.0:1787368091.546248:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808593664 00000100:00100000:1.0:1787368091.546263:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808593280 00000100:00100000:1.0:1787368091.546266:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808593280 00000100:00100000:1.0:1787368091.546277:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787368091.546285:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808592640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546325:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808592640:12345-0@lo:400:kworker.0 Request processed in 40us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368091.546332:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787368091.546346:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787368091.546384:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808593152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546429:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808593152:12345-0@lo:400:kworker.0 Request processed in 76us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368091.546436:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787368091.546449:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787368091.546455:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808593664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546479:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808593664:12345-0@lo:400:kworker.0 Request processed in 25us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368091.546485:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787368091.546494:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787368091.546500:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808593280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546524:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808593280:12345-0@lo:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368091.546529:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787368091.546553:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808592768 00000100:00100000:1.0:1787368091.546556:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808592768 00000100:00100000:1.0:1787368091.546580:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787368091.546587:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808592768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546618:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808592768:12345-0@lo:400:kworker.0 Request processed in 32us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368091.546625:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787368091.546655:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787368091.546657:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787368091.546682:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808592768:0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546692:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808593280:0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546701:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808592640:0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.546720:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808593152:0@lo:400:kworker.0 00010000:00080000:1.0:1787368091.546731:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4f800 x1874190808593664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368091.546742:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808593664:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.546844:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808592384:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.546874:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.546912:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808592896:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.546937:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.546956:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808593408:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.546975:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.546994:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787368091.546999:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808592512:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547018:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.547033:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808593024:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547052:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.547067:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808593536:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547090:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.547117:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808592896 00000100:00100000:2.0:1787368091.547122:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808592896 00000100:00100000:2.0:1787368091.547153:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808592512 00000100:00100000:2.0:1787368091.547156:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808592512 00000100:00100000:2.0:1787368091.547169:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808593024 00000100:00100000:2.0:1787368091.547171:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808593024 00000100:00100000:2.0:1787368091.547182:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787368091.547187:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808592896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547218:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808592896:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.547223:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787368091.547234:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787368091.547239:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808592512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547259:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808592512:12345-0@lo:400:kworker.0 Request processed in 21us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.547264:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787368091.547281:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787368091.547285:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808593024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547309:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808593024:12345-0@lo:400:kworker.0 Request processed in 23us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.547314:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787368091.547330:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787368091.547333:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368091.547347:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808592512:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547372:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808593024:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547382:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808592896:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547400:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808593408 00000100:00100000:2.0:1787368091.547403:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808593408 00000100:00100000:2.0:1787368091.547425:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808593536 00000100:00100000:2.0:1787368091.547427:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808593536 00000100:00100000:2.0:1787368091.547442:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787368091.547448:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808593408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547478:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808593408:12345-0@lo:400:kworker.0 Request processed in 30us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.547483:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787368091.547494:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787368091.547499:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808593536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.547522:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808593536:12345-0@lo:400:kworker.0 Request processed in 23us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.547526:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787368091.547538:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787368091.547540:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787368091.547561:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808593536:0@lo:400:kworker.0 00010000:00080000:2.0:1787368091.547571:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483c4e300 x1874190808593408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368091.547578:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808593408:0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.547655:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808592384 00000100:00100000:1.0:1787368091.547660:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808592384 00000100:00100000:1.0:1787368091.547690:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787368091.547697:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808592384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368091.547737:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808592384:12345-0@lo:400:kworker.0 Request processed in 41us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368091.547743:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787368091.547794:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808592384:0@lo:400:kworker.0 00000100:00100000:2.0:1787368091.550058:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808593792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787368091.550123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.550178:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808593792 00000100:00100000:2.0:1787368091.550185:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808593792 00000100:00100000:2.0:1787368091.550232:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787368091.550245:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808593792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787368091.550267:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368091.550272:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787368091.550287:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808593920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787368091.550318:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808593792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.550329:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787368091.550331:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368091.550350:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808593920 00000100:00100000:2.0:1787368091.550375:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808593920 00000100:00100000:2.0:1787368091.550398:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787368091.550406:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808593920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787368091.550424:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787368091.550453:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808593920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368091.550458:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787368091.550494:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808593792:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787368091.551013:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368091.554056:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808593920:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1787368092.505441:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787368092.505465:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5483083000 from 13 10000000:01000000:2.0:1787368092.505471:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787368092.505516:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.505541:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.505553:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368092.507188:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787368092.507270:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368092.507334:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368092.508955:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808594048 00000100:00100000:1.0:1787368092.508967:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808594048 00000100:00100000:1.0:1787368092.509030:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787368092.509040:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+20:17159:x1874190808594048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368092.509058:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368092.509079:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673c00/0x66f5679bff031d75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031d6e expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.509106:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673c00/0x66f5679bff031d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031d6e expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.509118:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673c00/0x66f5679bff031d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031d6e expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.509152:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673c00, rc 0) 00000100:00100000:1.0:1787368092.509220:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:17159:x1874190808594048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368092.509227:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787368092.510267:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368092.510291:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368092.510301:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368092.510416:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368092.510471:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368092.510503:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368092.510888:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808594176 00000100:00100000:1.0:1787368092.510895:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808594176 00000100:00100000:1.0:1787368092.510945:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787368092.510954:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+21:17159:x1874190808594176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787368092.511084:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+21:17159:x1874190808594176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368092.511092:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787368092.511131:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787368092.511163:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787368092.511209:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368092.511229:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5583641600 going to sleep for 11 seconds 00000100:00100000:1.0:1787368092.511242:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808594304 00000100:00100000:1.0:1787368092.511245:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808594304 00000100:00100000:1.0:1787368092.511271:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787368092.511280:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:17159:x1874190808594304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787368092.511385:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:17159:x1874190808594304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368092.511394:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787368092.511411:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787368092.518111:0:20257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787368092.518236:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787368092.518264:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787368092.518276:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368092.518288:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368092.518298:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787368092.518301:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55bd40d800 from 13 10000000:01000000:0.0:1787368092.518304:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787368092.518339:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368092.518349:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368092.518380:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368092.518406:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787368092.518614:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368092.518845:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368092.519942:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808594432 00000100:00100000:2.0:1787368092.519953:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808594432 00000100:00100000:2.0:1787368092.520007:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787368092.520017:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+21:17159:x1874190808594432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368092.520031:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368092.520058:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bd67e600/0x66f5679bff031d83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031d7c expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.520085:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bd67e600/0x66f5679bff031d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031d7c expref: 22 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.520097:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bd67e600/0x66f5679bff031d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031d7c expref: 22 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.520105:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e600, rc 0) 00000100:00100000:2.0:1787368092.520171:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+22:17159:x1874190808594432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368092.520179:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787368092.520200:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368092.520220:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368092.520230:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368092.520294:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368092.520324:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368092.520505:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368092.520816:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808594560 00000100:00100000:2.0:1787368092.520822:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808594560 00000100:00100000:2.0:1787368092.520847:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787368092.520854:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+22:17159:x1874190808594560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368092.520976:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+22:17159:x1874190808594560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368092.520984:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787368092.521124:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368092.521221:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787368092.521269:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368092.521295:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368092.521331:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808594688 00000100:00100000:2.0:1787368092.521336:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808594688 00000100:00100000:2.0:1787368092.521379:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787368092.521387:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+22:17159:x1874190808594688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787368092.521486:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+22:17159:x1874190808594688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368092.521503:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787368092.523879:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787368092.525633:0:20258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787368092.528950:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787368092.528990:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787368092.529002:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.529015:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368092.529027:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787368092.529030:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55a0f12000 from 13 10000000:01000000:2.0:1787368092.529034:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787368092.529073:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.529082:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.529101:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368092.529127:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787368092.529198:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368092.529269:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368092.529275:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808594816 00000100:00100000:3.0:1787368092.529284:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808594816 00000100:00100000:3.0:1787368092.529340:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787368092.529350:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+22:17159:x1874190808594816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368092.529381:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368092.529395:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5580030000/0x66f5679bff031d91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031d8a expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368092.529418:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5580030000/0x66f5679bff031d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031d8a expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368092.529429:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5580030000/0x66f5679bff031d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031d8a expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368092.529438:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580030000, rc 0) 00000100:00100000:3.0:1787368092.529492:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808594816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368092.529499:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787368092.529821:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368092.529839:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.529849:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368092.529912:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368092.529939:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368092.529970:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368092.530150:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808594944 00000100:00100000:3.0:1787368092.530155:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808594944 00000100:00100000:3.0:1787368092.530191:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787368092.530200:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808594944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368092.530320:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808594944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368092.530328:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787368092.530350:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808594944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368092.530540:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808595072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787368092.530577:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368092.530606:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368092.530980:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808595072 00000100:00100000:3.0:1787368092.530986:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808595072 00000100:00100000:3.0:1787368092.531018:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787368092.531025:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808595072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368092.531110:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808595072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368092.531118:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787368092.531208:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808595072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787368092.532200:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787368092.533282:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787368092.533309:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787368092.533319:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368092.533340:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368092.533350:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787368092.533387:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5483e3e800 from 13 10000000:01000000:0.0:1787368092.533391:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787368092.533423:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368092.533430:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368092.533440:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368092.533459:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808595200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787368092.533510:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368092.533545:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368092.533635:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808595200 00000100:00100000:2.0:1787368092.533642:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808595200 00000100:00100000:2.0:1787368092.533682:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787368092.533690:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+23:17159:x1874190808595200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368092.533701:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368092.533712:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bd67fc00/0x66f5679bff031d9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff031d98 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.533830:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bd67fc00/0x66f5679bff031d9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff031d98 expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.533848:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bd67fc00/0x66f5679bff031d9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff031d98 expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.533855:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fc00, rc 0) 00000100:00100000:2.0:1787368092.533981:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:17159:x1874190808595200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 292us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368092.533988:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787368092.539147:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808595200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368092.539177:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368092.539190:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368092.539284:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808595328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368092.539345:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368092.539618:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368092.539667:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808595328 00000100:00100000:2.0:1787368092.539673:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808595328 00000100:00100000:2.0:1787368092.539729:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787368092.539738:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:17159:x1874190808595328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368092.539944:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:17159:x1874190808595328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368092.539952:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787368092.545153:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808595328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787368092.545227:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808595456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787368092.545304:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368092.545350:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582bdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787368092.545491:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808595456 00000100:00100000:3.0:1787368092.545496:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808595456 00000100:00100000:3.0:1787368092.545552:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787368092.545563:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:17159:x1874190808595456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368092.545667:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:17159:x1874190808595456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368092.545675:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787368092.545721:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3ce871c-8318-4c29-9238-0157d9966155:17159:1874190808595456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787368092.552968:0:20262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787368092.556781:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787368092.556819:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787368092.556830:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.556843:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368092.569799:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368092.734991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368092.736890:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788586624 00000100:00100000:1.0:1787368092.736904:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788586624 00000100:00100000:1.0:1787368092.736978:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:1.0:1787368092.736989:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:14933:x1874190788586624:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368092.737006:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368092.737023:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673e00/0x66f5679bff031da6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb7a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.737051:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673e00/0x66f5679bff031da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb7a expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.737061:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673e00/0x66f5679bff031da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb7a expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.737069:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673e00, rc 0) 00000100:00100000:1.0:1787368092.737131:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:14933:x1874190788586624:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 145us (2150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368092.737138:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:0.0:1787368092.742057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368092.742135:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788586752 00000100:00100000:2.0:1787368092.742144:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788586752 00000100:00100000:2.0:1787368092.742231:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:2.0:1787368092.742242:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:14933:x1874190788586752:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368092.742414:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:14933:x1874190788586752:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 173us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368092.742422:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 158 00000100:00100000:3.0:1787368092.746564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368092.749459:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788586880 00000100:00100000:1.0:1787368092.749472:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788586880 00000100:00100000:1.0:1787368092.749579:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:1.0:1787368092.749591:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:14933:x1874190788586880:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787368092.749721:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:14933:x1874190788586880:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 132us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368092.749729:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:0.0:1787368092.756338:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368092.756451:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788587008 00000100:00100000:1.0:1787368092.756461:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788587008 00000100:00100000:1.0:1787368092.756508:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:1.0:1787368092.756518:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:14933:x1874190788587008:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368092.756533:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368092.756550:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581672400/0x66f5679bff031dad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb81 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.756577:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581672400/0x66f5679bff031dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb81 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.756589:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581672400/0x66f5679bff031dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb81 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368092.756599:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672400, rc 0) 00000100:00100000:1.0:1787368092.756658:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:14933:x1874190788587008:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 142us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368092.756666:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:0.0:1787368092.763106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368092.763209:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788587136 00000100:00100000:1.0:1787368092.763219:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788587136 00000100:00100000:1.0:1787368092.763321:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:1.0:1787368092.763332:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:14933:x1874190788587136:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787368092.763505:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:14933:x1874190788587136:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 174us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368092.763513:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:3.0:1787368092.765506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368092.767861:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788587264 00000100:00100000:0.0:1787368092.767875:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788587264 00000100:00100000:0.0:1787368092.767939:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:0.0:1787368092.767950:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:14933:x1874190788587264:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787368092.768195:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:14933:x1874190788587264:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 245us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368092.768203:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000040:00080000:2.0:1787368093.017066:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787368093.595799:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368094.104627:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808595584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368094.104721:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368094.106518:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808595584 00000100:00100000:3.0:1787368094.106533:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808595584 00000100:00100000:3.0:1787368094.106628:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787368094.106640:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808595584:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787368094.106661:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787368094.106675:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787368094.106767:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808595584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.106775:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787368094.106812:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808595584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368094.325390:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368094.325908:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788587392 00000100:00100000:1.0:1787368094.325918:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788587392 00000100:00100000:1.0:1787368094.325982:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1787368094.325993:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:15599:x1874190788587392:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787368094.326015:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368094.326038:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031db4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb88 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.326114:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.326129:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.326143:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.326157:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.326163:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.326169:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787368094.327586:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787368094.327809:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff031dc9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.327826:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff031dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.327836:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff031dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368094.327878:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787368094.327882:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787368094.327920:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff031dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.327931:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.327937:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.327943:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.327949:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368094.327953:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.327960:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.327972:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1100) 00010000:00010000:1.0:1787368094.327985:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368094.327991:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.327997:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328013:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328019:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328026:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328030:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368094.328033:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328039:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328047:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c5582a23c00) 00010000:00010000:1.0:1787368094.328049:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368094.328052:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328057:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328094:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031db4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb88 expref: 8 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328118:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff031dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb88 expref: 7 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.328125:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c5582a23900) 00010000:00010000:1.0:1787368094.328127:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787368094.328130:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672a00, rc 0) 00000100:00100000:1.0:1787368094.328322:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+7:15599:x1874190788587392:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 2329us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368094.328331:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1787368094.337447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.337571:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788587520 00000100:00100000:3.0:1787368094.337581:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788587520 00000100:00100000:3.0:1787368094.337648:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1787368094.337659:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2d5a7807-1963-49fe-bc72-734aca1edb48+7:15599:x1874190788587520:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787368094.338513:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2d5a7807-1963-49fe-bc72-734aca1edb48+7:15599:x1874190788587520:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 Request processed in 853us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.338523:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1787368094.341208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368094.342249:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788587776 00000100:00100000:1.0:1787368094.342261:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788587776 00000100:00100000:1.0:1787368094.342646:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1787368094.342657:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+7:15599:x1874190788587776:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787368094.342677:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368094.342698:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031dd0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb8f expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.342789:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.342804:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.342814:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.343774:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.343804:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.343814:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344137:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673800/0x66f5679bff031de5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344147:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673800/0x66f5679bff031de5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344154:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673800/0x66f5679bff031de5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368094.344165:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787368094.344347:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344374:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344382:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344388:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368094.344392:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344400:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344423:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c5582a23900) 00010000:00010000:1.0:1787368094.344427:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368094.344431:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344437:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031dd7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344452:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344458:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344464:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344469:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368094.344472:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344478:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344497:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c5582a23c00) 00010000:00010000:1.0:1787368094.344500:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368094.344503:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.344509:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031dde lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.352187:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031dd0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb8f expref: 10 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.352218:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673800/0x66f5679bff031de5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb8f expref: 9 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.352227:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c5582a23b00) 00010000:00010000:1.0:1787368094.352229:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368094.352233:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673800, rc 0) 00000100:00100000:1.0:1787368094.352314:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+9:15599:x1874190788587776:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 9659us (11116us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787368094.352324:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1787368094.372562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.372663:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788587904 00000100:00100000:3.0:1787368094.372672:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788587904 00000100:00100000:3.0:1787368094.372732:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1787368094.372755:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+9:15599:x1874190788587904:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787368094.372861:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+9:15599:x1874190788587904:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 120us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.372869:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1787368094.378857:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368094.379692:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788588032 00000100:00100000:1.0:1787368094.379704:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788588032 00000100:00100000:1.0:1787368094.379929:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1787368094.379942:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:15599:x1874190788588032:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787368094.380009:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787368094.383070:0:17163:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3076us 00000100:00100000:3.0:1787368094.403461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.403497:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788588160 00000100:00100000:3.0:1787368094.403518:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788588160 00000100:00100000:3.0:1787368094.403569:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:3.0:1787368094.403580:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+9:15604:x1874190788588160:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1787368094.403600:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368094.403619:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031df3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb96 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.403680:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.403695:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.403706:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.403721:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.403728:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.403735:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.403785:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.403792:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.403799:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405071:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368094.405078:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405087:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405103:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1100) 00010000:00010000:3.0:1787368094.405106:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368094.405111:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405118:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031dfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405659:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405667:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405673:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405678:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580031a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368094.405682:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405688:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405711:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c5590ea9800) 00010000:00010000:3.0:1787368094.405714:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368094.405718:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405724:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405784:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031df3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb96 expref: 10 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.405795:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1100) 00010000:00010000:3.0:1787368094.405798:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368094.406480:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031df3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb96 expref: 10 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.406496:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580030600, rc 0) 00000100:00100000:3.0:1787368094.406569:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+9:15604:x1874190788588160:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2990us (3116us total) trans 0 rc 301/301 00000100:00100000:3.0:1787368094.406578:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:3.0:1787368094.413113:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:15599:x1874190788588032:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 33152us (34247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.413128:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:2.0:1787368094.430220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.430725:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788588288 00000100:00100000:3.0:1787368094.430736:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788588288 00000100:00100000:3.0:1787368094.430802:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1787368094.430812:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2d5a7807-1963-49fe-bc72-734aca1edb48+9:15604:x1874190788588288:12345-192.168.203.4@tcp:700:lfs.0 00000100:00100000:3.0:1787368094.430923:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2d5a7807-1963-49fe-bc72-734aca1edb48+9:15604:x1874190788588288:12345-192.168.203.4@tcp:700:lfs.0 Request processed in 112us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.430931:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1787368094.432780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.433597:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788588544 00000100:00100000:3.0:1787368094.433606:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788588544 00000100:00100000:3.0:1787368094.433664:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:3.0:1787368094.433675:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+9:15604:x1874190788588544:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1787368094.433725:0:18960:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368094.433761:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031d21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb03 expref: 9 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.433778:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1100) 00010000:00010000:3.0:1787368094.433783:0:18960:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787368094.433853:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.433866:0:18960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb73 expref: 5 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.433874:0:18960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.433915:0:18960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb73 expref: 5 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.433928:0:18960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb73 expref: 5 pid: 17164 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368094.433957:0:18960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808595712:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368094.434038:0:18960:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787368094.441079:0:18960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808595712:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368094.441110:0:18960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368094.442877:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368094.443026:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788588672 00000100:00100000:0.0:1787368094.443035:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788588672 00010000:00010000:0.0:1787368094.443094:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb73 expref: 6 pid: 17164 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368094.443140:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1787368094.443149:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90bfb389-29f4-40ca-b84c-07db457328e3+6:2403:x1874190788588672:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787368094.443165:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368094.443173:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb73 expref: 6 pid: 17164 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.443186:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb73 expref: 6 pid: 17164 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.443231:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031d60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb73 expref: 6 pid: 17164 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.443250:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1100) 00010000:00010000:0.0:1787368094.443255:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.443265:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.443273:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.443299:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368094.443382:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90bfb389-29f4-40ca-b84c-07db457328e3+5:2403:x1874190788588672:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 206us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368094.443391:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00080000:2.0:1787368094.443718:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787368094.444431:0:18960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.444442:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.444467:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.444477:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.444487:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450024:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450047:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450059:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787368094.450088:0:18960:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0be0d1d reply state 000000003d2fbd8e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450100:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450108:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368094.450111:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787368094.450115:0:18960:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787368094.450121:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787368094.450129:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450136:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450142:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450148:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368094.450152:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450160:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450169:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1100) 00010000:00010000:3.0:1787368094.450171:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368094.450174:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450191:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787368094.450211:0:18960:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0be0d1d reply state 000000003d2fbd8e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450219:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.450224:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c5590ea9800) 00010000:00010000:3.0:1787368094.450227:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787368094.450228:0:18960:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787368094.450324:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+10:15604:x1874190788588544:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 16646us (17547us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787368094.450333:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1787368094.529750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.530040:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788588800 00000100:00100000:3.0:1787368094.530050:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788588800 00000100:00100000:3.0:1787368094.530114:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:3.0:1787368094.530128:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+10:15613:x1874190788588800:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:3.0:1787368094.530152:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368094.530175:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eb9d expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.530236:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff031e24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.530249:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff031e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.530279:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff031e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787368094.530323:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787368094.530328:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368094.530660:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff031e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.530687:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb9d expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.530706:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff031e24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb9d expref: 11 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.530714:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:2.0:1787368094.530716:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787368094.530720:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031400, rc 0) 00000100:00100000:2.0:1787368094.530985:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+11:15613:x1874190788588800:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 861us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368094.530994:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1787368094.573873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368094.577487:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788588928 00000100:00100000:2.0:1787368094.577517:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788588928 00000100:00100000:2.0:1787368094.577589:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1787368094.577600:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+5:15614:x1874190788588928:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368094.577620:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368094.577641:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff031e2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eba4 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.579596:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff031e32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.579617:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff031e32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.579628:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff031e32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368094.579670:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787368094.579673:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368094.579692:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff031e32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.579717:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff031e2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eba4 expref: 7 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.579756:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff031e32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eba4 expref: 6 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.579771:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:2.0:1787368094.579774:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787368094.579778:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fe00, rc 0) 00000100:00100000:2.0:1787368094.579939:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+6:15614:x1874190788588928:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2339us (6074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368094.579952:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1787368094.584919:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368094.585875:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788589056 00000100:00100000:2.0:1787368094.585885:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788589056 00000100:00100000:2.0:1787368094.585963:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1787368094.586381:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+6:15614:x1874190788589056:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368094.586401:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368094.586423:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebab expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.586483:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.586498:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.586509:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.586519:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.586527:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.586533:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.586966:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.586984:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.586992:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787368094.587025:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787368094.587028:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787368094.587046:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587057:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587064:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587071:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587077:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368094.587081:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587105:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587117:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:3.0:1787368094.587119:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368094.587124:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587130:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031e40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587144:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587150:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587156:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587161:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ec00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368094.587164:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587169:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587176:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c5590ea9800) 00010000:00010000:3.0:1787368094.587178:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368094.587180:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587204:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031e47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587231:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebab expref: 8 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587244:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebab expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.587251:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368094.587254:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787368094.587256:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580030600, rc 0) 00000100:00100000:3.0:1787368094.587324:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+7:15614:x1874190788589056:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1352us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.587332:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:0.0:1787368094.592436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.592514:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788589184 00000100:00100000:3.0:1787368094.592524:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788589184 00000100:00100000:3.0:1787368094.592599:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1787368094.592609:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:90bfb389-29f4-40ca-b84c-07db457328e3+5:15614:x1874190788589184:12345-192.168.203.4@tcp:900:lfs.0 00000100:00100000:3.0:1787368094.592689:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:90bfb389-29f4-40ca-b84c-07db457328e3+5:15614:x1874190788589184:12345-192.168.203.4@tcp:900:lfs.0 Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.592696:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00080000:2.0:1787368094.593008:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787368094.600070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368094.600191:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788589440 00000100:00100000:1.0:1787368094.600200:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788589440 00000100:00100000:1.0:1787368094.600295:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1787368094.600304:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+7:15614:x1874190788589440:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787368094.600323:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368094.600384:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031e55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebb2 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368094.600500:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787368094.600587:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031e55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebb2 expref: 9 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.600603:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:1.0:1787368094.600606:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787368094.600610:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031e55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebb2 expref: 9 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.600624:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673000, rc 0) 00000100:00100000:1.0:1787368094.600667:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+8:15614:x1874190788589440:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 364us (606us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787368094.600674:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1787368094.604932:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.604993:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788589696 00000100:00100000:3.0:1787368094.605003:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788589696 00000100:00100000:3.0:1787368094.605066:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:3.0:1787368094.605077:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+8:15614:x1874190788589696:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1787368094.605144:0:17163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368094.605169:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031e4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebab expref: 8 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.605189:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368094.605194:0:17163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787368094.605214:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.605227:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.605236:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787368094.605491:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099f83319 reply state 00000000eaa54306 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.605504:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.605511:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368094.605513:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787368094.605516:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787368094.605523:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787368094.605609:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+9:15614:x1874190788589696:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 533us (687us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787368094.605617:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1787368094.614090:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368094.614267:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788589952 00000100:00100000:2.0:1787368094.614289:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788589952 00000100:00100000:2.0:1787368094.614520:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1787368094.614535:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90bfb389-29f4-40ca-b84c-07db457328e3+9:15614:x1874190788589952:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787368094.615316:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90bfb389-29f4-40ca-b84c-07db457328e3+10:15614:x1874190788589952:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 781us (1231us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787368094.615335:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00010000:00010000:2.0:1787368094.617304:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368094.623078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368094.623140:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788590208 00000100:00100000:2.0:1787368094.623150:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788590208 00000100:00100000:2.0:1787368094.623220:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1787368094.623230:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+10:15614:x1874190788590208:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368094.623253:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368094.623274:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff031e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebb9 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623541:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623556:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623567:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623578:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623594:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623622:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368094.623729:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787368094.623821:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623829:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623836:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623842:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368094.623847:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623855:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623868:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:2.0:1787368094.623872:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368094.623877:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623894:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031e71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623912:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623928:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623934:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623944:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368094.623947:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623954:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623964:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c5590ea9800) 00010000:00010000:2.0:1787368094.623966:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368094.623969:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.623979:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff031e78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.624017:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff031e6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebb9 expref: 12 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.624027:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:2.0:1787368094.624030:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787368094.624034:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff031e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebb9 expref: 12 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.624055:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f800, rc 0) 00000100:00100000:2.0:1787368094.624515:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+11:15614:x1874190788590208:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1285us (1443us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787368094.624525:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1787368094.630848:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368094.631455:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788590336 00000100:00100000:0.0:1787368094.631466:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788590336 00000100:00100000:0.0:1787368094.631760:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1787368094.631776:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+11:15614:x1874190788590336:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368094.631821:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368094.631845:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031e86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebc0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.631974:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.631990:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.632002:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368094.632031:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787368094.632035:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787368094.632057:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.632092:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031e86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc0 expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.632112:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc0 expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.632122:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368094.632125:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787368094.632129:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a400, rc 0) 00000100:00100000:0.0:1787368094.632210:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+12:15614:x1874190788590336:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 439us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368094.638282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.638457:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788590464 00000100:00100000:3.0:1787368094.638470:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788590464 00000100:00100000:3.0:1787368094.638552:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1787368094.638564:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90bfb389-29f4-40ca-b84c-07db457328e3+13:15614:x1874190788590464:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:0.0:1787368094.640468:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:3.0:1787368094.651750:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90bfb389-29f4-40ca-b84c-07db457328e3+12:15614:x1874190788590464:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 13169us (13461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.651763:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1787368094.667506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.667979:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788590720 00000100:00100000:3.0:1787368094.667991:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788590720 00000100:00100000:3.0:1787368094.668053:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1787368094.668076:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd757050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90bfb389-29f4-40ca-b84c-07db457328e3+12:15614:x1874190788590720:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787368094.669493:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd757050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90bfb389-29f4-40ca-b84c-07db457328e3+13:15614:x1874190788590720:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 1418us (1989us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787368094.669504:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1787368094.729430:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368094.730148:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788590848 00000100:00100000:1.0:1787368094.730162:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788590848 00000100:00100000:1.0:1787368094.730231:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1787368094.730242:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+11:15620:x1874190788590848:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1787368094.730264:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368094.730284:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebc7 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.730349:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.730411:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.730424:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.730438:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.730445:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.730452:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.730532:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031ea9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.735400:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.735419:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368094.735642:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787368094.735647:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787368094.735695:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735709:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735715:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735722:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735727:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368094.735730:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735737:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735761:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:0.0:1787368094.735764:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368094.735768:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735774:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031e9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735789:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735804:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735824:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735829:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368094.735832:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735838:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735846:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c5590ea9800) 00010000:00010000:0.0:1787368094.735848:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368094.735851:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735857:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ea2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735904:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc7 expref: 13 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735927:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc7 expref: 12 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.735936:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368094.735939:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787368094.735941:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673000, rc 0) 00000100:00100000:0.0:1787368094.736015:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+12:15620:x1874190788590848:12345-192.168.203.4@tcp:101:bash.0 Request processed in 5774us (6593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368094.736033:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1787368094.741162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.741306:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788590976 00000100:00100000:3.0:1787368094.741317:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788590976 00000100:00100000:3.0:1787368094.741410:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1787368094.741422:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:15620:x1874190788590976:12345-192.168.203.4@tcp:900:bash.0 00000100:00100000:3.0:1787368094.741507:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:15620:x1874190788590976:12345-192.168.203.4@tcp:900:bash.0 Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.741514:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1787368094.745850:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.746084:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788591232 00000100:00100000:3.0:1787368094.746095:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788591232 00000100:00100000:3.0:1787368094.746160:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:3.0:1787368094.746171:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+12:15620:x1874190788591232:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787368094.746193:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368094.746347:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031eb0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebce expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.746553:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.746583:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc0 expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.746594:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.746630:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc0 expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.746644:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc0 expref: 12 pid: 17164 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368094.746657:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808595840:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368094.746764:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5583641600 going to sleep for 11 seconds 00000100:00100000:3.0:1787368094.751766:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808595840:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368094.751794:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368094.754325:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.754715:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788591360 00000100:00100000:3.0:1787368094.754724:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788591360 00010000:00010000:3.0:1787368094.754777:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc0 expref: 13 pid: 17164 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368094.754882:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1787368094.754901:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90bfb389-29f4-40ca-b84c-07db457328e3+13:2405:x1874190788591360:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368094.754917:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368094.754937:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc0 expref: 13 pid: 17164 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.754950:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc0 expref: 13 pid: 17164 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.755186:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031e8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc0 expref: 13 pid: 17164 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.755272:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368094.755278:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.755289:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.755297:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.755333:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368094.755603:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90bfb389-29f4-40ca-b84c-07db457328e3+12:2405:x1874190788591360:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 702us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.755612:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00010000:00010000:1.0:1787368094.755924:0:17163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.755933:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.755963:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.755986:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.755995:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.756973:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.756990:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.756998:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368094.757008:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787368094.757037:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757044:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757051:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757057:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368094.757061:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757532:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757548:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:1.0:1787368094.757551:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368094.757555:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757562:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031eb7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787368094.757676:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df5e0fa0 reply state 000000003045bdec transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757690:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757697:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5582a23c00) 00010000:00010000:1.0:1787368094.757699:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787368094.757703:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787368094.757757:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031eb0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebce expref: 15 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757773:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebce expref: 14 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368094.757780:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368094.757782:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787368094.757784:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672200, rc 0) 00000100:00100000:1.0:1787368094.759767:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+15:15620:x1874190788591232:12345-192.168.203.4@tcp:101:bash.0 Request processed in 13587us (13917us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787368094.759781:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:1.0:1787368094.778784:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368094.778902:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788591488 00000100:00100000:2.0:1787368094.778916:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788591488 00000100:00100000:2.0:1787368094.778995:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1787368094.779006:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+15:15620:x1874190788591488:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787368094.779040:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368094.779066:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031ed3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebd5 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.779180:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.779197:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.779211:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368094.779280:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787368094.779292:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368094.779321:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.779333:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.779491:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031ed3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebd5 expref: 17 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.779520:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebd5 expref: 16 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368094.779529:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:2.0:1787368094.779532:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787368094.779536:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fa00, rc 0) 00000100:00100000:2.0:1787368094.779689:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+16:15620:x1874190788591488:12345-192.168.203.4@tcp:101:bash.0 Request processed in 685us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368094.779697:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1787368094.786204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368094.786316:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788591744 00000100:00100000:1.0:1787368094.786328:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788591744 00000100:00100000:1.0:1787368094.786431:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1787368094.786444:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+16:15620:x1874190788591744:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:1.0:1787368094.786763:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+17:15620:x1874190788591744:12345-192.168.203.4@tcp:35:bash.0 Request processed in 322us (570us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787368094.786773:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1787368094.837186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368094.837697:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788592000 00000100:00100000:0.0:1787368094.837707:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788592000 00000100:00100000:0.0:1787368094.837950:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1787368094.837961:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+17:15630:x1874190788592000:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368094.837985:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368094.838004:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031ee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebdc expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368094.838098:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787368094.838210:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031ee1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebdc expref: 19 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.838224:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:0.0:1787368094.838227:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787368094.838232:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031ee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebdc expref: 19 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.838246:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b400, rc 0) 00000100:00100000:0.0:1787368094.838309:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+18:15630:x1874190788592000:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 350us (1132us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787368094.838316:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1787368094.840593:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368094.841024:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788592256 00000100:00100000:2.0:1787368094.841038:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788592256 00000100:00100000:2.0:1787368094.842328:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1787368094.842340:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+18:15630:x1874190788592256:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787368094.842573:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15630:x1874190788592256:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 234us (2000us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787368094.842591:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000040:00080000:0.0:1787368094.873872:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787368094.879580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368094.881032:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788592512 00000100:00100000:0.0:1787368094.881048:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788592512 00000100:00100000:0.0:1787368094.881180:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:0.0:1787368094.881203:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15633:x1874190788592512:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368094.881232:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368094.881254:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031eef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebe3 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.881396:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031ef6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.881412:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031ef6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.881424:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031ef6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368094.881447:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787368094.881557:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031eef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebe3 expref: 22 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.881577:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031ef6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebe3 expref: 21 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368094.881586:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368094.881589:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787368094.881593:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613b600, rc 0) 00000100:00100000:0.0:1787368094.881714:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15633:x1874190788592512:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 513us (2143us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787368094.881723:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1787368094.893067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368094.893173:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788592640 00000100:00100000:3.0:1787368094.893182:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788592640 00000100:00100000:3.0:1787368094.893240:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:3.0:1787368094.893249:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15633:x1874190788592640:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1787368094.893328:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.893375:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.893386:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.893424:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.893430:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.893436:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.893441:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368094.893445:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.893452:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.893463:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:3.0:1787368094.893466:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787368094.893470:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368094.893475:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368094.893551:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15633:x1874190788592640:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 303us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368094.893563:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000040:00080000:2.0:1787368095.065938:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787368095.128716:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808596096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368095.128728:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808595968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368095.129021:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368095.129151:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808596096 00000100:00100000:2.0:1787368095.129160:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808596096 00000100:00100000:2.0:1787368095.129265:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787368095.129277:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808596096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368095.129316:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787368095.129440:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808596096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368095.129448:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787368095.129484:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368095.129506:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808595968 00000100:00100000:3.0:1787368095.129511:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808595968 00000100:00100000:3.0:1787368095.129547:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787368095.129557:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808595968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787368095.129576:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787368095.129623:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808595968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368095.129629:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787368095.129706:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808596096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368095.130252:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808595968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368095.225724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368095.226898:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788592896 00000100:00100000:2.0:1787368095.226909:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788592896 00000100:00100000:2.0:1787368095.226978:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:2.0:1787368095.226989:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15670:x1874190788592896:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1787368095.227010:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368095.227232:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031f0b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebea expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.230369:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.230394:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebce expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.230404:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebd5 expref: 22 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.230413:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.230471:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebd5 expref: 22 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.230491:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebd5 expref: 22 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368095.230506:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585102300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808596224:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787368095.230628:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebce expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.230638:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebce expref: 22 pid: 17163 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368095.231101:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5585103800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808596352:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787368095.231132:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551780 going to sleep for 11 seconds 00000100:00100000:2.0:1787368095.240088:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585102300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808596224:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787368095.240105:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5585103800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808596352:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787368095.240133:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368095.241177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368095.241253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368095.241322:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788593152 00000100:00100000:0.0:1787368095.241331:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788593152 00010000:00010000:0.0:1787368095.241395:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebce expref: 23 pid: 17163 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368095.241400:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788593024 00000100:00100000:2.0:1787368095.241407:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788593024 00010000:00010000:2.0:1787368095.241430:0:18318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebd5 expref: 24 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368095.241452:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1787368095.241469:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1787368095.241474:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+24:2402:x1874190788593152:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787368095.241497:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368095.241505:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebce expref: 24 pid: 17163 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.241517:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebce expref: 24 pid: 17163 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.241537:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031ec5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebce expref: 24 pid: 17163 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.241609:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368095.241615:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.241627:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368095.241629:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+23:2404:x1874190788593024:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368095.241642:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368095.241829:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368095.241884:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+23:2402:x1874190788593152:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 422us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368095.241902:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00010000:00010000:2.0:1787368095.241996:0:18318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebd5 expref: 22 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.242009:0:18318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebd5 expref: 22 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.242024:0:18318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff031eda lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebd5 expref: 22 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.242037:0:18318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:2.0:1787368095.242040:0:18318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.242047:0:18318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.242055:0:18318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.242157:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787368095.242164:0:17162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.242174:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368095.242183:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+21:2404:x1874190788593024:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 556us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368095.242190:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000004:00200000:0.0:1787368095.242194:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787368095.242334:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff031f0b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebea expref: 22 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.242352:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebea expref: 21 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.242592:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368095.242595:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787368095.242598:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67ea00, rc 0) 00000100:00100000:0.0:1787368095.242624:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15670:x1874190788592896:12345-192.168.203.4@tcp:101:dd.0 Request processed in 15637us (16909us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787368095.242631:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:3.0:1787368095.253662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368095.253916:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788593280 00000100:00100000:1.0:1787368095.253927:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788593280 00000100:00100000:1.0:1787368095.255207:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:1.0:1787368095.255226:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15670:x1874190788593280:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1787368095.255253:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368095.255275:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031f20 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebf1 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.255334:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.255349:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.255386:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.255488:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031f20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf1 expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.255505:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf1 expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.255514:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368095.255517:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787368095.255521:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673200, rc 0) 00000100:00100000:1.0:1787368095.255572:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+22:15670:x1874190788593280:12345-192.168.203.4@tcp:101:dd.0 Request processed in 350us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368095.255579:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1787368095.259324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368095.260009:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788593536 00000100:00100000:0.0:1787368095.260019:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788593536 00000100:00100000:0.0:1787368095.260123:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:0.0:1787368095.260134:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+22:15670:x1874190788593536:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1787368095.260336:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.260386:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.260414:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787368095.260460:0:18960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:0.0:1787368095.260483:0:18960:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000238f033c reply state 000000001ef1c7e6 transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.260496:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.260502:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368095.260505:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787368095.260508:0:18960:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787368095.260598:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+25:15670:x1874190788593536:12345-192.168.203.4@tcp:36:dd.0 Request processed in 466us (1283us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787368095.260606:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000020:00080000:0.0:1787368095.260611:0:18960:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787368095.502780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368095.512533:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788593664 00000100:00100000:1.0:1787368095.512547:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788593664 00000100:00100000:1.0:1787368095.512677:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1787368095.512689:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+25:15685:x1874190788593664:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:1.0:1787368095.512712:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368095.512732:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031f35 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebf8 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.512830:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.512845:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.512865:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.512877:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.512892:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.512899:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.512975:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.512986:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebea expref: 26 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.512994:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.513028:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebea expref: 26 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.513053:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebea expref: 26 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368095.513068:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808596480:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368095.513159:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787368095.519247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368095.519399:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808596480:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787368095.519638:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788593920 00000100:00100000:0.0:1787368095.519659:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788593920 00000100:00100000:0.0:1787368095.519784:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1787368095.519814:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+27:14931:x1874190788593920:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787368095.520216:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+28:14931:x1874190788593920:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 422us (977us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787368095.520225:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00010000:00010000:1.0:1787368095.520393:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368095.526760:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368095.526838:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788594048 00000100:00100000:2.0:1787368095.526848:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788594048 00010000:00010000:2.0:1787368095.526888:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebea expref: 28 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368095.526945:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1787368095.527014:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+28:2402:x1874190788594048:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368095.527029:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368095.527035:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebea expref: 28 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.527048:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebea expref: 28 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.527069:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff031f12 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebea expref: 28 pid: 17162 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.527086:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:2.0:1787368095.527091:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.527099:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.527107:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368095.527143:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368095.527203:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+27:2402:x1874190788594048:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 192us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368095.527212:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00010000:00010000:3.0:1787368095.527252:0:17163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527261:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787368095.527312:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787368095.527316:0:17163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787368095.527380:0:17163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527392:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527401:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527535:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527543:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527548:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368095.527553:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527560:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527569:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368095.527572:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368095.527576:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527582:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff031f3c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527593:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527599:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527604:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527608:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368095.527618:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527624:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527633:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5582a23c00) 00010000:00010000:3.0:1787368095.527635:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368095.527638:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527644:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527676:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff031f35 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf8 expref: 27 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527689:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf8 expref: 26 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.527696:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:3.0:1787368095.527698:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787368095.527701:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580030c00, rc 0) 00000100:00100000:3.0:1787368095.527727:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+26:15685:x1874190788593664:12345-192.168.203.4@tcp:101:stat.0 Request processed in 15040us (24956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368095.527742:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:3.0:1787368095.541758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368095.541854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368095.541912:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368095.542011:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788594560 00000100:00100000:1.0:1787368095.542022:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788594560 00000100:00100000:1.0:1787368095.542122:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1787368095.542146:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788594560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368095.542242:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788594560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 111us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368095.542266:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00080000:0.0:1787368095.542419:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787368095.549038:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788594304 00000100:00100000:2.0:1787368095.549068:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788594304 00000100:00100000:2.0:1787368095.549145:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788594816 00000100:00100000:2.0:1787368095.549149:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788594816 00000100:00100000:2.0:1787368095.549182:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:2.0:1787368095.549193:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788594304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368095.549248:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:1.0:1787368095.549271:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788594816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368095.549279:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788594304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (7526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368095.549288:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:1.0:1787368095.549320:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788594816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (7406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368095.549340:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:3.0:1787368095.556915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368095.557390:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788595072 00000100:00100000:3.0:1787368095.557396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368095.557402:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788595072 00000100:00080000:1.0:1787368095.557441:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787368095.557451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368095.557491:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788594432 00000100:00100000:2.0:1787368095.557495:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788594432 00000100:00100000:1.0:1787368095.557505:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1787368095.557520:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788595072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368095.557532:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1787368095.557543:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788594432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368095.557602:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788594432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 62us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368095.557610:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1787368095.557686:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788594176 00000100:00100000:0.0:1787368095.557690:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788594176 00000100:00100000:0.0:1787368095.557743:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:0.0:1787368095.557759:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2404:x1874190788594176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368095.558005:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788595072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 490us (4272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368095.558013:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00080000:1.0:1787368095.558030:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787368095.558898:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368095.559835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368095.559860:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788594944 00000100:00100000:3.0:1787368095.559868:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788594944 00000100:00100000:3.0:1787368095.559919:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:3.0:1787368095.559928:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788594944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368095.559993:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788594944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368095.560000:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00080000:3.0:1787368095.560017:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787368095.561443:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2404:x1874190788594176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 3677us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368095.561456:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:1.0:1787368095.563858:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788594688 00000100:00100000:1.0:1787368095.563872:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788594688 00000100:00100000:1.0:1787368095.563930:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:1.0:1787368095.563940:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+12:2404:x1874190788594688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368095.565941:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+12:2404:x1874190788594688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 1984us (7029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368095.565965:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:3.0:1787368095.598678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368095.599045:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788595328 00000100:00100000:1.0:1787368095.599055:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788595328 00000100:00100000:1.0:1787368095.599172:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1787368095.599183:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+26:15691:x1874190788595328:12345-192.168.203.4@tcp:36:truncate.0 00010000:00010000:1.0:1787368095.599241:0:17164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368095.599269:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf8 expref: 26 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.599290:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368095.599294:0:17164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787368095.599531:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.599567:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.599606:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787368095.599662:0:17164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787368095.599684:0:17164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029810c13 reply state 00000000c23c37ba transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.599696:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.599703:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368095.599706:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787368095.599708:0:17164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787368095.599847:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+28:15691:x1874190788595328:12345-192.168.203.4@tcp:36:truncate.0 Request processed in 666us (1178us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787368095.599855:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000020:00080000:1.0:1787368095.599860:0:17164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787368095.645775:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368095.737508:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368095.737616:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788595456 00000100:00100000:1.0:1787368095.737625:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788595456 00000100:00100000:1.0:1787368095.737680:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:1.0:1787368095.737690:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+28:15705:x1874190788595456:12345-192.168.203.4@tcp:101:stat.0 00010000:00010000:1.0:1787368095.737711:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368095.737729:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ebff expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.737814:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.737828:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.737852:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.737863:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.737869:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.737875:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.737937:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.737954:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.737961:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368095.737999:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787368095.738003:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787368095.738020:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738029:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738036:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738049:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738055:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738060:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368095.738064:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738071:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738082:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:1.0:1787368095.738084:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368095.738088:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738093:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738106:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738112:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738117:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738121:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368095.738128:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738134:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738140:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5582a23c00) 00010000:00010000:1.0:1787368095.738142:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368095.738144:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738149:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff031f66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738172:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff031f58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebff expref: 30 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738183:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebff expref: 29 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.738190:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368095.738192:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787368095.738194:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a1a00, rc 0) 00000100:00100000:1.0:1787368095.738248:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+29:15705:x1874190788595456:12345-192.168.203.4@tcp:101:stat.0 Request processed in 560us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368095.738254:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:2.0:1787368095.824153:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368095.824221:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788595712 00000100:00100000:0.0:1787368095.824231:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788595712 00000100:00100000:0.0:1787368095.824344:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:0.0:1787368095.824390:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+29:15715:x1874190788595712:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368095.824411:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368095.824432:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec06 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368095.824548:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787368095.824643:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f74 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec06 expref: 31 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.824657:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:0.0:1787368095.824660:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787368095.824665:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec06 expref: 31 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.824679:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a400, rc 0) 00000100:00100000:0.0:1787368095.824763:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+30:15715:x1874190788595712:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 408us (618us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787368095.824770:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:3.0:1787368095.832008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368095.832079:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788595968 00000100:00100000:2.0:1787368095.832089:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788595968 00000100:00100000:2.0:1787368095.832152:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1787368095.832162:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+30:15715:x1874190788595968:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787368095.832410:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+31:15715:x1874190788595968:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 248us (414us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787368095.832419:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000040:00080000:0.0:1787368095.897536:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787368095.900554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368095.900741:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788596224 00000100:00100000:3.0:1787368095.900751:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788596224 00000100:00100000:3.0:1787368095.900814:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:3.0:1787368095.900834:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+31:15721:x1874190788596224:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787368095.900860:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368095.900881:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031f82 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec0d expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.901162:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.901179:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebff expref: 32 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.901200:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.901305:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebff expref: 32 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.901321:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebff expref: 32 pid: 17162 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368095.901336:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808596608:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368095.901490:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55905c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787368095.908565:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368095.908578:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808596608:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368095.908613:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368095.909204:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788596352 00000100:00100000:0.0:1787368095.909212:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788596352 00010000:00010000:0.0:1787368095.909250:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebff expref: 33 pid: 17162 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368095.909288:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1787368095.909297:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483d46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+33:2405:x1874190788596352:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787368095.909311:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368095.909318:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebff expref: 33 pid: 17162 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.909329:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebff expref: 33 pid: 17162 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.909349:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff031f6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebff expref: 33 pid: 17162 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.909393:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368095.909398:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.909408:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.909416:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.909444:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368095.909505:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483d46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+32:2405:x1874190788596352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 208us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368095.909512:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00010000:00010000:3.0:1787368095.909827:0:17163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.909833:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787368095.909848:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787368095.909999:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031f82 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec0d expref: 33 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.910014:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec0d expref: 32 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.910032:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:3.0:1787368095.910034:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787368095.910037:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ce00, rc 0) 00000100:00100000:3.0:1787368095.910235:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+32:15721:x1874190788596224:12345-192.168.203.4@tcp:101:bash.0 Request processed in 9403us (9690us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787368095.910240:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:1.0:1787368095.913277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368095.913497:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788596608 00000100:00100000:0.0:1787368095.913505:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788596608 00000100:00100000:0.0:1787368095.913554:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:0.0:1787368095.913561:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+32:15721:x1874190788596608:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:0.0:1787368095.913920:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.913938:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.913948:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787368095.913981:0:17164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:0.0:1787368095.913995:0:17164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1b9e834 reply state 000000002d29205d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.914004:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.914009:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368095.914011:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787368095.914013:0:17164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787368095.914100:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+35:15721:x1874190788596608:12345-192.168.203.4@tcp:36:bash.0 Request processed in 538us (832us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787368095.914107:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000020:00080000:0.0:1787368095.914111:0:17164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787368095.918936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368095.918992:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788596736 00000100:00100000:1.0:1787368095.919001:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788596736 00000100:00100000:1.0:1787368095.919065:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:1.0:1787368095.919073:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+35:15721:x1874190788596736:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1787368095.919091:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368095.919106:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec14 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.919175:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.919185:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec0d expref: 36 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.919192:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.919215:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec0d expref: 36 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.919224:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec0d expref: 36 pid: 17163 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368095.919233:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808596736:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368095.919298:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368095.920831:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808596736:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368095.920855:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368095.921086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368095.921209:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788596864 00000100:00100000:3.0:1787368095.921216:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788596864 00010000:00010000:3.0:1787368095.921247:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec0d expref: 37 pid: 17163 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368095.921282:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:3.0:1787368095.921415:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+37:2403:x1874190788596864:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368095.921425:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368095.921430:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec0d expref: 37 pid: 17163 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.921438:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec0d expref: 37 pid: 17163 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.921453:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031f89 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec0d expref: 37 pid: 17163 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.921464:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:3.0:1787368095.921467:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.921483:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.921488:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.921504:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787368095.921528:0:17162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.921541:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368095.921549:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+36:2403:x1874190788596864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 137us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368095.921556:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000004:00200000:1.0:1787368095.921698:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787368095.921703:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787368095.921722:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.921762:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031f9e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec14 expref: 36 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.921777:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec14 expref: 35 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368095.921784:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368095.921787:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787368095.921789:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0400, rc 0) 00000100:00100000:1.0:1787368095.921827:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+35:15721:x1874190788596736:12345-192.168.203.4@tcp:101:bash.0 Request processed in 2754us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368095.921834:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:2.0:1787368095.924306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368095.924375:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788597120 00000100:00100000:0.0:1787368095.924384:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788597120 00000100:00100000:0.0:1787368095.924423:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1787368095.924430:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+35:15721:x1874190788597120:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:0.0:1787368095.924607:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+36:15721:x1874190788597120:12345-192.168.203.4@tcp:35:bash.0 Request processed in 175us (308us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1787368095.924615:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1787368095.972534:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368095.972950:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788597376 00000100:00100000:0.0:1787368095.972960:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788597376 00000100:00100000:0.0:1787368095.973024:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1787368095.973034:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+36:15731:x1874190788597376:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368095.973060:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368095.973082:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff031fac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec1b expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368095.973175:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787368095.973278:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff031fac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec1b expref: 38 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.973294:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:0.0:1787368095.973297:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787368095.973303:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff031fac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec1b expref: 38 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368095.973316:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a600, rc 0) 00000100:00100000:0.0:1787368095.973418:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+37:15731:x1874190788597376:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 385us (891us total) trans 8589934617 rc 301/301 00000100:00100000:0.0:1787368095.973442:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:2.0:1787368095.976949:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368095.977151:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788597504 00000100:00100000:3.0:1787368095.977161:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788597504 00000100:00100000:3.0:1787368095.977223:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:3.0:1787368095.977232:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+37:15731:x1874190788597504:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1787368095.977301:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977317:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977328:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977337:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977343:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977348:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977462:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977472:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977479:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787368095.977522:0:17163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977532:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977538:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977543:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977549:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368095.977553:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977560:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977571:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368095.977574:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368095.977578:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977591:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff031fba lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977604:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977610:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977616:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977621:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ca00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368095.977625:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977630:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977638:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5582a23c00) 00010000:00010000:3.0:1787368095.977641:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368095.977644:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977650:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff031fc1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977660:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977665:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977677:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977682:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368095.977685:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977691:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977699:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:3.0:1787368095.977702:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368095.977705:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368095.977711:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff031fc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368095.977794:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+37:15731:x1874190788597504:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 562us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368095.977802:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1787368095.982151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368095.982203:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788597760 00000100:00100000:0.0:1787368095.982211:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788597760 00000100:00100000:0.0:1787368095.982306:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1787368095.982317:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd755450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+37:15731:x1874190788597760:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787368095.982550:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd755450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+38:15731:x1874190788597760:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 234us (405us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1787368095.982558:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1787368096.004306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368096.004347:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788598016 00000100:00100000:0.0:1787368096.004386:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788598016 00000100:00100000:0.0:1787368096.004458:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:0.0:1787368096.004468:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+38:15734:x1874190788598016:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368096.004489:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368096.004509:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff031fcf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec22 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787368096.004567:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787368096.004790:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.004806:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.004817:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.004828:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.004853:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.004861:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.004984:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff031fe4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.004993:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff031fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005001:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff031fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368096.005011:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787368096.005078:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005084:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005091:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005098:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68aa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368096.005102:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005109:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005130:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368096.005133:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368096.005138:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005145:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff031fd6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005159:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005165:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005170:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005175:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ba00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368096.005178:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005184:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005191:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5582a23c00) 00010000:00010000:0.0:1787368096.005193:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368096.005197:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005203:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff031fdd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005250:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff031fcf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec22 expref: 41 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005264:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff031fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec22 expref: 40 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.005271:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368096.005274:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787368096.005276:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a200, rc 0) 00000100:00100000:0.0:1787368096.005333:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15734:x1874190788598016:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 866us (1033us total) trans 8589934619 rc 0/0 00000100:00100000:0.0:1787368096.005341:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1787368096.008047:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368096.008127:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788598272 00000100:00100000:3.0:1787368096.008135:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788598272 00000100:00100000:3.0:1787368096.008187:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1787368096.008197:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15734:x1874190788598272:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787368096.009285:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+41:15734:x1874190788598272:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 1086us (1241us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787368096.009293:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1787368096.010863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368096.011279:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788598400 00000100:00100000:1.0:1787368096.011290:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788598400 00000100:00100000:1.0:1787368096.011389:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1787368096.011402:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+41:2403:x1874190788598400:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368096.011417:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368096.011445:0:18318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff031fe4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec22 expref: 41 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.011483:0:18318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368096.011489:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368096.011550:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+40:2403:x1874190788598400:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 151us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368096.011558:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1787368096.013988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368096.014311:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788598528 00000100:00100000:1.0:1787368096.014320:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788598528 00000100:00100000:1.0:1787368096.014606:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:1.0:1787368096.014617:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15734:x1874190788598528:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:1.0:1787368096.014691:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.014708:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.014718:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.014757:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.014764:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.014771:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.014776:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368096.014780:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.014803:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.014815:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368096.014818:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787368096.014822:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.014828:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368096.014910:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15734:x1874190788598528:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 295us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368096.014918:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:2.0:1787368096.149453:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368096.149547:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788598656 00000100:00100000:1.0:1787368096.149557:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788598656 00000100:00100000:1.0:1787368096.149614:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:1.0:1787368096.149625:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15753:x1874190788598656:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787368096.149645:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368096.149665:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec29 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.149726:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff032000 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.149750:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff032000 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.149761:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff032000 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368096.149812:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787368096.149816:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787368096.149836:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff032000 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.149861:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff031ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec29 expref: 42 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.149939:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff032000 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec29 expref: 41 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.149949:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:1.0:1787368096.149952:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787368096.149955:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a1200, rc 0) 00000100:00100000:1.0:1787368096.150101:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+41:15753:x1874190788598656:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 477us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368096.150109:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:2.0:1787368096.156316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368096.156495:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788599040 00000100:00100000:0.0:1787368096.156505:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788599040 00000100:00100000:0.0:1787368096.156589:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1787368096.156600:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+41:15753:x1874190788599040:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787368096.156895:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15753:x1874190788599040:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 298us (588us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1787368096.156903:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:2.0:1787368096.159268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368096.159334:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788599168 00000100:00100000:1.0:1787368096.159342:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788599168 00000100:00100000:1.0:1787368096.159419:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1787368096.159429:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15753:x1874190788599168:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:1.0:1787368096.159442:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787368096.159467:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff031fa5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec14 expref: 42 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.159489:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b600/0x66f5679bff031ef6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebe3 expref: 41 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368096.159518:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368096.159523:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368096.159573:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15753:x1874190788599168:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 146us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368096.159581:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1787368096.161571:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368096.161655:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788599296 00000100:00100000:2.0:1787368096.161663:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788599296 00000100:00100000:2.0:1787368096.161710:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1787368096.161720:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15753:x1874190788599296:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:2.0:1787368096.161826:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368096.161843:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368096.161855:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787368096.163106:0:17162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787368096.163146:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787368096.163283:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787368096.163458:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15753:x1874190788599296:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 1736us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368096.163467:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1787368096.182840:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368096.182957:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788599424 00000100:00100000:0.0:1787368096.182966:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788599424 00000100:00100000:0.0:1787368096.183022:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:0.0:1787368096.183034:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15755:x1874190788599424:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368096.183054:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368096.183082:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03200e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec30 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183145:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183160:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183170:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183181:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183188:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183194:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183256:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183266:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183272:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368096.183310:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787368096.183314:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787368096.183331:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183349:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183381:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183388:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183395:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183401:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68aa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368096.183405:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183412:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183423:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368096.183425:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368096.183429:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183436:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032015 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183448:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183454:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183465:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183470:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68bc00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368096.183473:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183479:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183487:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5582a23c00) 00010000:00010000:0.0:1787368096.183489:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368096.183492:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183498:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff03201c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183524:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03200e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec30 expref: 42 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183537:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec30 expref: 41 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368096.183544:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368096.183546:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787368096.183548:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b200, rc 0) 00000100:00100000:0.0:1787368096.183618:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+41:15755:x1874190788599424:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 587us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368096.183633:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:1.0:1787368096.665484:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808596864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787368096.665562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368096.665648:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808596864 00000100:00100000:3.0:1787368096.665656:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808596864 00000100:00100000:3.0:1787368096.665714:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787368096.665744:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808596864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787368096.665769:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787368096.665809:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808596864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368096.665816:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787368096.665946:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787368096.665980:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808596864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787368096.666181:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808597248:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666219:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368096.666240:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808597760:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666260:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368096.666279:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808598272:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666302:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368096.666317:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787368096.666321:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808597120:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666342:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368096.666370:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808597632:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368096.666409:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808598144:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666424:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368096.666444:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808597248 00000100:00100000:0.0:1787368096.666447:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808597248 00000100:00100000:0.0:1787368096.666472:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808597760 00000100:00100000:0.0:1787368096.666475:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808597760 00000100:00100000:0.0:1787368096.666486:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808597632 00000100:00100000:0.0:1787368096.666488:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808597632 00000100:00100000:0.0:1787368096.666499:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787368096.666505:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808597248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666534:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808597248:12345-0@lo:400:kworker.0 Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368096.666552:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787368096.666576:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787368096.666582:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808597760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666612:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808597760:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368096.666617:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787368096.666629:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787368096.666634:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808597632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666658:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808597632:12345-0@lo:400:kworker.0 Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368096.666664:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787368096.666680:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808598272 00000100:00100000:0.0:1787368096.666683:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808598272 00000100:00100000:0.0:1787368096.666708:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808598144 00000100:00100000:0.0:1787368096.666711:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808598144 00000100:00100000:0.0:1787368096.666738:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787368096.666745:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808598272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666774:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808598272:12345-0@lo:400:kworker.0 Request processed in 30us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368096.666780:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787368096.666791:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787368096.666797:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808598144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.666822:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808598144:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368096.666827:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787368096.667092:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808597120 00000100:00100000:1.0:1787368096.667096:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808597120 00000100:00100000:1.0:1787368096.667126:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787368096.667133:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808597120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368096.667167:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808597120:12345-0@lo:400:kworker.0 Request processed in 35us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368096.667172:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787368096.667197:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787368096.667200:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787368096.667202:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787368096.667204:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787368096.667237:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368096.667263:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808597120:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.667287:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808597632:0@lo:400:kworker.0 00010000:00080000:0.0:1787368096.667298:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483ea2a00 x1874190808598144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368096.667308:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808598144:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.667318:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808597248:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.667326:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808597760:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.667335:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808598272:0@lo:400:kworker.0 00000100:00100000:2.0:1787368096.667499:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808596992:0@lo:400:kworker.0 00000100:00100000:2.0:1787368096.667550:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368096.667578:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808597504:0@lo:400:kworker.0 00000100:00100000:2.0:1787368096.667602:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368096.667620:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808598016:0@lo:400:kworker.0 00000100:00100000:2.0:1787368096.667641:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368096.667659:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787368096.667664:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808597376:0@lo:400:kworker.0 00000100:00100000:2.0:1787368096.667685:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368096.667702:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808597888:0@lo:400:kworker.0 00000100:00100000:2.0:1787368096.667722:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368096.667747:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808598400:0@lo:400:kworker.0 00000100:00100000:2.0:1787368096.667770:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368096.667817:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808597504 00000100:00100000:2.0:1787368096.667821:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808597504 00000100:00100000:2.0:1787368096.667845:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787368096.667852:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808597504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368096.667897:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808597504:12345-0@lo:400:kworker.0 Request processed in 46us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368096.667903:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787368096.667931:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548442dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808598528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787368096.667955:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368096.667981:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808597504:0@lo:400:kworker.0 00000100:00100000:3.0:1787368096.668168:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808598016 00000100:00100000:3.0:1787368096.668172:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808598016 00000100:00100000:3.0:1787368096.668211:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808597376 00000100:00100000:3.0:1787368096.668215:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808597376 00000100:00100000:3.0:1787368096.668227:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808597888 00000100:00100000:3.0:1787368096.668229:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808597888 00000100:00100000:3.0:1787368096.668238:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808598400 00000100:00100000:3.0:1787368096.668240:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808598400 00000100:00100000:3.0:1787368096.668255:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787368096.668261:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808598016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368096.668302:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808598016:12345-0@lo:400:kworker.0 Request processed in 42us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368096.668309:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787368096.668322:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787368096.668328:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808597376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368096.668374:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808597376:12345-0@lo:400:kworker.0 Request processed in 26us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368096.668392:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787368096.668405:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787368096.668411:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808597888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368096.668437:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808597888:12345-0@lo:400:kworker.0 Request processed in 27us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368096.668453:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787368096.668464:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787368096.668471:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808598400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368096.668501:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808598400:12345-0@lo:400:kworker.0 Request processed in 31us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368096.668507:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787368096.668556:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808597376:0@lo:400:kworker.0 00000100:00100000:3.0:1787368096.668567:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808597888:0@lo:400:kworker.0 00010000:00080000:3.0:1787368096.668577:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483ea1500 x1874190808598400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368096.668587:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808598400:0@lo:400:kworker.0 00000100:00100000:3.0:1787368096.668597:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808598016:0@lo:400:kworker.0 00000100:00100000:0.0:1787368096.668773:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808598528 00000100:00100000:0.0:1787368096.668778:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808598528 00000100:00100000:0.0:1787368096.668803:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787368096.668810:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808598528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787368096.668831:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787368096.668869:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808598528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368096.669001:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808596992 00000100:00100000:1.0:1787368096.669005:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808596992 00000100:00100000:1.0:1787368096.669031:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787368096.669037:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:3654:x1874190808596992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368096.669080:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:3654:x1874190808596992:12345-0@lo:400:kworker.0 Request processed in 43us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368096.669086:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787368096.669119:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808598656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787368096.669145:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368096.669176:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808598656 00000100:00100000:1.0:1787368096.669180:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808598656 00000100:00100000:1.0:1787368096.669203:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787368096.669208:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808598656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787368096.669218:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787368096.669247:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808598656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368096.669254:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787368096.669285:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808598656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787368096.669371:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787368096.669683:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548442dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808598528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787368096.669692:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808596992:0@lo:400:kworker.0 00000100:00080000:2.0:1787368096.669912:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787368096.669917:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787368096.927550:0:20342:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787368096.927559:0:20342:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787368096.927593:0:20342:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787368096.927599:0:20342:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1787368097.123060:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787368097.123068:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787368097.123092:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787368097.123098:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787368097.123225:0:17198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17198:1874190808598784:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787368097.126459:0:17198:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55905c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787368097.132420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.132458:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788599552 00000100:00100000:1.0:1787368097.132467:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788599552 00000100:00100000:1.0:1787368097.132518:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:1.0:1787368097.132527:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15767:x1874190788599552:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787368097.132560:0:17163:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787368097.132671:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15767:x1874190788599552:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 144us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.132679:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1787368097.139838:0:17198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17198:1874190808598784:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787368097.142967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368097.145545:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788599680 00000100:00100000:0.0:1787368097.145561:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788599680 00000100:00100000:0.0:1787368097.145682:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:0.0:1787368097.145692:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+41:15767:x1874190788599680:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787368097.145774:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.145811:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.145824:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.145841:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.145848:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.145855:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.145893:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.145902:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.145909:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368097.145953:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787368097.145957:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787368097.145973:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.145985:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146000:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146007:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146014:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ba00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.146018:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146025:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146038:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c5582a23b00) 00010000:00010000:0.0:1787368097.146041:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.146046:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146052:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03202a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146065:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146071:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146078:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146083:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68bc00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.146094:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146101:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146109:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c54824f0200) 00010000:00010000:0.0:1787368097.146112:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.146115:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146121:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032031 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146138:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146144:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146150:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146155:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68aa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.146157:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146164:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146171:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368097.146173:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.146183:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.146189:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032038 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368097.146278:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+41:15767:x1874190788599680:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 587us (3319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368097.146287:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:3.0:1787368097.151740:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.156156:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788599936 00000100:00100000:1.0:1787368097.156248:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788599936 00000100:00100000:1.0:1787368097.156316:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:1.0:1787368097.156325:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+41:15767:x1874190788599936:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787368097.156345:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368097.156381:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff03203f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec37 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156478:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156493:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156504:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368097.156515:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787368097.156589:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156596:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156602:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156608:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368097.156612:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156619:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156638:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:1.0:1787368097.156641:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787368097.156646:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156652:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff032046 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156928:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff03203f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec37 expref: 43 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.156998:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c5582a23b00) 00010000:00010000:1.0:1787368097.157000:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787368097.157005:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff03203f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec37 expref: 43 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.157016:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a1600, rc 0) 00000100:00100000:1.0:1787368097.157114:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15767:x1874190788599936:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 789us (5398us total) trans 8589934622 rc 301/301 00000100:00100000:1.0:1787368097.157123:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:3.0:1787368097.168106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368097.168139:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788600064 00000100:00100000:3.0:1787368097.168148:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788600064 00000100:00100000:3.0:1787368097.168325:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1787368097.168336:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15767:x1874190788600064:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787368097.168389:0:17164:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787368097.168492:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15767:x1874190788600064:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 158us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368097.168500:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1787368097.176146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368097.176265:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788600320 00000100:00100000:3.0:1787368097.176275:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788600320 00000100:00100000:3.0:1787368097.176324:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1787368097.176334:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15767:x1874190788600320:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787368097.176368:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368097.176371:0:17163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787368097.176398:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff032000 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec29 expref: 42 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.176415:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368097.176420:0:17163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787368097.176432:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff032054 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec3e expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787368097.178544:0:17163:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1787368097.178555:0:17163:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1787368097.178574:0:17163:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787368097.178797:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff03205b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.178814:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff03205b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.178825:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff03205b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.179913:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff032054 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec3e expref: 44 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.179997:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff03205b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec3e expref: 43 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.180007:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5590ea9b00) 00010000:00010000:3.0:1787368097.180011:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787368097.180013:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ca00, rc 0) 00000100:00100000:3.0:1787368097.180082:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15767:x1874190788600320:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 3748us (5156us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787368097.180092:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1787368097.187761:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368097.188772:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788600576 00000100:00100000:0.0:1787368097.188782:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788600576 00000100:00100000:0.0:1787368097.188849:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:0.0:1787368097.188860:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15767:x1874190788600576:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787368097.188922:0:17164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368097.188951:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff03205b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec3e expref: 43 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.188971:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5590ea9b00) 00010000:00010000:0.0:1787368097.188982:0:17164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787368097.189005:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189019:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189030:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189044:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189070:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189076:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189119:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189126:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189131:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189136:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68aa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.189140:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189147:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189155:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368097.189158:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.189162:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189169:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff032069 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189179:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189191:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189197:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189202:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68bc00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.189205:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189211:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189219:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x8d8933f6 (ffff9c54824f0200) 00010000:00010000:0.0:1787368097.189222:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.189224:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.189230:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032070 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8d8933f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368097.189317:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15767:x1874190788600576:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 458us (1591us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787368097.189325:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:0.0:1787368097.191155:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.191440:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788600704 00000100:00100000:1.0:1787368097.191448:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788600704 00000100:00100000:1.0:1787368097.191530:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:1.0:1787368097.191540:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+42:15767:x1874190788600704:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787368097.191558:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368097.191577:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff032077 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec45 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.191634:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.191647:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.191658:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.191762:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff032077 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec45 expref: 44 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.191778:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec45 expref: 43 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.191787:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:1.0:1787368097.191790:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787368097.191793:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0a00, rc 0) 00000100:00100000:1.0:1787368097.191843:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15767:x1874190788600704:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 304us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.191851:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1787368097.197524:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.197619:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788600960 00000100:00100000:1.0:1787368097.197629:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788600960 00000100:00100000:1.0:1787368097.197685:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1787368097.197696:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15767:x1874190788600960:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787368097.197780:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.197814:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.197825:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368097.197981:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787368097.197991:0:17162:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554485634546ns, next at 555485632455ns, rc = 0 00000004:00010000:1.0:1787368097.198040:0:17162:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001263e861 reply state 000000003f338f32 transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.198052:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.198059:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:1.0:1787368097.198062:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787368097.198065:0:17162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787368097.198160:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+45:15767:x1874190788600960:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 465us (644us total) trans 8589934624 rc 0/0 00000100:00100000:1.0:1787368097.198168:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1787368097.200271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368097.200341:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788601088 00000100:00100000:0.0:1787368097.200350:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788601088 00000100:00100000:0.0:1787368097.200438:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:0.0:1787368097.200447:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+45:15767:x1874190788601088:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787368097.200481:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368097.200497:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec4c expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.200546:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec4c expref: 46 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.200559:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec4c expref: 46 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.200575:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:0.0:1787368097.200578:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787368097.200581:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ba00, rc 0) 00000100:00100000:0.0:1787368097.200636:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+46:15767:x1874190788601088:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 189us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368097.200643:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1787368097.204544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368097.204627:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788601216 00000100:00100000:0.0:1787368097.204636:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788601216 00000100:00100000:0.0:1787368097.204705:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1787368097.204716:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2402:x1874190788601216:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787368097.204969:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2402:x1874190788601216:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 254us (434us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787368097.204977:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00080000:2.0:1787368097.205314:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787368097.211848:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368097.212004:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788601472 00000100:00100000:2.0:1787368097.212014:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788601472 00000100:00100000:2.0:1787368097.212075:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1787368097.212087:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+46:15767:x1874190788601472:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787368097.212549:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+47:15767:x1874190788601472:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 462us (711us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1787368097.212558:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1787368097.215463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.215852:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788601728 00000100:00100000:1.0:1787368097.215862:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788601728 00000100:00100000:1.0:1787368097.215919:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:1.0:1787368097.215928:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+47:15767:x1874190788601728:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787368097.216039:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+47:15767:x1874190788601728:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 112us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.216047:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:2.0:1787368097.221648:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368097.221711:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788601856 00000100:00100000:0.0:1787368097.221721:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788601856 00000100:00100000:0.0:1787368097.221796:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1787368097.221804:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+47:15767:x1874190788601856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787368097.221834:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368097.221852:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032093 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec53 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.221920:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff03209a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.221935:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff03209a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.221947:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff03209a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368097.221995:0:17163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787368097.222014:0:17163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff03209a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.222036:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68bc00/0x66f5679bff032093 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec53 expref: 49 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.222051:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff03209a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec53 expref: 48 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.222057:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:0.0:1787368097.222059:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787368097.222061:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68aa00, rc 0) 00000100:00100000:0.0:1787368097.222115:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+48:15767:x1874190788601856:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 311us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368097.222122:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1787368097.225707:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.225860:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788601984 00000100:00100000:1.0:1787368097.225869:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788601984 00000100:00100000:1.0:1787368097.225926:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1787368097.225936:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2402:x1874190788601984:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787368097.225954:0:18672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368097.225976:0:18672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec5a expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787368097.226000:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8912a1, blocks: 0x0 00010000:00010000:1.0:1787368097.226020:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=554s v=(0 0) 00010000:00010000:1.0:1787368097.226025:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368097.226034:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec5a expref: 7 pid: 18672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.226053:0:18672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec5a expref: 7 pid: 18672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.226065:0:18672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a1600, rc 0) 00000100:00100000:1.0:1787368097.226125:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2402:x1874190788601984:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 189us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.226132:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1787368097.230982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.231088:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788602240 00000100:00100000:1.0:1787368097.231097:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788602240 00000100:00100000:1.0:1787368097.231160:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1787368097.231171:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+48:15767:x1874190788602240:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787368097.231281:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+48:15767:x1874190788602240:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.231300:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:2.0:1787368097.236674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368097.236801:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788602368 00000100:00100000:3.0:1787368097.236812:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788602368 00000100:00100000:3.0:1787368097.236880:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:3.0:1787368097.236892:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+7:15767:x1874190788602368:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787368097.236910:0:19618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368097.236929:0:19618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec61 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.237126:0:19618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec5a expref: 8 pid: 18672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.237135:0:19618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368097.237139:0:19618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368097.237144:0:19618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 8 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.237278:0:19618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec5a expref: 8 pid: 18672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.237294:0:19618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec5a expref: 8 pid: 18672 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368097.237307:0:19618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19618:1874190808598912:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368097.237437:0:19618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a0482480 going to sleep for 11 seconds 00000100:00100000:0.0:1787368097.240097:0:19618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19618:1874190808598912:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787368097.240135:0:19618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 8 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.240158:0:19618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c200, rc 0) 00000100:00100000:0.0:1787368097.245149:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+8:15767:x1874190788602368:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 8248us (8472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368097.245172:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1787368097.245270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368097.245459:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788602496 00000100:00100000:3.0:1787368097.245469:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788602496 00010000:00010000:3.0:1787368097.245524:0:18318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec5a expref: 9 pid: 18672 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368097.245569:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1787368097.245578:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+9:2402:x1874190788602496:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368097.245602:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368097.245621:0:18318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec5a expref: 9 pid: 18672 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.245634:0:18318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec5a expref: 9 pid: 18672 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.245657:0:18318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0320a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec5a expref: 9 pid: 18672 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.245675:0:18318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368097.245679:0:18318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368097.245687:0:18318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 8 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.245709:0:18318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 8 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.245754:0:18318:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 8 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368097.245779:0:18318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18318:1874190808599040:192.168.203.4@tcp:105: 00000100:00100000:3.0:1787368097.245961:0:18318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a0482480 going to sleep for 11 seconds 00000100:00100000:3.0:1787368097.249325:0:18318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18318:1874190808599040:192.168.203.4@tcp:105: 00010000:00010000:3.0:1787368097.249350:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368097.249426:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2402:x1874190788602496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3848us (4156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368097.249438:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1787368097.251501:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.251598:0:18675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788602624 00000100:00100000:1.0:1787368097.251607:0:18675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788602624 00002000:00100000:1.0:1787368097.251652:0:18675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9c5483ea0700 x1874190788602624/t0(0) o4->2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp:738/0 lens 504/0 e 0 to 0 dl 1787368108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787368097.251662:0:18675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483ea0700 with x1874190788602624 ext(0->8) 00002000:00010000:1.0:1787368097.251667:0:18675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483ea0700 00000100:00100000:1.0:1787368097.251700:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1787368097.251709:0:18675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2402:x1874190788602624:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787368097.253022:0:18675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+9:2402:x1874190788602624:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 1307us (1520us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787368097.253034:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00002000:00100000:1.0:1787368097.253043:0:18675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9c5483ea0700 x1874190788602624/t8589934596(0) o4->2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp:738/0 lens 504/448 e 0 to 0 dl 1787368108 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787368097.253053:0:18675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483ea0700 with x1874190788602624 ext(0->8) 00002000:00010000:1.0:1787368097.253058:0:18675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483ea0700 00000100:00100000:1.0:1787368097.263788:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368097.263897:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788602752 00000100:00100000:0.0:1787368097.263907:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788602752 00000100:00100000:0.0:1787368097.263974:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1787368097.263985:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+48:15767:x1874190788602752:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787368097.266654:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000004:00080000:2.0:1787368097.266673:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787368097.266752:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787368097.266918:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787368097.266947:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808599168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787368097.267021:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368097.267070:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808599168 00000100:00100000:1.0:1787368097.267078:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808599168 00000100:00100000:1.0:1787368097.267124:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787368097.267133:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808599168:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787368097.267257:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.267268:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.267275:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.267281:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580031c00 already unused, calling callback (ffffffffc175e4f0) 00002000:00010000:1.0:1787368097.267281:0:19223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787368097.267284:0:19223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787368097 00010000:00010000:3.0:1787368097.267286:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787368097.267287:0:19223:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787368097.267289:0:19223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787368097 -> 1787368097 00002000:00010000:1.0:1787368097.267292:0:19223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787368097.267294:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.267309:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368097.267312:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787368097.267317:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368097.267328:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808599168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 196us (307us total) trans 8589934597 rc 0/0 00010000:00010000:3.0:1787368097.267333:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff031e63 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368097.267336:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1787368097.267397:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c5483794380/2, rc 0, transno 8589934597 00000100:00100000:1.0:1787368097.267403:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808599168:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1787368097.267644:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267653:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267660:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267665:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580031a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.267668:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267674:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267693:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c5590ea9800) 00010000:00010000:0.0:1787368097.267697:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.267701:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267706:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031a00/0x66f5679bff031e0f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267732:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267738:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267743:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267748:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.267751:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267757:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267765:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368097.267768:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.267771:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267777:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff031e16 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267800:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267806:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267812:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267817:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.267820:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267826:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267834:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5582a23c00) 00010000:00010000:0.0:1787368097.267836:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.267839:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267845:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff031ebe lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267860:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267866:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267871:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267883:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.267886:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267892:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267900:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368097.267902:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.267905:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267910:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613b400/0x66f5679bff031f2e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267923:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267929:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267945:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267951:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.267953:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267959:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267976:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368097.267979:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.267982:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267987:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff031f51 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.267998:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268004:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268009:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268014:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.268017:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268023:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268030:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368097.268032:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.268035:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268041:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b613a400/0x66f5679bff031f97 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268065:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268071:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268076:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268081:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.268084:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268089:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268097:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:0.0:1787368097.268100:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787368097.268102:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.268107:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff032085 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368097.268395:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+14:15767:x1874190788602752:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 4409us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368097.268405:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:2.0:1787368097.270569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.270685:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788602880 00000100:00100000:1.0:1787368097.270694:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788602880 00000100:00100000:1.0:1787368097.270756:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1787368097.270766:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+9:2403:x1874190788602880:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787368097.279216:0:19486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1787368097.279231:0:19486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:1.0:1787368097.279436:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2403:x1874190788602880:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 8666us (8868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.279446:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1787368097.297653:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.297806:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788603136 00000100:00100000:1.0:1787368097.297815:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788603136 00000100:00100000:1.0:1787368097.297873:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:1.0:1787368097.297883:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+14:15767:x1874190788603136:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787368097.297936:0:17162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368097.297963:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff03209a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec53 expref: 14 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.297982:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:1.0:1787368097.298001:0:17162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787368097.298031:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.298043:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.298052:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787368097.298193:0:17162:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000d9ff7b reply state 00000000770d57f6 transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.298206:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.298212:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:1.0:1787368097.298214:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787368097.298217:0:17162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787368097.298311:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+15:15767:x1874190788603136:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 429us (666us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1787368097.298320:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:0.0:1787368097.301497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.301621:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788603264 00000100:00100000:1.0:1787368097.301630:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788603264 00000100:00100000:1.0:1787368097.301685:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1787368097.301695:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2403:x1874190788603264:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787368097.301856:0:19618:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787368097.301860:0:19618:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787368097 -> 1787368096 00002000:00010000:1.0:1787368097.301862:0:19618:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787368095 00002000:00010000:1.0:1787368097.301864:0:19618:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787368097 -> 1787368096 00002000:00010000:1.0:1787368097.301879:0:19618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787368097.302026:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2403:x1874190788603264:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 331us (537us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787368097.302035:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:2.0:1787368097.321184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.321391:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788603520 00000100:00100000:1.0:1787368097.321401:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788603520 00000100:00100000:1.0:1787368097.321452:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:1.0:1787368097.321462:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+15:15767:x1874190788603520:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787368097.321538:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.321555:0:18960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec45 expref: 15 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.321564:0:18960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.321601:0:18960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec45 expref: 15 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.321614:0:18960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec45 expref: 15 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368097.321628:0:18960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808599296:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368097.321716:0:18960:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743240 going to sleep for 11 seconds 00000100:00100000:1.0:1787368097.328960:0:18960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808599296:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368097.328990:0:18960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368097.329997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.330086:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788603648 00000100:00100000:1.0:1787368097.330094:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788603648 00010000:00010000:1.0:1787368097.330136:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec45 expref: 16 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368097.330184:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1787368097.330203:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+16:2403:x1874190788603648:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368097.330222:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368097.330229:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec45 expref: 16 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.330241:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec45 expref: 16 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.330264:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff03207e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec45 expref: 16 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.330281:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:1.0:1787368097.330285:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.330294:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.330301:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.330332:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368097.330441:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+15:2403:x1874190788603648:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 238us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.330449:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00010000:00010000:2.0:1787368097.330676:0:18960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.330685:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.330719:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.330744:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.330751:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.330757:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368097.330761:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.330769:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.330777:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:2.0:1787368097.330780:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787368097.330784:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.330790:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0320b6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368097.330838:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+14:15767:x1874190788603520:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 9376us (9673us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787368097.330846:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:2.0:1787368097.335625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368097.335694:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788603776 00000100:00100000:3.0:1787368097.335703:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788603776 00000100:00100000:3.0:1787368097.335763:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:3.0:1787368097.335772:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2403:x1874190788603776:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787368097.335814:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.335833:0:18670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 7 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.335843:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368097.335847:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787368097.335852:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.335883:0:18670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 7 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.335896:0:18670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 7 pid: 19618 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368097.335910:0:18670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18670:1874190808599424:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368097.335996:0:18670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a0482480 going to sleep for 11 seconds 00000100:00100000:3.0:1787368097.340501:0:18670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18670:1874190808599424:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368097.340533:0:18670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368097.340682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.340770:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788603904 00000100:00100000:1.0:1787368097.340778:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788603904 00010000:00010000:1.0:1787368097.340816:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 8 pid: 19618 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368097.340854:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1787368097.340863:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+8:2402:x1874190788603904:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368097.340880:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368097.340901:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 8 pid: 19618 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.340913:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 8 pid: 19618 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.340935:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff0320a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec61 expref: 8 pid: 19618 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.340951:0:17147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787368097.340955:0:17147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787368097.340961:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.340971:0:17147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.341024:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368097.341081:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2402:x1874190788603904:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 218us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.341089:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00010000:00010000:0.0:1787368097.341159:0:18670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.341193:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.341217:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.341224:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.341231:0:18670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.341237:0:18670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368097.341241:0:18670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.341250:0:18670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.341261:0:18670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.341268:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0320bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368097.341327:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2403:x1874190788603776:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 5555us (5709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368097.341335:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1787368097.347811:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.347905:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788604160 00000100:00100000:1.0:1787368097.347914:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788604160 00000100:00100000:1.0:1787368097.347972:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:1.0:1787368097.347982:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+14:15767:x1874190788604160:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787368097.348058:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.348075:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf1 expref: 14 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.348084:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.348118:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf1 expref: 14 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.348131:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf1 expref: 14 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368097.348145:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808599552:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368097.348244:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743240 going to sleep for 11 seconds 00000100:00100000:2.0:1787368097.353691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.353808:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808599552:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368097.353849:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368097.353913:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788604288 00000100:00100000:3.0:1787368097.353920:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788604288 00010000:00010000:3.0:1787368097.353957:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf1 expref: 15 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368097.353994:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1787368097.354005:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+15:2403:x1874190788604288:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368097.354019:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368097.354026:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf1 expref: 15 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.354038:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf1 expref: 15 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.354059:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673200/0x66f5679bff031f27 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebf1 expref: 15 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.354074:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:3.0:1787368097.354078:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.354088:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.354102:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.354128:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368097.354184:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+14:2403:x1874190788604288:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 181us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368097.354200:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00010000:00010000:1.0:1787368097.354525:0:17162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.354533:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.354703:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.354714:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec4c expref: 14 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.354731:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.354756:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec4c expref: 14 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.354769:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec4c expref: 14 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368097.354781:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808599680:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368097.354833:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368097.360658:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808599680:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368097.360691:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368097.365398:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368097.365962:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788604416 00000100:00100000:1.0:1787368097.365972:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788604416 00010000:00010000:1.0:1787368097.366014:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec4c expref: 15 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368097.366055:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1787368097.366064:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+15:2402:x1874190788604416:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368097.366075:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368097.366080:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec4c expref: 15 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.366091:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec4c expref: 15 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.366108:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03208c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec4c expref: 15 pid: 17163 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.366120:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:1.0:1787368097.366124:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.366131:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.366136:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368097.366167:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368097.366244:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+14:2402:x1874190788604416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 180us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.366252:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00010000:00010000:2.0:1787368097.366541:0:17162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.366560:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787368097.366655:0:17162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:2.0:1787368097.366778:0:17162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:2.0:1787368097.366826:0:17162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:2.0:1787368097.366897:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548442f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17162:1874190808599808:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787368097.366944:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368097.366966:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482392900 going to sleep for 11 seconds 00000100:00100000:1.0:1787368097.367379:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808599808 00000100:00100000:1.0:1787368097.367385:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808599808 00000100:00100000:1.0:1787368097.367418:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787368097.367426:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:17162:x1874190808599808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787368097.367510:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:17162:x1874190808599808:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368097.367518:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787368097.367602:0:17162:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787368097.367609:0:17162:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c5483794380, transno 8589934597 00000100:00100000:3.0:1787368097.367629:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548442f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17162:1874190808599808:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787368097.367802:0:17162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:3.0:1787368097.367848:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17162:1874190808599936:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787368097.367878:0:17162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368097.367894:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd4b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787368097.368005:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808599936 00000100:00100000:1.0:1787368097.368009:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808599936 00000100:00100000:1.0:1787368097.368041:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787368097.368048:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:17162:x1874190808599936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787368097.368157:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17162:x1874190808599936:12345-0@lo:1000:mdt00_000.0 Request processed in 109us (277us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787368097.368266:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17162:1874190808599936:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787368097.368305:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368314:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368321:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368326:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.368331:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368338:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368376:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:0.0:1787368097.368379:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787368097.368383:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368389:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0320cb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368429:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368435:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368439:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368444:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.368446:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368451:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368459:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368097.368461:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787368097.368464:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368470:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032007 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368514:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368527:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec30 expref: 17 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368535:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368567:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec30 expref: 17 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.368581:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec30 expref: 17 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368097.368595:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808600064:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787368097.368654:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368097.368861:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787368097.372067:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808600064:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368097.372097:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368097.373416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368097.373631:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788604544 00000100:00100000:3.0:1787368097.373640:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788604544 00010000:00010000:3.0:1787368097.373676:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec30 expref: 18 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368097.373713:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:3.0:1787368097.373738:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+18:2402:x1874190788604544:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368097.373754:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368097.373775:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec30 expref: 18 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.373789:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec30 expref: 18 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.373810:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032023 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec30 expref: 18 pid: 18960 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.373825:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:3.0:1787368097.373830:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.373839:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.373847:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368097.373877:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787368097.373986:0:17162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.373994:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374006:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374012:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374019:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374025:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68b400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.374028:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374035:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374051:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368097.374053:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368097.374057:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374062:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff0320d2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374071:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374077:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374081:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374087:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368097.374090:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374095:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374101:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5582a23600) 00010000:00010000:0.0:1787368097.374103:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787368097.374105:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368097.374109:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0320c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368097.374352:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+17:2402:x1874190788604544:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 629us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368097.374391:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000040:00080000:3.0:1787368097.374493:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787368097.374498:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787368097.374514:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787368097.374522:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787368097.378373:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+16:15767:x1874190788604160:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 30361us (30540us total) trans 8589934631 rc 0/0 00000100:00100000:0.0:1787368097.378390:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000020:00080000:0.0:1787368097.378399:0:17162:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787368097.383264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368097.386486:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788604800 00000100:00100000:2.0:1787368097.386500:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788604800 00000100:00100000:2.0:1787368097.386568:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1787368097.386578:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+16:15767:x1874190788604800:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787368097.386838:0:17166:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787368097.386869:0:17166:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:2.0:1787368097.386902:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.386917:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.386928:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.386936:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.386943:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.386966:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.386982:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787368097.387066:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+18:15767:x1874190788604800:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 489us (3809us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1787368097.387073:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000020:00080000:2.0:1787368097.387077:0:17166:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787368097.387101:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368097.387107:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.387114:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368097.387118:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.387126:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.387138:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:2.0:1787368097.387141:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787368097.387146:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.387152:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff0320d9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368097.387178:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368097.387180:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368097.387181:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368097.689108:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368098.715350:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787368098.894235:0:20394:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787368098.894244:0:20394:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787368098.894271:0:20394:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787368098.894279:0:20394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787368099.054579:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.054748:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788605056 00000100:00100000:0.0:1787368099.054757:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788605056 00000100:00080000:2.0:1787368099.054936:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787368099.054998:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:0.0:1787368099.055009:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+18:15785:x1874190788605056:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368099.055031:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368099.055051:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff0320e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec68 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368099.055145:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787368099.055235:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff0320e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec68 expref: 20 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.055250:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:0.0:1787368099.055253:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787368099.055257:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff0320e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec68 expref: 20 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.055267:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b800, rc 0) 00000100:00100000:0.0:1787368099.055329:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15785:x1874190788605056:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 322us (758us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1787368099.055344:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:0.0:1787368099.058170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368099.058434:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788605184 00000100:00100000:3.0:1787368099.058444:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788605184 00000100:00100000:3.0:1787368099.058500:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:3.0:1787368099.058517:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15785:x1874190788605184:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1787368099.058591:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058609:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058621:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058639:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058647:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058654:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058739:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058748:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058755:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787368099.058807:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058822:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058834:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058841:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.058847:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241de00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368099.058851:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059329:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059342:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368099.059345:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368099.059350:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059435:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0320ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059447:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059454:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059461:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059466:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368099.059475:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059482:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059490:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5590ea9700) 00010000:00010000:3.0:1787368099.059493:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368099.059496:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059502:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0320f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059518:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059524:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059530:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059534:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368099.059537:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059542:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059548:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c5590ea9100) 00010000:00010000:3.0:1787368099.059551:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368099.059558:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.059564:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0320fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368099.059867:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15785:x1874190788605184:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1339us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368099.059877:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1787368099.062784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.062864:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788605440 00000100:00100000:2.0:1787368099.062872:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788605440 00000100:00100000:2.0:1787368099.062948:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1787368099.062958:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15785:x1874190788605440:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787368099.063155:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+20:15785:x1874190788605440:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 198us (377us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1787368099.063163:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1787368099.101964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.108967:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788605696 00000100:00100000:2.0:1787368099.108983:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788605696 00000100:00100000:2.0:1787368099.109062:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:2.0:1787368099.109073:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+20:15788:x1874190788605696:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368099.109098:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368099.109120:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032103 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec6f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109193:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109208:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109219:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109265:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109272:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109278:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109421:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109430:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109437:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368099.109446:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1787368099.109514:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109521:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109527:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109533:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368099.109537:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109555:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109567:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:2.0:1787368099.109570:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368099.109574:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109580:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03210a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109594:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109601:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109607:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109611:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368099.109615:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109632:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109639:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c559aafe100) 00010000:00010000:2.0:1787368099.109642:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368099.109645:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109660:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032111 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109704:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032103 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec6f expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109727:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec6f expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.109734:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:2.0:1787368099.109736:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787368099.109738:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f800, rc 0) 00000100:00100000:2.0:1787368099.110269:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+22:15788:x1874190788605696:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1195us (8312us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1787368099.110277:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1787368099.114150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.115773:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788605824 00000100:00100000:0.0:1787368099.115786:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788605824 00000100:00100000:0.0:1787368099.115852:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:0.0:1787368099.115864:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+22:15788:x1874190788605824:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1787368099.115935:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.115952:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.115963:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.115997:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.116002:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.116007:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.116011:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ba00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.116014:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.116020:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.116043:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:0.0:1787368099.116045:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787368099.116048:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.116053:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032126 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368099.116131:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+22:15788:x1874190788605824:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 268us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368099.116138:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1787368099.121566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368099.121705:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788606080 00000100:00100000:3.0:1787368099.121724:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788606080 00000100:00100000:3.0:1787368099.121787:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1787368099.121797:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd754050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+22:15788:x1874190788606080:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1787368099.122024:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd754050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+23:15788:x1874190788606080:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 229us (467us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1787368099.122032:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:1.0:1787368099.147499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.147855:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788606336 00000100:00100000:2.0:1787368099.147876:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788606336 00000100:00100000:2.0:1787368099.147968:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:2.0:1787368099.147979:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+23:13008:x1874190788606336:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787368099.148001:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368099.148033:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03212d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec76 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.148182:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.148198:0:18960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec6f expref: 24 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.148244:0:18960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.148271:0:18960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec6f expref: 24 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.148281:0:18960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec6f expref: 24 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368099.148291:0:18960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c548442f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808600192:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787368099.148415:0:18960:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55884df300 going to sleep for 11 seconds 00000100:00100000:2.0:1787368099.149823:0:18960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c548442f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808600192:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787368099.149849:0:18960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368099.150148:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.150276:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788606464 00000100:00100000:0.0:1787368099.150282:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788606464 00010000:00010000:0.0:1787368099.150315:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec6f expref: 25 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368099.150350:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:0.0:1787368099.150375:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+25:2403:x1874190788606464:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787368099.150388:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368099.150394:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec6f expref: 25 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.150407:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec6f expref: 25 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.150429:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032118 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec6f expref: 25 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.150462:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:0.0:1787368099.150468:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.150475:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.150483:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.150529:0:18960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.150529:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787368099.150538:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368099.150553:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00000100:00100000:0.0:1787368099.150585:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+24:2403:x1874190788606464:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 202us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368099.150594:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00010000:00010000:2.0:1787368099.150762:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff03212d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec76 expref: 25 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.150779:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec76 expref: 24 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.150810:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:2.0:1787368099.150813:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787368099.150816:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67ea00, rc 0) 00000100:00100000:2.0:1787368099.150858:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+24:13008:x1874190788606336:12345-192.168.203.4@tcp:101:bash.0 Request processed in 2877us (3364us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1787368099.150865:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:1.0:1787368099.152569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.152844:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788606592 00000100:00100000:0.0:1787368099.152852:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788606592 00000100:00100000:0.0:1787368099.152892:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:0.0:1787368099.152898:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+24:13008:x1874190788606592:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787368099.152916:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368099.152932:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032142 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec7d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.152964:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68be00/0x66f5679bff032149 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.152974:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68be00/0x66f5679bff032149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.152981:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68be00/0x66f5679bff032149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.153112:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032142 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec7d expref: 26 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.153124:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68be00/0x66f5679bff032149 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec7d expref: 25 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.153130:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:0.0:1787368099.153132:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787368099.153134:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68be00, rc 0) 00000100:00100000:0.0:1787368099.153170:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+25:13008:x1874190788606592:12345-192.168.203.4@tcp:101:bash.0 Request processed in 273us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368099.153175:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:1.0:1787368099.154883:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.154917:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788606848 00000100:00100000:0.0:1787368099.154924:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788606848 00000100:00100000:0.0:1787368099.154968:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:0.0:1787368099.154978:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+25:13008:x1874190788606848:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:0.0:1787368099.155245:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.155257:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.155263:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787368099.155293:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:0.0:1787368099.155307:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000566b1816 reply state 00000000d2801b14 transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.155329:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.155334:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:0.0:1787368099.155336:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787368099.155338:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787368099.155427:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:0.0:1787368099.155499:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+29:13008:x1874190788606848:12345-192.168.203.4@tcp:36:bash.0 Request processed in 523us (622us total) trans 8589934641 rc 0/0 00000100:00100000:0.0:1787368099.155504:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000020:00080000:0.0:1787368099.155508:0:17163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787368099.156453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.157133:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788606976 00000100:00100000:2.0:1787368099.157142:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788606976 00000100:00100000:2.0:1787368099.157268:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:2.0:1787368099.157294:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+29:13008:x1874190788606976:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787368099.157328:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368099.157409:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff032157 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec84 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.157560:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff032157 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec84 expref: 30 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.157978:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff032157 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec84 expref: 30 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.158011:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:2.0:1787368099.158015:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787368099.158018:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fa00, rc 0) 00000100:00100000:2.0:1787368099.158197:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+30:13008:x1874190788606976:12345-192.168.203.4@tcp:101:bash.0 Request processed in 919us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368099.158303:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:1.0:1787368099.160960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.161206:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788607104 00000100:00100000:2.0:1787368099.161215:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788607104 00000100:00100000:2.0:1787368099.161290:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1787368099.161301:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+6:13008:x1874190788607104:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787368099.161317:0:18672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368099.161338:0:18672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec8b expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787368099.161344:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1787368099.161402:0:18672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 9, mtime: 0x6a8912a0, atime: 0x6a89129f, ctime: 0x6a8912a0, blocks: 0x8 00010000:00010000:2.0:1787368099.161423:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1787368099.161428:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368099.161436:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec8b expref: 7 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.161454:0:18672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec8b expref: 7 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.161467:0:18672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f200, rc 0) 00000100:00100000:2.0:1787368099.161514:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:13008:x1874190788607104:12345-192.168.203.4@tcp:101:bash.0 Request processed in 217us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368099.161519:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:1.0:1787368099.163083:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.163413:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788607232 00000100:00100000:2.0:1787368099.163421:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788607232 00002000:00010000:2.0:1787368099.163447:0:18677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/34 (0->18446744073709551615) 00002000:00100000:2.0:1787368099.163450:0:18677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483795500 with x1874190788607232 ext(0->18446744073709551615) 00002000:00010000:2.0:1787368099.163470:0:18677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483795500. 00000100:00100000:2.0:1787368099.163498:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1787368099.163505:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2402:x1874190788607232:12345-192.168.203.4@tcp:10:bash.0 00002000:00010000:2.0:1787368099.163758:0:18677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787368099.163762:0:18677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787368096 -> 1787368099 00002000:00010000:2.0:1787368099.163764:0:18677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 1787368095 -> 1787368095 00002000:00010000:2.0:1787368099.163766:0:18677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787368096 -> 1787368099 00002000:00010000:2.0:1787368099.163769:0:18677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787368099.163830:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+8:2402:x1874190788607232:12345-192.168.203.4@tcp:10:bash.0 Request processed in 324us (767us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787368099.163839:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00002000:00010000:2.0:1787368099.163842:0:18677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/34 (0->18446744073709551615) 00002000:00100000:2.0:1787368099.163845:0:18677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483795500 with x1874190788607232 ext(0->18446744073709551615) 00002000:00010000:2.0:1787368099.163850:0:18677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c5483795500. 00000100:00100000:3.0:1787368099.205319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.205447:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788607488 00000100:00100000:2.0:1787368099.205456:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788607488 00000100:00100000:2.0:1787368099.205637:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:2.0:1787368099.205648:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+30:15802:x1874190788607488:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368099.205668:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368099.205688:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec92 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.205818:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff03216c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.205832:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff03216c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.205865:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff03216c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368099.205877:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787368099.205982:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec92 expref: 33 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.206001:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff03216c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec92 expref: 32 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.206009:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:2.0:1787368099.206013:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787368099.206016:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f800, rc 0) 00000100:00100000:2.0:1787368099.206080:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+32:15802:x1874190788607488:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 434us (769us total) trans 8589934642 rc 0/0 00000100:00100000:2.0:1787368099.206087:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:1.0:1787368099.208219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.208288:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788607616 00000100:00100000:0.0:1787368099.208295:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788607616 00000100:00100000:0.0:1787368099.208332:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:0.0:1787368099.208338:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+32:15802:x1874190788607616:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1787368099.208442:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208471:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208482:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208497:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208505:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208524:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208580:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208589:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208595:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787368099.208637:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208649:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208654:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208661:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208667:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ba00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.208671:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208678:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208689:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368099.208698:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368099.208703:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208720:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03217a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208735:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208741:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208747:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208753:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.208755:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208762:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208776:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368099.208778:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368099.208781:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208786:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032181 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208802:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208816:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208830:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208834:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.208837:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208843:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208851:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:0.0:1787368099.208853:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368099.208856:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.208860:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032188 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368099.208929:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+32:15802:x1874190788607616:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 589us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368099.208934:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:1.0:1787368099.226812:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787368099.226838:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808600320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787368099.226909:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368099.227032:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808600320 00000100:00100000:0.0:1787368099.227040:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808600320 00000100:00100000:0.0:1787368099.227112:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787368099.227122:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808600320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787368099.227150:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787368099.227217:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808600320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368099.227224:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787368099.227270:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808600320:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787368099.227341:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787368099.244239:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.244487:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788607872 00000100:00100000:0.0:1787368099.244498:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788607872 00000100:00100000:0.0:1787368099.244612:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:0.0:1787368099.244622:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+32:15805:x1874190788607872:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368099.244642:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368099.244672:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff03218f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ec99 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.244759:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.244773:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.244782:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.244796:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.244802:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.244808:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.244928:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff0321a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.244937:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff0321a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.244944:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff0321a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368099.244953:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787368099.245029:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245036:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245042:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245048:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.245053:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245059:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245071:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368099.245074:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368099.245078:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245095:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032196 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245109:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245114:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245119:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245123:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ba00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.245126:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245131:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245138:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368099.245141:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368099.245143:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245148:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff03219d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245184:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff03218f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec99 expref: 35 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245209:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff0321a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec99 expref: 34 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.245216:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:0.0:1787368099.245218:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787368099.245220:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ae00, rc 0) 00000100:00100000:0.0:1787368099.245290:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+34:15805:x1874190788607872:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 670us (1060us total) trans 8589934643 rc 0/0 00000100:00100000:0.0:1787368099.245298:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:2.0:1787368099.250326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.250420:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788608000 00000100:00100000:0.0:1787368099.250429:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788608000 00000100:00100000:0.0:1787368099.250482:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:0.0:1787368099.250491:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+34:15805:x1874190788608000:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1787368099.250550:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.250565:0:17164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec76 expref: 34 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.250574:0:17164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.250614:0:17164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec76 expref: 34 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.250628:0:17164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec76 expref: 34 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368099.250850:0:17164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1874190808600448:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787368099.250942:0:17164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787368099.255576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.255716:0:17164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1874190808600448:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787368099.255745:0:17164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368099.256734:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788608256 00000100:00100000:3.0:1787368099.256743:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788608256 00000100:00100000:3.0:1787368099.256958:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1787368099.256966:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+35:14931:x1874190788608256:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787368099.257241:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+36:14931:x1874190788608256:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 275us (1676us total) trans 8589934644 rc 0/0 00000100:00100000:3.0:1787368099.257247:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1787368099.263439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.263547:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788608384 00000100:00100000:2.0:1787368099.263555:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788608384 00010000:00010000:2.0:1787368099.263597:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec76 expref: 36 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368099.263659:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1787368099.263685:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+36:2403:x1874190788608384:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368099.263802:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368099.263810:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec76 expref: 36 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.263824:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec76 expref: 36 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.263844:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032134 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec76 expref: 36 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.263862:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:2.0:1787368099.263867:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.263877:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.263884:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.263969:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368099.264025:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+35:2403:x1874190788608384:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 344us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368099.264033:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00010000:00010000:0.0:1787368099.264848:0:17164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.264859:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.264893:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.264900:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.264906:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.264911:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68aa00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.264915:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.264922:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.264932:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:0.0:1787368099.264935:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787368099.264938:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.264944:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68aa00/0x66f5679bff0321b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368099.265043:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+34:15805:x1874190788608000:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 14551us (14724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368099.265053:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:1.0:1787368099.274323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.274442:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788608640 00000100:00100000:2.0:1787368099.274453:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788608640 00000100:00100000:2.0:1787368099.274517:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:2.0:1787368099.274527:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+34:15805:x1874190788608640:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787368099.274769:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+35:15805:x1874190788608640:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 243us (456us total) trans 8589934645 rc 0/0 00000100:00100000:2.0:1787368099.274777:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:2.0:1787368099.376262:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368099.376539:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788608896 00000100:00100000:1.0:1787368099.376549:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788608896 00000100:00100000:1.0:1787368099.376620:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:1.0:1787368099.376632:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+35:15816:x1874190788608896:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:1.0:1787368099.376659:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368099.376686:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0321b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eca0 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.376774:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.376790:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.376801:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.376839:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.376959:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.376967:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378044:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0321ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378060:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0321ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378069:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0321ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368099.378083:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:1.0:1787368099.378169:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378177:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378184:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378190:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368099.378195:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378218:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378234:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:1.0:1787368099.378237:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368099.378243:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378249:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0321c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378267:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378272:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378278:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378283:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368099.378285:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.378290:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.380298:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5582a23200) 00010000:00010000:1.0:1787368099.380304:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368099.380311:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.380340:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0600/0x66f5679bff0321c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.380449:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0321b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca0 expref: 38 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.380463:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0321ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca0 expref: 37 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.380469:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:1.0:1787368099.380472:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787368099.381322:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0a00, rc 0) 00000100:00100000:1.0:1787368099.381427:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+37:15816:x1874190788608896:12345-192.168.203.4@tcp:101:cat.0 Request processed in 4797us (5171us total) trans 8589934646 rc 0/0 00000100:00100000:1.0:1787368099.381437:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:1.0:1787368099.389957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.390469:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788609152 00000100:00100000:2.0:1787368099.390480:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788609152 00000100:00100000:2.0:1787368099.390543:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1787368099.390554:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+37:15816:x1874190788609152:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:2.0:1787368099.391232:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+38:15816:x1874190788609152:12345-192.168.203.4@tcp:35:cat.0 Request processed in 678us (1284us total) trans 8589934647 rc 0/0 00000100:00100000:2.0:1787368099.391241:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1787368099.463461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368099.463556:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788609408 00000100:00100000:3.0:1787368099.463566:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788609408 00000100:00100000:3.0:1787368099.463635:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:3.0:1787368099.463646:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+38:15817:x1874190788609408:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:3.0:1787368099.463716:0:17162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787368099.463759:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff032157 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec84 expref: 38 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.463802:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0321ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca0 expref: 37 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.463816:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff0321a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec99 expref: 36 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.463829:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68be00/0x66f5679bff032149 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec7d expref: 35 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.463838:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:3.0:1787368099.463843:0:17162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787368099.463871:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.463884:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.463894:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.463906:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.463912:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.463918:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464000:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464011:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464018:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787368099.464218:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 64 off8408 00000004:00080000:3.0:1787368099.464228:0:17162:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 556751871650ns, next at 557751869057ns, rc = 0 00010000:00010000:3.0:1787368099.464272:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464281:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464289:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464296:0:17162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464303:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464309:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464333:0:17162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368099.464413:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464426:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464432:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464439:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241de00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368099.464443:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464451:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.464544:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368099.464551:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.464557:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368099.464560:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.464567:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.464578:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:2.0:1787368099.464580:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787368099.464584:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.464590:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0321f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.464608:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368099.464610:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368099.464611:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368099.464899:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:3.0:1787368099.464903:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787368099.464907:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464913:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff0321ea lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464927:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464932:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464938:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464942:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368099.464951:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464957:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464964:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368099.464967:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368099.464970:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464975:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff0321dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787368099.464984:0:17162:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f577647 reply state 000000001240556f transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.464994:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.465000:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5590ea9100) 00010000:00010000:3.0:1787368099.465002:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787368099.465005:0:17162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787368099.465086:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+36:15817:x1874190788609408:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1439us (1633us total) trans 8589934648 rc 0/0 00000100:00100000:3.0:1787368099.465094:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:3.0:1787368099.528671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.528790:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788609664 00000100:00100000:0.0:1787368099.528800:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788609664 00000100:00100000:0.0:1787368099.528872:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:0.0:1787368099.528883:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+36:15823:x1874190788609664:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1787368099.528908:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368099.528939:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff0321f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eca7 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529036:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529051:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529062:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529073:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529080:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529087:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529614:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529625:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529632:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368099.529641:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787368099.529665:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529672:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529679:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529685:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ba00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.529689:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529697:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529718:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368099.529722:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368099.529726:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529742:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff0321ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787368099.529755:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c14b831 reply state 0000000074073a82 transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529766:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529772:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5590ea9100) 00010000:00010000:0.0:1787368099.529775:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787368099.529778:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787368099.529806:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff0321f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca7 expref: 39 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529820:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca7 expref: 38 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.529827:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368099.529829:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787368099.529831:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b000, rc 0) 00000100:00100000:0.0:1787368099.529893:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+39:15823:x1874190788609664:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1012us (1232us total) trans 8589934649 rc 0/0 00000100:00100000:0.0:1787368099.529902:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1787368099.534303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368099.535090:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788609792 00000100:00100000:3.0:1787368099.535101:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788609792 00000100:00100000:3.0:1787368099.535200:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:3.0:1787368099.535210:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+39:15823:x1874190788609792:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787368099.535252:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368099.535273:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03221b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecae expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.535337:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.535351:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.535435:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787368099.535482:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787368099.535486:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787368099.535504:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.535514:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.535534:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03221b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecae expref: 41 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.535550:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecae expref: 40 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.535558:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:3.0:1787368099.535560:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787368099.535563:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241de00, rc 0) 00000100:00100000:3.0:1787368099.535645:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15823:x1874190788609792:12345-192.168.203.4@tcp:101:bash.0 Request processed in 436us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368099.535652:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:0.0:1787368099.543091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368099.543175:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788610048 00000100:00100000:3.0:1787368099.543189:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788610048 00000100:00100000:3.0:1787368099.543241:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:3.0:1787368099.543248:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+40:15823:x1874190788610048:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:3.0:1787368099.543509:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+41:15823:x1874190788610048:12345-192.168.203.4@tcp:35:bash.0 Request processed in 262us (428us total) trans 8589934650 rc 0/0 00000100:00100000:3.0:1787368099.543514:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1787368099.604499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.604643:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788610304 00000100:00100000:0.0:1787368099.604654:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788610304 00000100:00100000:0.0:1787368099.604733:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:0.0:1787368099.604756:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+41:15836:x1874190788610304:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368099.604780:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368099.604815:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032229 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecb5 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.604915:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032230 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.604929:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032230 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.604940:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032230 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368099.604950:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787368099.605049:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032229 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecb5 expref: 44 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.605064:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032230 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecb5 expref: 43 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.605073:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368099.605076:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787368099.605080:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ba00, rc 0) 00000100:00100000:0.0:1787368099.605151:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15836:x1874190788610304:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 397us (661us total) trans 8589934651 rc 0/0 00000100:00100000:0.0:1787368099.605158:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:1.0:1787368099.607730:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.607828:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788610432 00000100:00100000:0.0:1787368099.607839:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788610432 00000100:00100000:0.0:1787368099.607978:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:0.0:1787368099.607988:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15836:x1874190788610432:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:0.0:1787368099.608051:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.608067:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.608078:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.608111:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.608118:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.608125:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.608131:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.608135:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.608142:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.608152:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368099.608155:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787368099.608159:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.608174:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03223e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368099.608260:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15836:x1874190788610432:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 273us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368099.608267:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:2.0:1787368099.668429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368099.668532:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788610688 00000100:00100000:1.0:1787368099.668542:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788610688 00000100:00100000:1.0:1787368099.668593:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:1.0:1787368099.668603:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15846:x1874190788610688:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1787368099.668622:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368099.668644:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff032245 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecbc expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.668753:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.668781:0:18960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca7 expref: 44 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.668790:0:18960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecae expref: 44 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.668798:0:18960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.668832:0:18960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecae expref: 44 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.668844:0:18960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecae expref: 44 pid: 17162 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368099.668867:0:18960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483713100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808600576:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368099.668976:0:18960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca7 expref: 44 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.668986:0:18960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca7 expref: 44 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368099.668994:0:18960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b30380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808600704:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368099.669018:0:18960:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787368099.671715:0:18960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b30380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808600704:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787368099.672116:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368099.672458:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788610816 00000100:00100000:3.0:1787368099.672465:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788610816 00010000:00010000:3.0:1787368099.672502:0:18318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca7 expref: 45 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368099.672629:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:3.0:1787368099.672640:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+45:2402:x1874190788610816:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368099.672665:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368099.672672:0:18318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca7 expref: 45 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.672685:0:18318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca7 expref: 45 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.672715:0:18318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b000/0x66f5679bff03220d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eca7 expref: 45 pid: 17163 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.672748:0:18318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:3.0:1787368099.672754:0:18318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.672763:0:18318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.672769:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368099.674370:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+44:2402:x1874190788610816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1710us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368099.674384:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1787368099.675276:0:18960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483713100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808600576:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368099.675322:0:18960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368099.675659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.675777:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788610944 00000100:00100000:2.0:1787368099.675784:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788610944 00010000:00010000:2.0:1787368099.675819:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecae expref: 44 pid: 17162 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368099.675850:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1787368099.675870:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+44:2402:x1874190788610944:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368099.675884:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368099.675891:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecae expref: 44 pid: 17162 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.675903:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecae expref: 44 pid: 17162 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.675924:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032222 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecae expref: 44 pid: 17162 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.675939:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368099.675944:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.675963:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.675971:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.675999:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368099.676043:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+43:2402:x1874190788610944:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 184us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368099.676050:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00010000:00010000:1.0:1787368099.676204:0:18960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.676211:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368099.676229:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787368099.676380:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff032245 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecbc expref: 44 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.676399:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecbc expref: 43 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.676406:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787368099.676408:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787368099.676411:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0200, rc 0) 00000100:00100000:1.0:1787368099.676437:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15846:x1874190788610688:12345-192.168.203.4@tcp:101:bash.0 Request processed in 7836us (8018us total) trans 8589934652 rc 0/0 00000100:00100000:1.0:1787368099.676444:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:1.0:1787368099.685443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368099.685678:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788611072 00000100:00100000:3.0:1787368099.685687:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788611072 00000100:00100000:3.0:1787368099.685746:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:3.0:1787368099.685756:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+43:15846:x1874190788611072:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787368099.685779:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368099.685798:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03225a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecc3 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.685830:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.685844:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.685855:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.685979:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03225a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecc3 expref: 45 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.685997:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecc3 expref: 44 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.686006:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:3.0:1787368099.686009:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787368099.686013:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ca00, rc 0) 00000100:00100000:3.0:1787368099.686076:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+44:15846:x1874190788611072:12345-192.168.203.4@tcp:101:bash.0 Request processed in 321us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368099.686083:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:0.0:1787368099.696680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.696800:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788611328 00000100:00100000:2.0:1787368099.696809:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788611328 00000100:00100000:2.0:1787368099.696877:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:2.0:1787368099.696887:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+44:15846:x1874190788611328:12345-192.168.203.4@tcp:36:bash.0 00010000:00010000:2.0:1787368099.697094:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.697111:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.697121:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787368099.697161:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934653 00000004:00010000:2.0:1787368099.697196:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000557a349f reply state 00000000a6828e1c transno 8589934654 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.697209:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.697233:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368099.697236:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787368099.697239:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787368099.697332:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+47:15846:x1874190788611328:12345-192.168.203.4@tcp:36:bash.0 Request processed in 446us (661us total) trans 8589934654 rc 0/0 00000100:00100000:2.0:1787368099.697339:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00000020:00080000:2.0:1787368099.697344:0:17163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787368099.700729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368099.700880:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788611456 00000100:00100000:3.0:1787368099.700890:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788611456 00000100:00100000:3.0:1787368099.700946:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:3.0:1787368099.700956:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+47:15846:x1874190788611456:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787368099.700980:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368099.701000:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03226f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecca expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.701092:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.701108:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecbc expref: 48 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.701117:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.701167:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecbc expref: 48 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.701180:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecbc expref: 48 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368099.701194:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808600832:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368099.701279:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a03fcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787368099.703692:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483da6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808600832:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787368099.703743:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368099.706597:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.706663:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788611584 00000100:00100000:0.0:1787368099.706673:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788611584 00010000:00010000:0.0:1787368099.706724:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecbc expref: 49 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368099.706767:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:0.0:1787368099.706778:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+49:2403:x1874190788611584:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787368099.706793:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368099.706799:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecbc expref: 49 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.706812:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecbc expref: 49 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.706834:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff03224c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecbc expref: 49 pid: 18960 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.707019:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368099.707026:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.707035:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.707043:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.707076:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368099.707131:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+48:2403:x1874190788611584:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 353us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368099.707139:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00010000:00010000:3.0:1787368099.707274:0:17162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.707283:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368099.708220:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787368099.708228:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787368099.708256:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.708293:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c200/0x66f5679bff03226f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecca expref: 48 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.708326:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecca expref: 47 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.708335:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787368099.708337:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787368099.708341:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241de00, rc 0) 00000100:00100000:1.0:1787368099.708473:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+47:15846:x1874190788611456:12345-192.168.203.4@tcp:101:bash.0 Request processed in 7517us (7752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368099.708482:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:2.0:1787368099.711583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.711656:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788611840 00000100:00100000:0.0:1787368099.711664:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788611840 00000100:00100000:0.0:1787368099.711729:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1787368099.711740:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+47:15846:x1874190788611840:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:0.0:1787368099.711961:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+48:15846:x1874190788611840:12345-192.168.203.4@tcp:35:bash.0 Request processed in 223us (387us total) trans 8589934655 rc 0/0 00000100:00100000:0.0:1787368099.711970:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00010000:00010000:2.0:1787368099.736591:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368099.748256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.748399:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788611968 00000100:00100000:2.0:1787368099.748409:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788611968 00000100:00100000:2.0:1787368099.748535:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:2.0:1787368099.748546:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+48:15852:x1874190788611968:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368099.748570:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368099.748598:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03227d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecd1 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.748663:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032284 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.748676:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032284 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.748697:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032284 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368099.748747:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787368099.748761:0:17163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368099.748784:0:17163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032284 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.748806:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff03227d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd1 expref: 50 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.748825:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032284 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd1 expref: 49 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.748838:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:2.0:1787368099.748841:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787368099.748843:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67ec00, rc 0) 00000100:00100000:2.0:1787368099.748904:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+49:15852:x1874190788611968:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 360us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368099.748911:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:2.0:1787368099.752009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.752098:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788612096 00000100:00100000:0.0:1787368099.752108:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788612096 00000100:00100000:0.0:1787368099.752164:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:0.0:1787368099.752175:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+49:15852:x1874190788612096:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368099.752195:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368099.752228:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03228b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecd8 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752308:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752322:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752332:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752343:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752349:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752431:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752505:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752515:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752522:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368099.752570:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787368099.752575:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787368099.752593:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752615:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752717:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752728:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752735:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752742:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.752746:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752755:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752768:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368099.752771:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368099.752775:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752782:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032292 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752798:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752803:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752818:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752824:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368099.752828:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752834:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752842:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5590ea9100) 00010000:00010000:0.0:1787368099.752845:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368099.752848:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752853:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032299 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752884:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff03228b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 51 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752897:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 50 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368099.752905:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368099.752907:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787368099.752909:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a800, rc 0) 00000100:00100000:0.0:1787368099.753028:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+50:15852:x1874190788612096:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 855us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368099.753045:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:3.0:1787368099.756215:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368099.756316:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788612352 00000100:00100000:1.0:1787368099.756325:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788612352 00000100:00100000:1.0:1787368099.756495:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:1.0:1787368099.756506:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+50:15852:x1874190788612352:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787368099.756526:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368099.756544:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0322a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecdf expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.756821:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.756842:0:18960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecca expref: 51 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.756850:0:18960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 51 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.756874:0:18960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.756904:0:18960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 51 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.756918:0:18960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 51 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368099.756931:0:18960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808600960:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368099.757026:0:18960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecca expref: 51 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.757036:0:18960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecca expref: 51 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368099.757045:0:18960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808601088:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368099.757068:0:18960:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743900 going to sleep for 11 seconds 00000100:00100000:3.0:1787368099.757203:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.757767:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788612480 00000100:00100000:2.0:1787368099.757776:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788612480 00010000:00010000:2.0:1787368099.757813:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 52 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368099.757858:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1787368099.757870:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+52:2403:x1874190788612480:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368099.757881:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368099.757887:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 52 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.757917:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 52 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.757938:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368099.757943:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.757950:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.757955:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368099.758083:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+52:2403:x1874190788612480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 132us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368099.758093:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00010000:00010000:1.0:1787368099.760958:0:18960:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.4@tcp) returned -22 from blocking AST (req@0000000098b1b23a x1874190808600960) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 51 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.760982:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a800/0x66f5679bff0322a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd8 expref: 51 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368099.760999:0:18960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b31880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808600960:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368099.761030:0:18960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5582b32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808601088:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368099.761055:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787368099.761060:0:18960:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.761069:0:18960:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.761078:0:18960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368099.761965:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368099.762118:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788612608 00000100:00100000:1.0:1787368099.762128:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788612608 00010000:00010000:1.0:1787368099.762166:0:18318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecca expref: 51 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368099.762299:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1787368099.762310:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+51:2402:x1874190788612608:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368099.762327:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368099.762334:0:18318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecca expref: 51 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.762347:0:18318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecca expref: 51 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.762403:0:18318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241de00/0x66f5679bff032276 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecca expref: 51 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.762506:0:18318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787368099.762511:0:18318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.762520:0:18318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.762528:0:18318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.762561:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787368099.762656:0:18960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.762664:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368099.762681:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787368099.762806:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1600/0x66f5679bff0322a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecdf expref: 52 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.762821:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecdf expref: 51 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.762828:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368099.762836:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787368099.762839:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0200, rc 0) 00000100:00100000:2.0:1787368099.762931:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+51:15852:x1874190788612352:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 6427us (6723us total) trans 8589934656 rc 0/0 00000100:00100000:2.0:1787368099.762940:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:1.0:1787368099.763031:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+50:2402:x1874190788612608:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 722us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368099.763040:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:3.0:1787368099.764985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368099.765076:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788612992 00000100:00100000:0.0:1787368099.765087:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788612992 00000100:00100000:0.0:1787368099.765176:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1787368099.765187:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd754450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+50:15852:x1874190788612992:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787368099.765414:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd754450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+51:15852:x1874190788612992:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 226us (435us total) trans 8589934657 rc 0/0 00000100:00100000:0.0:1787368099.765422:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1787368099.767611:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368099.767793:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788613120 00000100:00100000:3.0:1787368099.767802:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788613120 00000100:00100000:3.0:1787368099.767868:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1787368099.767877:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+51:15852:x1874190788613120:12345-192.168.203.4@tcp:103:lfs.0 00010000:00010000:3.0:1787368099.767892:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368099.767917:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ba00/0x66f5679bff032230 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecb5 expref: 51 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368099.767959:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:3.0:1787368099.767964:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368099.768018:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+50:15852:x1874190788613120:12345-192.168.203.4@tcp:103:lfs.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368099.768025:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1787368099.770064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368099.770266:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788613248 00000100:00100000:1.0:1787368099.770274:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788613248 00000100:00100000:1.0:1787368099.770329:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:1.0:1787368099.770338:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+50:15852:x1874190788613248:12345-192.168.203.4@tcp:58:lfs.0 00010000:00010000:1.0:1787368099.770510:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.770527:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368099.770537:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368099.770950:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:1.0:1787368099.771075:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+50:15852:x1874190788613248:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 736us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368099.771091:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:1.0:1787368099.774198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368099.774293:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788613376 00000100:00100000:2.0:1787368099.774302:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788613376 00000100:00100000:2.0:1787368099.774471:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:2.0:1787368099.774481:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+50:15852:x1874190788613376:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368099.774503:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368099.774525:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ece6 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.774578:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.774589:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ece6 expref: 51 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.774608:0:17163:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.774620:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ece6 expref: 51 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.774633:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368099.774714:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787368099.774732:0:17163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ece6 expref: 51 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368099.774741:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fa00, rc 0) 00000100:00100000:2.0:1787368099.774859:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+51:15852:x1874190788613376:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 372us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368099.774867:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:3.0:1787368100.249986:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787368100.250010:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808601216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368100.250109:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368100.251627:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808601216 00000100:00100000:1.0:1787368100.251640:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808601216 00000100:00100000:1.0:1787368100.251723:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787368100.251733:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808601216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787368100.251779:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787368100.251857:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808601216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.251864:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787368100.251917:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808601216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368100.252626:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368100.252642:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808601344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368100.252690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368100.252879:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808601344 00000100:00100000:3.0:1787368100.252886:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808601344 00000100:00100000:3.0:1787368100.252928:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787368100.252936:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808601344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787368100.252961:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787368100.253009:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808601344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368100.253016:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787368100.253880:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808601344:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787368100.445422:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787368100.445431:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787368100.445457:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1787368100.445466:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787368100.445593:0:17198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd625c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17198:1874190808601472:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787368100.445691:0:17198:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a03fc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368100.451268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368100.451414:0:17198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd625c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17198:1874190808601472:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787368100.453827:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788613504 00000100:00100000:0.0:1787368100.453843:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788613504 00000100:00100000:0.0:1787368100.453930:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:0.0:1787368100.453941:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+51:15853:x1874190788613504:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787368100.453972:0:17164:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787368100.454090:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+51:15853:x1874190788613504:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 150us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368100.454097:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:0.0:1787368100.460671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.460919:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788613632 00000100:00100000:1.0:1787368100.460930:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788613632 00000100:00100000:1.0:1787368100.460996:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:1.0:1787368100.461006:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+51:15853:x1874190788613632:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787368100.461085:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461102:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461113:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461127:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461152:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461160:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461182:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461191:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461198:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368100.461312:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787368100.461317:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787368100.461331:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461342:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461348:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461380:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461387:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368100.461391:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461406:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461418:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c5582a23b00) 00010000:00010000:1.0:1787368100.461421:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368100.461425:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461432:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0a00/0x66f5679bff0322ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461447:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461453:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461460:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461464:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368100.461467:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461474:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461481:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff9c5582a23200) 00010000:00010000:1.0:1787368100.461483:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368100.461486:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461502:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461517:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461524:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461531:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461536:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368100.461540:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461546:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461553:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787368100.461556:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368100.461559:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.461565:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.461635:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+51:15853:x1874190788613632:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 629us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.461642:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 103 00000100:00100000:3.0:1787368100.484890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.484961:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788613888 00000100:00100000:1.0:1787368100.484971:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788613888 00000100:00100000:1.0:1787368100.485034:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:1.0:1787368100.485045:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+51:15853:x1874190788613888:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787368100.485073:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368100.485096:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eced expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485197:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485212:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485223:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368100.485235:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787368100.485308:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485315:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485321:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485326:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368100.485329:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485336:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485401:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787368100.485403:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787368100.485408:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485414:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff0322e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485455:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322df lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eced expref: 53 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485465:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c5582a23b00) 00010000:00010000:1.0:1787368100.485467:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787368100.485470:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff0322df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eced expref: 53 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.485481:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a1800, rc 0) 00000100:00100000:1.0:1787368100.485537:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+52:15853:x1874190788613888:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 495us (659us total) trans 8589934658 rc 301/301 00000100:00100000:1.0:1787368100.485545:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:3.0:1787368100.491186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.492224:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788614016 00000100:00100000:1.0:1787368100.492238:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788614016 00000100:00100000:1.0:1787368100.492311:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:1.0:1787368100.492323:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+52:15853:x1874190788614016:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787368100.492384:0:18960:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787368100.492517:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+52:15853:x1874190788614016:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 195us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.492534:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:0.0:1787368100.495404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.499061:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788614272 00000100:00100000:2.0:1787368100.499077:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788614272 00000100:00100000:2.0:1787368100.499156:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:2.0:1787368100.499167:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+52:15853:x1874190788614272:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787368100.499187:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368100.499190:0:17164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787368100.499217:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ec00/0x66f5679bff032284 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecd1 expref: 52 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.499238:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:2.0:1787368100.499243:0:17164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787368100.499260:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff0322f4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecf4 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787368100.499724:0:17164:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:2.0:1787368100.499731:0:17164:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787368100.499765:0:17164:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787368100.499926:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0322fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.499940:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0322fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.499950:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0322fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.499999:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff0322f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecf4 expref: 54 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.500013:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0322fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecf4 expref: 53 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.500020:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe900) 00010000:00010000:2.0:1787368100.500022:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787368100.500025:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74e00, rc 0) 00000100:00100000:2.0:1787368100.500095:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+53:15853:x1874190788614272:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 930us (4699us total) trans 8589934659 rc 0/0 00000100:00100000:2.0:1787368100.500102:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 106 00000100:00100000:3.0:1787368100.508526:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.508652:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788614528 00000100:00100000:1.0:1787368100.508662:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788614528 00000100:00100000:1.0:1787368100.508725:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:1.0:1787368100.508745:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+53:15853:x1874190788614528:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787368100.508803:0:18960:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368100.508830:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0322fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecf4 expref: 53 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.508851:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe900) 00010000:00010000:1.0:1787368100.508861:0:18960:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787368100.508883:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.508898:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.508923:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.508939:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.508946:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.508952:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509009:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509016:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509022:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509028:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368100.509032:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509039:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509048:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:1.0:1787368100.509062:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368100.509066:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509073:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1800/0x66f5679bff032309 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509084:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509089:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509095:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509107:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368100.509109:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509115:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509123:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x726f2a2d (ffff9c5582a23200) 00010000:00010000:1.0:1787368100.509126:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368100.509129:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.509135:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032310 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x726f2a2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.509211:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+52:15853:x1874190788614528:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 475us (692us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787368100.509219:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 107 00000100:00100000:3.0:1787368100.514437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.514840:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788614656 00000100:00100000:2.0:1787368100.514852:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788614656 00000100:00100000:2.0:1787368100.514930:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:2.0:1787368100.514942:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+52:15853:x1874190788614656:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787368100.514962:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368100.514984:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff032317 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ecfb expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.515038:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.515051:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.515075:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.515181:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff032317 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecfb expref: 54 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.515200:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecfb expref: 53 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.515209:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:2.0:1787368100.515212:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787368100.515216:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75600, rc 0) 00000100:00100000:2.0:1787368100.515283:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+53:15853:x1874190788614656:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 342us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368100.515291:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 108 00000100:00100000:0.0:1787368100.519573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.520261:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788614912 00000100:00100000:1.0:1787368100.520273:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788614912 00000100:00100000:1.0:1787368100.520344:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:1.0:1787368100.520386:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+53:15853:x1874190788614912:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787368100.520477:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.520510:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.520522:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368100.520711:0:18960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787368100.520722:0:18960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 557808366204ns, next at 558808363340ns, rc = 0 00000004:00010000:1.0:1787368100.520781:0:18960:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a10e22a reply state 00000000d0cc24f9 transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.520794:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.520802:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:1.0:1787368100.520805:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787368100.520808:0:18960:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787368100.521104:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+55:15853:x1874190788614912:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 748us (1541us total) trans 8589934660 rc 0/0 00000100:00100000:1.0:1787368100.521112:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:3.0:1787368100.546599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.546728:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788615040 00000100:00100000:2.0:1787368100.546738:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788615040 00000100:00100000:2.0:1787368100.546816:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:2.0:1787368100.546827:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+55:15853:x1874190788615040:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787368100.546854:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368100.546877:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed02 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.546950:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed02 expref: 56 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.546964:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed02 expref: 56 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.546982:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:2.0:1787368100.546985:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787368100.546989:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75a00, rc 0) 00000100:00100000:2.0:1787368100.547059:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+56:15853:x1874190788615040:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 226us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368100.547067:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 110 00000100:00100000:0.0:1787368100.558033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.558169:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788615168 00000100:00100000:2.0:1787368100.558180:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788615168 00000100:00100000:2.0:1787368100.558270:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1787368100.558282:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2403:x1874190788615168:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787368100.558476:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368100.559129:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2403:x1874190788615168:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 846us (1105us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787368100.559141:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1787368100.582827:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368100.582970:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788615424 00000100:00100000:3.0:1787368100.582980:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788615424 00000100:00100000:3.0:1787368100.583041:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:3.0:1787368100.583052:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+56:15853:x1874190788615424:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787368100.583343:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+57:15853:x1874190788615424:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 292us (525us total) trans 8589934661 rc 0/0 00000100:00100000:3.0:1787368100.583351:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:2.0:1787368100.599278:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368100.599350:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788615680 00000100:00100000:0.0:1787368100.599388:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788615680 00000100:00100000:0.0:1787368100.599456:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:0.0:1787368100.599467:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+57:15853:x1874190788615680:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787368100.599602:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+57:15853:x1874190788615680:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 137us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368100.599610:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 111 00000100:00100000:1.0:1787368100.602264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.602386:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788615808 00000100:00100000:2.0:1787368100.602397:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788615808 00000100:00100000:2.0:1787368100.602462:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:2.0:1787368100.602472:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5582b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+57:15853:x1874190788615808:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787368100.602492:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368100.602528:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032333 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed09 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.602603:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03233a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.602619:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03233a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.602629:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03233a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368100.602669:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368100.602687:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03233a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.602725:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032333 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed09 expref: 59 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.602744:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03233a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed09 expref: 58 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.602753:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:2.0:1787368100.602756:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787368100.602760:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75000, rc 0) 00000100:00100000:2.0:1787368100.602825:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5582b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+58:15853:x1874190788615808:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 354us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368100.602833:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 112 00000100:00100000:2.0:1787368100.606726:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368100.606818:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788615936 00000100:00100000:0.0:1787368100.606828:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788615936 00000100:00100000:0.0:1787368100.606897:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1787368100.606907:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2403:x1874190788615936:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787368100.606924:0:18670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368100.606944:0:18670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed10 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787368100.606969:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8912a4, blocks: 0x0 00010000:00010000:0.0:1787368100.606988:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=557s v=(0 0) 00010000:00010000:0.0:1787368100.606992:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368100.607002:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed10 expref: 7 pid: 18670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.607020:0:18670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed10 expref: 7 pid: 18670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.607034:0:18670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b000, rc 0) 00000100:00100000:0.0:1787368100.607091:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2403:x1874190788615936:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 185us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368100.607098:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:3.0:1787368100.611238:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368100.612626:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788616192 00000100:00100000:0.0:1787368100.612657:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788616192 00000100:00100000:0.0:1787368100.613126:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:0.0:1787368100.613138:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+58:15853:x1874190788616192:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787368100.613258:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+58:15853:x1874190788616192:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 121us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368100.613266:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:1.0:1787368100.616506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.616654:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788616320 00000100:00100000:2.0:1787368100.616752:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788616320 00000100:00100000:2.0:1787368100.616816:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1787368100.616827:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:15853:x1874190788616320:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787368100.616846:0:18672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368100.616874:0:18672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed17 expref: -99 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.616906:0:18672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed10 expref: 8 pid: 18670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.616915:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368100.616920:0:18672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368100.616925:0:18672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 8 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.616961:0:18672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed10 expref: 8 pid: 18670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.616976:0:18672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed10 expref: 8 pid: 18670 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368100.616990:0:18672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18672:1874190808601600:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787368100.617072:0:18672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55884df900 going to sleep for 11 seconds 00000100:00100000:1.0:1787368100.620210:0:18672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18672:1874190808601600:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368100.620248:0:18672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 8 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.620269:0:18672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75400, rc 0) 00000100:00100000:1.0:1787368100.620334:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+8:15853:x1874190788616320:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 3508us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.620344:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:3.0:1787368100.622758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368100.622858:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788616448 00000100:00100000:0.0:1787368100.622868:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788616448 00010000:00010000:0.0:1787368100.622910:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed10 expref: 8 pid: 18670 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368100.622951:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1787368100.622960:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+8:2402:x1874190788616448:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787368100.622975:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368100.622997:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed10 expref: 8 pid: 18670 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.623010:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed10 expref: 8 pid: 18670 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.623031:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ec88f2/0x66f5679bff032341 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed10 expref: 8 pid: 18670 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.623048:0:17147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368100.623052:0:17147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368100.623060:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 7 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.623084:0:17147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 7 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.623121:0:17147:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 7 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368100.623135:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483797100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17147:1874190808601728:192.168.203.4@tcp:105: 00000100:00100000:0.0:1787368100.623516:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787368100.629750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368100.629993:0:18675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788616576 00000100:00100000:3.0:1787368100.630001:0:18675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788616576 00002000:00100000:3.0:1787368100.630044:0:18675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->12) req@ffff9c5483796d80 x1874190788616576/t0(0) o4->2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp:741/0 lens 504/0 e 0 to 0 dl 1787368111 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787368100.630054:0:18675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483796d80 with x1874190788616576 ext(0->12) 00002000:00010000:3.0:1787368100.630059:0:18675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c5483796d80 00000100:00100000:3.0:1787368100.630091:0:18675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1787368100.630100:0:18675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+8:2403:x1874190788616576:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787368100.631135:0:18675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+10:2403:x1874190788616576:12345-192.168.203.4@tcp:4:lhsmtool_posix.0 Request processed in 1032us (1390us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787368100.631146:0:18675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00002000:00100000:3.0:1787368100.631162:0:18675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->12) req@ffff9c5483796d80 x1874190788616576/t8589934596(0) o4->2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp:741/0 lens 504/448 e 0 to 0 dl 1787368111 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787368100.631187:0:18675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c5483796d80 with x1874190788616576 ext(0->12) 00002000:00010000:3.0:1787368100.631191:0:18675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c5483796d80 00000100:00100000:1.0:1787368100.632742:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483797100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17147:1874190808601728:192.168.203.4@tcp:105: 00010000:00010000:1.0:1787368100.632890:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368100.632997:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+9:2402:x1874190788616448:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 10037us (10325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.633007:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1787368100.635022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368100.636068:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788616704 00000100:00100000:3.0:1787368100.636081:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788616704 00000100:00100000:3.0:1787368100.636149:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1787368100.637954:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+58:15853:x1874190788616704:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787368100.641383:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934661 is committed 00000004:00080000:1.0:1787368100.641401:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1787368100.641426:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:2.0:1787368100.641533:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641555:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641563:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641570:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368100.641574:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641582:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641599:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c5582a23d00) 00010000:00010000:2.0:1787368100.641602:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368100.641607:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641613:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff0320af lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641640:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641647:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641653:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641658:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68b600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368100.641667:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641685:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641694:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c559aafea00) 00010000:00010000:2.0:1787368100.641696:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368100.641711:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641717:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032150 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641733:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641740:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641745:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641750:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368100.641753:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641821:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641830:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5590ea9100) 00010000:00010000:2.0:1787368100.641834:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368100.641843:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641909:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff0321e3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641923:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641930:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641936:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641942:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368100.641945:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641951:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641959:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c5590ea9100) 00010000:00010000:2.0:1787368100.641961:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368100.641964:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641969:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032206 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.641985:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642001:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642007:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642012:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ea00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368100.642016:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642021:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642030:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368100.642033:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368100.642035:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642042:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032268 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642056:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642062:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642067:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642072:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368100.642081:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642088:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642096:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:2.0:1787368100.642098:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787368100.642101:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.642107:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032325 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787368100.642246:0:17142:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c55bd4b09c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1787368100.642252:0:17142:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55912b7100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c55bd4b0cc0 00000020:00080000:1.0:1787368100.642255:0:17142:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55912b7000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c54845c3400 00000100:00100000:1.0:1787368100.642402:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787368100.642419:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808601856:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787368100.642657:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808601984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787368100.642735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368100.643130:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787368100.643276:0:17202:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1787368100.643345:0:17202:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1787368100.643582:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808601984 00000100:00100000:1.0:1787368100.643590:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808601984 00000100:00100000:1.0:1787368100.643715:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808601856 00000100:00100000:1.0:1787368100.643719:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808601856 00000100:00080000:2.0:1787368100.643765:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787368100.643770:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787368100.644022:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787368100.644034:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808601984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787368100.644149:0:19618:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787368100.644163:0:19618:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787368100 00002000:00010000:3.0:1787368100.644166:0:19618:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787368100.644169:0:19618:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787368100 -> 1787368100 00002000:00010000:3.0:1787368100.644172:0:19618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787368100.644237:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808601984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (1501us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787368100.644245:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787368100.644263:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787368100.644270:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808601856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787368100.644286:0:19618:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:34 count 1 00010000:00010000:3.0:1787368100.644310:0:19618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.644334:0:19618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec8b expref: 7 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.644387:0:19618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787368100.644393:0:19618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787368100.644398:0:19618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.644429:0:19618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec8b expref: 7 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787368100.644637:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c5483def800/2, rc 0, transno 8589934597 00000100:00100000:2.0:1787368100.644645:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808601984:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787368100.645002:0:19618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec8b expref: 7 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368100.645019:0:19618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483defb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19618:1874190808602112:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368100.645092:0:19618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a03fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787368100.646583:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+16:15853:x1874190788616704:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 9732us (11562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368100.646594:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1787368100.650386:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.650418:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788616832 00000100:00100000:2.0:1787368100.650427:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788616832 00010000:00010000:2.0:1787368100.650477:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec8b expref: 8 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368100.650513:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1787368100.650535:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+8:2402:x1874190788616832:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368100.650550:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368100.650556:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec8b expref: 8 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.650569:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec8b expref: 8 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368100.650737:0:19618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483defb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19618:1874190808602112:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368100.651277:0:19618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.651421:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ea602a5/0x66f5679bff03215e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec8b expref: 8 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.651447:0:17149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787368100.651451:0:17149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787368100.651456:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.651466:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.651488:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368100.651548:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2402:x1874190788616832:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1014us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368100.651557:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1787368100.651647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.653278:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788616960 00000100:00100000:1.0:1787368100.653294:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788616960 00000100:00100000:1.0:1787368100.653378:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1787368100.653388:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+9:2403:x1874190788616960:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787368100.656147:0:18666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1787368100.656168:0:18666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000100:00100000:1.0:1787368100.656403:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2403:x1874190788616960:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 3010us (4750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.656415:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1787368100.661515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.661546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.661597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.661623:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.661685:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788617728 00000100:00100000:1.0:1787368100.661697:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788617728 00010000:00010000:0.0:1787368100.664323:0:19618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.664345:0:19618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.664369:0:19618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.664378:0:19618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.664415:0:19618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787368100.664969:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1874190808601856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20695us (21835us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787368100.664994:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787368100.665027:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:0.0:1787368100.665038:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90bfb389-29f4-40ca-b84c-07db457328e3+5:2402:x1874190788617728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368100.665095:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90bfb389-29f4-40ca-b84c-07db457328e3+5:2402:x1874190788617728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 61us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368100.665101:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00010000:00010000:3.0:1787368100.665392:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368100.665400:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.665410:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368100.665421:0:18696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.665431:0:18696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.665461:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.665469:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c75d0aa9/0x66f5679bff03234f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.665493:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368100.665494:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368100.665496:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368100.666010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.666034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368100.666263:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788617216 00000100:00100000:3.0:1787368100.666271:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788617216 00000100:00100000:3.0:1787368100.666313:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788617472 00000100:00100000:3.0:1787368100.666317:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788617472 00000100:00100000:3.0:1787368100.666330:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788617344 00000100:00100000:3.0:1787368100.666332:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788617344 00000100:00100000:3.0:1787368100.666347:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1787368100.666380:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2402:x1874190788617216:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368100.666431:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2402:x1874190788617216:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (4926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368100.666451:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1787368100.666466:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1787368100.666473:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+5:2402:x1874190788617472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368100.666507:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+5:2402:x1874190788617472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (4960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368100.666514:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1787368100.666526:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:3.0:1787368100.666532:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+6:2402:x1874190788617344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368100.666557:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+6:2402:x1874190788617344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368100.666563:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1787368100.669055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.669082:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788617984 00000100:00100000:2.0:1787368100.669091:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788617984 00000100:00100000:2.0:1787368100.669135:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:2.0:1787368100.669143:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+16:15853:x1874190788617984:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787368100.669209:0:17162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368100.669236:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff03233a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed09 expref: 16 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.669260:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:2.0:1787368100.669265:0:17162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787368100.669298:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.669312:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.669322:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.669529:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788617600 00000100:00100000:1.0:1787368100.669543:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788617600 00000004:00010000:2.0:1787368100.669592:0:17162:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000ecbc58 reply state 000000001722ae72 transno 8589934662 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.669604:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.669622:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:2.0:1787368100.669625:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787368100.669628:0:17162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787368100.669737:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+17:15853:x1874190788617984:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 593us (689us total) trans 8589934662 rc 0/0 00000100:00100000:2.0:1787368100.669745:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:0.0:1787368100.670269:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1787368100.670282:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90bfb389-29f4-40ca-b84c-07db457328e3+5:2402:x1874190788617600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368100.670319:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90bfb389-29f4-40ca-b84c-07db457328e3+5:2402:x1874190788617600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (4284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368100.670326:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1787368100.671612:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788617088 00000100:00100000:3.0:1787368100.671624:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788617088 00000100:00100000:3.0:1787368100.671692:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:3.0:1787368100.671713:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2402:x1874190788617088:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368100.671773:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2402:x1874190788617088:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (10148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368100.671780:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 165 00000004:00080000:3.0:1787368100.671839:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c55bc693b80/2, rc 0, transno 8589934601 00000100:00100000:3.0:1787368100.671857:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808601856:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1787368100.673589:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787368100.673598:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787368100.673601:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787368100.673604:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787368100.675006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.675138:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788618112 00000100:00100000:1.0:1787368100.675147:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788618112 00000100:00100000:1.0:1787368100.675211:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:1.0:1787368100.675221:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2403:x1874190788618112:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787368100.675408:0:18672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787368100.675412:0:18672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787368100 -> 1787368100 00002000:00010000:1.0:1787368100.675415:0:18672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787368099 00002000:00010000:1.0:1787368100.675417:0:18672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787368100 -> 1787368100 00002000:00010000:1.0:1787368100.675419:0:18672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787368100.675479:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2403:x1874190788618112:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 260us (481us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787368100.675488:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:2.0:1787368100.679890:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368100.680053:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788618368 00000100:00100000:3.0:1787368100.680062:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788618368 00000100:00100000:3.0:1787368100.680126:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:3.0:1787368100.680137:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+17:15853:x1874190788618368:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787368100.680204:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.680239:0:17162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecfb expref: 17 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.680248:0:17162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.680282:0:17162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecfb expref: 17 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.680296:0:17162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecfb expref: 17 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368100.680311:0:17162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dedf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808602240:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368100.680411:0:17162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a03fc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368100.683346:0:17162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dedf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17162:1874190808602240:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787368100.683407:0:17162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368100.685568:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.686536:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788618496 00000100:00100000:1.0:1787368100.686547:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788618496 00010000:00010000:1.0:1787368100.686594:0:18318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecfb expref: 18 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.686645:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:1.0:1787368100.686655:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+18:2403:x1874190788618496:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368100.686671:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368100.686677:0:18318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecfb expref: 18 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.686722:0:18318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecfb expref: 18 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.686743:0:18318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75600/0x66f5679bff03231e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecfb expref: 18 pid: 17164 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.686761:0:18318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:1.0:1787368100.686766:0:18318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.686774:0:18318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.686782:0:18318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.686813:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368100.686874:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+17:2403:x1874190788618496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 221us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.686882:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00010000:00010000:2.0:1787368100.687776:0:17162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.687787:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.687825:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.687832:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.687839:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.687852:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368100.687857:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.687876:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.687888:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:2.0:1787368100.687892:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787368100.687896:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.687902:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241c600/0x66f5679bff03235d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368100.687967:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+16:15853:x1874190788618368:12345-192.168.203.4@tcp:55:lhsmtool_posix.0 Request processed in 7830us (8084us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787368100.687976:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:2.0:1787368100.690504:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.692876:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788618624 00000100:00100000:1.0:1787368100.692890:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788618624 00000100:00100000:1.0:1787368100.692956:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1787368100.692967:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2402:x1874190788618624:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787368100.693014:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.693050:0:18670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 7 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.693058:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368100.693062:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787368100.693066:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.693100:0:18670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 7 pid: 18672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.693113:0:18670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 7 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.693127:0:18670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18670:1874190808602368:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368100.693226:0:18670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787368100.703859:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.704553:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788618752 00000100:00100000:2.0:1787368100.704564:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788618752 00010000:00010000:2.0:1787368100.704608:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 8 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368100.704656:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1787368100.704666:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+8:2403:x1874190788618752:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368100.704682:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368100.704714:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 8 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.704729:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 8 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.704770:0:17149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787368100.704774:0:17149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787368100.704780:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.704791:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.704812:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368100.704871:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+8:2403:x1874190788618752:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 206us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368100.704879:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00010000:00010000:1.0:1787368100.705149:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b21405d/0x66f5679bff032348 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed17 expref: 7 pid: 18672 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.705165:0:18670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18670:1874190808602368:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368100.705183:0:18670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.705193:0:18670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.705208:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.705227:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.705236:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.705243:0:18670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.705250:0:18670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368100.705255:0:18670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.705264:0:18670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.705277:0:18670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.705285:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aee7148d/0x66f5679bff032364 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.705404:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2402:x1874190788618624:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 12391us (14860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.705413:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:3.0:1787368100.710610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.711608:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788619008 00000100:00100000:1.0:1787368100.711622:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788619008 00000100:00100000:1.0:1787368100.711710:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:1.0:1787368100.711722:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+16:15853:x1874190788619008:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787368100.711795:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.711813:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecc3 expref: 16 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.711823:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.711859:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecc3 expref: 16 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.711872:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecc3 expref: 16 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.711887:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808602496:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368100.711971:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787368100.723046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.723549:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788619136 00000100:00100000:2.0:1787368100.723558:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788619136 00010000:00010000:2.0:1787368100.723600:0:18318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecc3 expref: 17 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368100.723645:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:2.0:1787368100.723655:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+17:2402:x1874190788619136:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368100.723670:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368100.723677:0:18318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecc3 expref: 17 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.723691:0:18318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecc3 expref: 17 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.723758:0:18318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368100.723766:0:18318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ece6 expref: 17 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.723775:0:18318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.723782:0:18318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.723789:0:18318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.723807:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368100.723875:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+17:2402:x1874190788619136:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 221us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368100.723883:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00010000:00010000:1.0:1787368100.723975:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ca00/0x66f5679bff032261 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecc3 expref: 16 pid: 17162 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.724002:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808602496:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368100.724021:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.724030:0:17163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.724036:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.724190:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.724202:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed02 expref: 16 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.724210:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.724235:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed02 expref: 16 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.724248:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed02 expref: 16 pid: 17164 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.724259:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808602624:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368100.724304:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b67436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368100.726932:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808602624:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368100.726960:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368100.728415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.728542:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788619264 00000100:00100000:2.0:1787368100.728550:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788619264 00010000:00010000:2.0:1787368100.728588:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed02 expref: 17 pid: 17164 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368100.728634:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:2.0:1787368100.728644:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+17:2402:x1874190788619264:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368100.728658:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368100.728666:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed02 expref: 17 pid: 17164 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.728715:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed02 expref: 17 pid: 17164 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.728742:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff03232c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed02 expref: 17 pid: 17164 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.728759:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:2.0:1787368100.728765:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.728773:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.728780:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.728808:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368100.728860:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+16:2402:x1874190788619264:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 217us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368100.728868:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00010000:00010000:1.0:1787368100.728925:0:17163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.728933:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787368100.729035:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000001:00080000:1.0:1787368100.729141:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000001:00080000:1.0:1787368100.729173:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934665 00000100:00100000:1.0:1787368100.729242:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17163:1874190808602752:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787368100.729287:0:17163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368100.729316:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b67433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368100.729540:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808602752 00000100:00100000:2.0:1787368100.729545:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808602752 00000100:00100000:2.0:1787368100.729583:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787368100.729591:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:17163:x1874190808602752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787368100.729665:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:17163:x1874190808602752:12345-0@lo:1000:mdt00_001.0 Request processed in 74us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368100.729672:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787368100.729807:0:17163:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787368100.729813:0:17163:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c5483def800, transno 8589934597 00000100:00100000:1.0:1787368100.729832:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17163:1874190808602752:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787368100.729938:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00000100:00100000:1.0:1787368100.729984:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17163:1874190808602880:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787368100.730011:0:17163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368100.730032:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6743300 going to sleep for 11 seconds 00000100:00100000:2.0:1787368100.730075:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808602880 00000100:00100000:2.0:1787368100.730079:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808602880 00000100:00100000:2.0:1787368100.730110:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787368100.730127:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:17163:x1874190808602880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787368100.730241:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17163:x1874190808602880:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (228us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787368100.730248:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787368100.730282:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17163:1874190808602880:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787368100.730314:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730323:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730330:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730345:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368100.730370:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730380:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730394:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:3.0:1787368100.730397:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787368100.730402:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730409:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0e00/0x66f5679bff032372 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730436:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730442:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730448:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730453:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368100.730456:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730463:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730484:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:3.0:1787368100.730486:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787368100.730493:0:17163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ece6 expref: 19 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730514:0:17163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ece6 expref: 19 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730521:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ece6 expref: 19 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.730545:0:17163:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ece6 expref: 19 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368100.730557:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808603008:192.168.203.4@tcp:105: 00000100:00100000:3.0:1787368100.730842:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a03fc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787368100.735004:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.735073:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1874190808603008:192.168.203.4@tcp:105: 00010000:00010000:1.0:1787368100.735107:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735120:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0400/0x66f5679bff0322bc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735177:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735192:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735203:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735212:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735218:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735226:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735232:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368100.735236:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735243:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735254:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787368100.735257:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368100.735261:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735267:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1a00/0x66f5679bff032379 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735283:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735291:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735297:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735302:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368100.735306:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735312:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735320:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787368100.735323:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787368100.735326:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.735332:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a1200/0x66f5679bff03236b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.735659:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15853:x1874190788619008:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 23938us (25058us total) trans 8589934667 rc 0/0 00000100:00100000:1.0:1787368100.735670:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000020:00080000:1.0:1787368100.735676:0:17163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787368100.735802:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787368100.735807:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787368100.735841:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1787368100.735850:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787368100.736003:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788619392 00000100:00100000:0.0:1787368100.736011:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788619392 00000100:00100000:0.0:1787368100.736057:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1787368100.736066:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15852:x1874190788619392:12345-192.168.203.4@tcp:49:lfs.0 00000100:00100000:0.0:1787368100.736162:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15852:x1874190788619392:12345-192.168.203.4@tcp:49:lfs.0 Request processed in 97us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368100.736170:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:3.0:1787368100.739419:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368100.739453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368100.739568:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788619648 00000100:00100000:0.0:1787368100.739577:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788619648 00000100:00100000:0.0:1787368100.739632:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:0.0:1787368100.739668:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+19:15853:x1874190788619648:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787368100.740006:0:17165:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787368100.740037:0:17165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00010000:00010000:0.0:1787368100.740082:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.740098:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.740109:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.740118:0:17165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.740125:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.740133:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368100.740160:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787368100.740242:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15853:x1874190788619648:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 601us (831us total) trans 8589934669 rc 0/0 00000100:00100000:0.0:1787368100.740251:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000020:00080000:0.0:1787368100.740256:0:17165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787368100.740562:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788619904 00000100:00100000:1.0:1787368100.740567:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788619904 00000100:00100000:1.0:1787368100.740612:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:1.0:1787368100.740620:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15852:x1874190788619904:12345-192.168.203.4@tcp:58:lfs.0 00000040:00080000:1.0:1787368100.740732:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 136 off8600 00000100:00100000:1.0:1787368100.740775:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15852:x1874190788619904:12345-192.168.203.4@tcp:58:lfs.0 Request processed in 156us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.740783:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00010000:00010000:3.0:1787368100.742255:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368100.742266:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.742297:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68b800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368100.742302:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.742312:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.742329:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:3.0:1787368100.742332:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787368100.742337:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.742343:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b800/0x66f5679bff032380 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.742372:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368100.742375:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368100.742376:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368100.760599:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368100.783138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.783385:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788620032 00000100:00100000:2.0:1787368100.783396:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788620032 00000100:00100000:2.0:1787368100.783464:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:2.0:1787368100.783473:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+21:15855:x1874190788620032:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368100.783497:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368100.783515:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff032387 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed1e expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783575:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783590:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783600:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783615:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783622:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783642:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783724:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783734:0:18960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecdf expref: 22 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783742:0:18960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783771:0:18960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecdf expref: 22 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368100.783783:0:18960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecdf expref: 22 pid: 18960 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368100.783796:0:18960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808603136:192.168.203.4@tcp:104: 00000100:00100000:2.0:1787368100.783865:0:18960:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5482392b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787368100.788720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368100.788835:0:18960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18960:1874190808603136:192.168.203.4@tcp:104: 00010000:00010000:2.0:1787368100.788872:0:18960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368100.789079:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788620288 00000100:00100000:3.0:1787368100.789086:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788620288 00000100:00100000:3.0:1787368100.789135:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1787368100.789144:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+23:15671:x1874190788620288:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787368100.789335:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+24:15671:x1874190788620288:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 191us (635us total) trans 8589934670 rc 0/0 00000100:00100000:3.0:1787368100.789343:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1787368100.794223:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368100.794319:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788620416 00000100:00100000:1.0:1787368100.794330:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788620416 00010000:00010000:1.0:1787368100.794408:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecdf expref: 24 pid: 18960 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368100.794456:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:1.0:1787368100.794466:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+24:2402:x1874190788620416:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368100.794482:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368100.794489:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecdf expref: 24 pid: 18960 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.794502:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecdf expref: 24 pid: 18960 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.794524:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55814a0200/0x66f5679bff0322ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ecdf expref: 24 pid: 18960 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.794542:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:1.0:1787368100.794548:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.794557:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.794579:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368100.794613:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368100.794658:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+23:2402:x1874190788620416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 193us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368100.794666:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00010000:00010000:3.0:1787368100.794784:0:18960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794799:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787368100.794857:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787368100.794862:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787368100.794881:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794894:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794904:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794911:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794918:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794924:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368100.794928:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794934:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794943:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:3.0:1787368100.794946:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368100.794949:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794966:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff03238e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794980:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794987:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794993:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.794998:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368100.795001:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.795007:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.795015:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c559aafea00) 00010000:00010000:3.0:1787368100.795018:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368100.795021:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.795027:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff032395 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.795178:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff032387 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed1e expref: 23 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.795202:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed1e expref: 22 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368100.795209:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:3.0:1787368100.795212:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787368100.795214:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75400, rc 0) 00000100:00100000:3.0:1787368100.795239:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+22:15855:x1874190788620032:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 11768us (12111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368100.795246:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000040:00080000:1.0:1787368101.519922:0:20445:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787368101.519931:0:20445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787368101.519963:0:20445:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1787368101.519970:0:20445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1787368101.784593:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787368101.784602:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787368101.784626:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1787368101.784636:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787368101.784771:0:17198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17198:1874190808603264:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787368101.785251:0:17198:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a03fc3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787368101.786559:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368101.786759:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808603520:0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.786815:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368101.786854:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808604032:0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.786876:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368101.787064:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808603392:0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.787101:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368101.787128:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808603904:0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.787152:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368101.787303:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808603776:0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.787338:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368101.787339:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808603904 00000100:00100000:1.0:1787368101.787348:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808603904 00000100:00100000:2.0:1787368101.787401:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808604288:0@lo:400:kworker.0 00000100:00100000:1.0:1787368101.787433:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787368101.787439:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368101.787446:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808603904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.787462:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808604800:0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.787483:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368101.787507:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808605312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787368101.787528:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368101.787554:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808603648:0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.787575:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368101.787590:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808604160:0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.787609:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368101.787625:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808604672:0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.787645:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368101.787662:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808605184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787368101.787681:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368101.787712:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368101.787718:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808605056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787368101.787739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368101.787762:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808603520 00000100:00100000:2.0:1787368101.787766:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808603520 00000100:00100000:2.0:1787368101.787791:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808604032 00000100:00100000:2.0:1787368101.787793:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808604032 00000100:00100000:2.0:1787368101.787805:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787368101.787810:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808603520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.787855:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808603520:12345-0@lo:400:kworker.0 Request processed in 45us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368101.787861:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787368101.787882:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787368101.787888:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808604032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.788114:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808604416:0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.788150:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368101.788163:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808604928:0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.788329:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368101.788370:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808603392 00000100:00100000:0.0:1787368101.788375:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808603392 00000100:00100000:0.0:1787368101.788418:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787368101.788425:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+24:3654:x1874190808603392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.788459:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3ce871c-8318-4c29-9238-0157d9966155+24:3654:x1874190808603392:12345-0@lo:400:kworker.0 Request processed in 35us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368101.788465:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787368101.788492:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808603776 00000100:00100000:0.0:1787368101.788495:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808603776 00000100:00100000:0.0:1787368101.788518:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808604288 00000100:00100000:0.0:1787368101.788522:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808604288 00000100:00100000:0.0:1787368101.788540:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808603648 00000100:00100000:0.0:1787368101.788543:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808603648 00000100:00100000:0.0:1787368101.788553:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808604160 00000100:00100000:0.0:1787368101.788555:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808604160 00000100:00100000:0.0:1787368101.788567:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787368101.788573:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3653:x1874190808603776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.788609:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3653:x1874190808603776:12345-0@lo:400:kworker.0 Request processed in 37us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368101.788615:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787368101.788625:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787368101.788631:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808604288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.788657:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808604288:12345-0@lo:400:kworker.0 Request processed in 26us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368101.788675:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787368101.788686:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787368101.788702:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808603648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.788738:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808603648:12345-0@lo:400:kworker.0 Request processed in 46us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368101.788743:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787368101.788754:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787368101.788759:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808604160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368101.788783:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808604160:12345-0@lo:400:kworker.0 Request processed in 25us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368101.788788:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787368101.788807:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808605312 00000100:00100000:0.0:1787368101.788811:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808605312 00000100:00100000:0.0:1787368101.788825:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808605184 00000100:00100000:0.0:1787368101.788827:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808605184 00000100:00100000:1.0:1787368101.788930:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808603904:12345-0@lo:400:kworker.0 Request processed in 1486us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368101.788939:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787368101.788953:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808604800 00000100:00100000:1.0:1787368101.788956:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808604800 00000100:00100000:1.0:1787368101.788974:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808604672 00000100:00100000:1.0:1787368101.788977:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808604672 00000100:00100000:1.0:1787368101.788987:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808604416 00000100:00100000:1.0:1787368101.788989:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808604416 00000100:00100000:1.0:1787368101.789000:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808604928 00000100:00100000:1.0:1787368101.789002:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808604928 00000100:00100000:1.0:1787368101.789017:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787368101.789023:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808604800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368101.789278:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808604800:12345-0@lo:400:kworker.0 Request processed in 253us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368101.789286:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787368101.789302:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787368101.789310:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808604672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368101.789340:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808604672:12345-0@lo:400:kworker.0 Request processed in 32us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368101.789346:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787368101.789438:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787368101.789446:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808604416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368101.790149:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808604416:12345-0@lo:400:kworker.0 Request processed in 702us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368101.790156:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787368101.790173:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787368101.790179:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808604928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368101.790211:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808604928:12345-0@lo:400:kworker.0 Request processed in 33us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368101.790216:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787368101.790249:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787368101.790253:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787368101.790256:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787368101.790259:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787368101.790530:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808604032:12345-0@lo:400:kworker.0 Request processed in 2641us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368101.790538:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787368101.790569:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787368101.790578:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808605312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787368101.790600:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787368101.790635:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808605312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (3107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368101.790643:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787368101.790660:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787368101.790667:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808605184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787368101.790670:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808603392:0@lo:400:kworker.0 00002000:00000024:2.0:1787368101.790685:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787368101.790701:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808603904:0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.790731:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808605184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368101.790737:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787368101.790783:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808605312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787368101.790796:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808603776:0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.790807:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808604288:0@lo:400:kworker.0 00000100:00100000:2.0:1787368101.790817:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808604800:0@lo:400:kworker.0 00000100:00100000:1.0:1787368101.792304:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808604416:0@lo:400:kworker.0 00010000:00080000:1.0:1787368101.792352:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55acbf6300 x1874190808604928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368101.792389:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808604928:0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.792864:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808604544:0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.793317:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368101.793378:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808603520:0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.793404:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808604032:0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.793452:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808604544 00000100:00100000:3.0:1787368101.793458:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808604544 00000100:00100000:3.0:1787368101.793514:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787368101.793522:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808604544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.793570:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808604544:12345-0@lo:400:kworker.0 Request processed in 49us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368101.793577:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787368101.793595:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787368101.793615:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808604544:0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.793657:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808603648:0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.793669:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808604160:0@lo:400:kworker.0 00010000:00080000:3.0:1787368101.793682:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55acbf4a80 x1874190808604672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368101.793705:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808604672:0@lo:400:kworker.0 00000100:00100000:3.0:1787368101.793724:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808605184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787368101.793793:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808605056 00000100:00100000:0.0:1787368101.793799:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808605056 00000100:00100000:0.0:1787368101.793839:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787368101.793846:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808605056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787368101.793859:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787368101.794909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368101.794939:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788620544 00000100:00100000:2.0:1787368101.794945:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788620544 00000100:00100000:2.0:1787368101.795021:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:2.0:1787368101.795030:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5585101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+23:15867:x1874190788620544:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787368101.795060:0:17162:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787368101.795175:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+23:15867:x1874190788620544:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 137us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368101.795183:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00080000:2.0:1787368101.795203:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787368101.795600:0:17198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17198:1874190808603264:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787368101.800169:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5585100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808605056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6307us (12412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368101.800184:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787368101.801966:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808605056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787368101.815582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368101.820104:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788620800 00000100:00100000:3.0:1787368101.820119:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788620800 00000100:00100000:2.0:1787368101.820336:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:2.0:1787368101.820349:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+22:15867:x1874190788620800:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787368101.820525:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368101.820547:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff0323a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed25 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368101.820651:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368101.820665:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368101.820677:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368101.820689:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787368101.820800:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff0323a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed25 expref: 25 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368101.820819:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed25 expref: 24 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368101.820847:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368101.820849:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787368101.820854:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75000, rc 0) 00000100:00100000:2.0:1787368101.821606:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+24:15867:x1874190788620800:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1258us (6030us total) trans 8589934671 rc 0/0 00000100:00100000:2.0:1787368101.821615:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:1.0:1787368101.829453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368101.829667:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788621056 00000100:00100000:3.0:1787368101.829677:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788621056 00000100:00100000:3.0:1787368101.829740:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:3.0:1787368101.829750:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+24:15867:x1874190788621056:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787368101.829821:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.829855:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.829868:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.830015:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.830023:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.830031:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.830037:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368101.830042:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.830049:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.830062:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:3.0:1787368101.830065:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787368101.830069:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.830074:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241ce00/0x66f5679bff0323b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368101.830619:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+25:15867:x1874190788621056:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 868us (1173us total) trans 8589934672 rc 0/0 00000100:00100000:3.0:1787368101.830636:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000040:00080000:1.0:1787368101.831637:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787368101.831644:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787368101.832129:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 4 00000040:00080000:1.0:1787368101.832140:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787368101.836679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368101.836776:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368101.837058:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788621184 00000100:00100000:3.0:1787368101.837069:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788621184 00000100:00100000:3.0:1787368101.837131:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1787368101.837142:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+25:2402:x1874190788621184:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368101.837156:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368101.837190:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed25 expref: 25 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368101.837211:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:3.0:1787368101.837216:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368101.837264:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+24:2402:x1874190788621184:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 125us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368101.837272:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1787368101.837642:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788621440 00000100:00100000:1.0:1787368101.837648:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788621440 00000100:00100000:1.0:1787368101.837689:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1787368101.837707:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+24:15867:x1874190788621440:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787368101.839325:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+25:15867:x1874190788621440:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1183us (2113us total) trans 8589934673 rc 0/0 00000100:00100000:1.0:1787368101.839340:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00010000:00010000:3.0:1787368102.810118:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787368102.811499:0:19486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:3.0:1787368102.811726:0:19486:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000040:00080000:2.0:1787368103.415787:0:20496:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787368103.415796:0:20496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787368103.415828:0:20496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1787368103.415838:0:20496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787368103.596920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368103.596982:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788621696 00000100:00100000:2.0:1787368103.596992:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788621696 00000100:00100000:2.0:1787368103.597069:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:2.0:1787368103.597081:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+25:15888:x1874190788621696:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368103.597104:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368103.597125:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff0323bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed2c expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.597241:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0323c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.597258:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0323c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.597271:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0323c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368103.597302:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000100:00080000:3.0:1787368103.597875:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787368103.598003:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75a00/0x66f5679bff0323bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed2c expref: 28 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.598024:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0323c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed2c expref: 27 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.598033:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368103.598036:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787368103.598039:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74e00, rc 0) 00000100:00100000:2.0:1787368103.598105:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+27:15888:x1874190788621696:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1026us (1195us total) trans 8589934674 rc 0/0 00000100:00100000:2.0:1787368103.598113:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:0.0:1787368103.600459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368103.600775:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788621824 00000100:00100000:2.0:1787368103.600785:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788621824 00000100:00100000:2.0:1787368103.600832:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:2.0:1787368103.600843:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+27:15888:x1874190788621824:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1787368103.600911:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.600941:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.600954:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.601003:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.601018:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.601025:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.601032:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368103.601036:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.601044:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.601057:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:2.0:1787368103.601061:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787368103.601065:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368103.601072:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75000/0x66f5679bff0323d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368103.601143:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+27:15888:x1874190788621824:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 301us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368103.601153:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:3.0:1787368103.732507:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368103.732629:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788621952 00000100:00100000:0.0:1787368103.732638:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788621952 00000100:00100000:0.0:1787368103.732732:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:0.0:1787368103.732743:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2405:x1874190788621952:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1787368103.732760:0:19618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368103.732781:0:19618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f40291a9/0x66f5679bff0323db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed33 expref: -99 pid: 19618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787368103.732805:0:19618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 13, mtime: 0x6a8912a4, atime: 0x6a8912a3, ctime: 0x6a8912a4, blocks: 0x8 00010000:00010000:0.0:1787368103.732822:0:19618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1787368103.732838:0:19618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368103.732848:0:19618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40291a9/0x66f5679bff0323db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed33 expref: 7 pid: 19618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368103.732867:0:19618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f40291a9/0x66f5679bff0323db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed33 expref: 7 pid: 19618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368103.732879:0:19618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a800, rc 0) 00000100:00100000:0.0:1787368103.733226:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2405:x1874190788621952:12345-192.168.203.4@tcp:101:cat.0 Request processed in 485us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368103.733233:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00080000:3.0:1787368103.733299:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787368103.738208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368103.740496:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788622080 00000100:00100000:2.0:1787368103.740510:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788622080 00002000:00100000:2.0:1787368103.740567:0:18677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x22:0x0] (0->4095) req@ffff9c55acbf5c00 x1874190788622080/t0(0) o3->2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp:744/0 lens 488/0 e 0 to 0 dl 1787368114 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787368103.740578:0:18677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c55acbf5c00 with x1874190788622080 ext(0->4095) 00002000:00010000:2.0:1787368103.740596:0:18677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c55acbf5c00 00000100:00100000:2.0:1787368103.740892:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1787368103.740904:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2405:x1874190788622080:12345-192.168.203.4@tcp:3:cat.0 00000100:00100000:2.0:1787368103.741102:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2405:x1874190788622080:12345-192.168.203.4@tcp:3:cat.0 Request processed in 201us (2903us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787368103.741111:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00002000:00100000:2.0:1787368103.741118:0:18677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x22:0x0] (0->4095) req@ffff9c55acbf5c00 x1874190788622080/t0(0) o3->2d5a7807-1963-49fe-bc72-734aca1edb48@192.168.203.4@tcp:744/0 lens 488/4536 e 0 to 0 dl 1787368114 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787368103.741127:0:18677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c55acbf5c00 with x1874190788622080 ext(0->4095) 00002000:00010000:2.0:1787368103.741130:0:18677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c55acbf5c00 00010000:00010000:3.0:1787368103.832692:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787368103.896623:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787368103.896632:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787368103.896653:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1787368103.896662:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787368104.344848:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787368104.344872:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808605440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787368104.344939:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368104.345226:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808605440 00000100:00100000:2.0:1787368104.345234:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808605440 00000100:00100000:2.0:1787368104.345305:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787368104.345315:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808605440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787368104.345345:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787368104.345420:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808605440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368104.345426:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787368104.345487:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787368104.345758:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808605440:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787368104.857144:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787368105.117968:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787368105.368841:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808605568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787368105.369146:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368105.369336:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808605696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368105.369406:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368105.369482:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808605568 00000100:00100000:2.0:1787368105.369490:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808605568 00000100:00100000:2.0:1787368105.369537:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808605696 00000100:00100000:2.0:1787368105.369540:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808605696 00000100:00100000:2.0:1787368105.369553:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787368105.369561:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808605568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368105.369608:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787368105.369697:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787368105.369707:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808605696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787368105.369724:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787368105.369755:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808605696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368105.369762:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787368105.369998:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808605696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368105.370299:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808605568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 737us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368105.370315:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787368105.370398:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808605568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368105.790927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368105.790974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368105.791007:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368105.791028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368105.791044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368105.791063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368105.791083:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368105.791108:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788622720 00000100:00100000:1.0:1787368105.791116:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788622720 00000100:00100000:1.0:1787368105.791161:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788622592 00000100:00100000:1.0:1787368105.791165:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788622592 00000100:00100000:1.0:1787368105.791186:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1787368105.791195:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2403:x1874190788622720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368105.791258:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2403:x1874190788622720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 64us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368105.791266:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1787368105.791280:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1787368105.791286:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2403:x1874190788622592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368105.791309:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+7:2403:x1874190788622592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368105.791314:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1787368105.791330:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788622464 00000100:00100000:1.0:1787368105.791334:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788622464 00000100:00100000:1.0:1787368105.791380:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788622976 00000100:00100000:1.0:1787368105.791383:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788622976 00000100:00100000:1.0:1787368105.791397:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788622336 00000100:00100000:1.0:1787368105.791416:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788622336 00000100:00100000:1.0:1787368105.791432:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788622848 00000100:00100000:1.0:1787368105.791434:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788622848 00000100:00100000:2.0:1787368105.791757:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788622208 00000100:00100000:2.0:1787368105.791762:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788622208 00000100:00100000:2.0:1787368105.791792:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:2.0:1787368105.791798:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2403:x1874190788622208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368105.791837:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2403:x1874190788622208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368105.791844:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:2.0:1787368105.791874:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:2.0:1787368105.791881:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2403:x1874190788622464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368105.791907:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2403:x1874190788622464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368105.791913:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:2.0:1787368105.791926:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:2.0:1787368105.791933:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+5:2403:x1874190788622976:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368105.791956:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+5:2403:x1874190788622976:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368105.791961:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:2.0:1787368105.791972:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1787368105.791978:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+27:2403:x1874190788622336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368105.791999:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+27:2403:x1874190788622336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368105.792005:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1787368105.792025:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:2.0:1787368105.792031:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:2403:x1874190788622848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368105.792055:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:2403:x1874190788622848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368105.792061:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00080000:2.0:1787368105.792103:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787368105.792106:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787368105.792109:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787368105.792111:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787368105.795821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368105.796011:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788623104 00000100:00100000:1.0:1787368105.796021:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788623104 00000100:00100000:1.0:1787368105.796087:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:1.0:1787368105.796097:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90bfb389-29f4-40ca-b84c-07db457328e3+5:2401:x1874190788623104:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:1.0:1787368105.796125:0:19618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031d4b 00000100:00080000:1.0:1787368105.796140:0:19618:0:(import.c:65:import_set_state_nolock()) ffff9c55acb11000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787368105.796181:0:19618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1787368105.796328:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90bfb389-29f4-40ca-b84c-07db457328e3+2:2401:x1874190788623104:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 232us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368105.796336:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00010000:00010000:1.0:1787368105.796378:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368105.796618:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368105.796900:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788623232 00000100:00100000:0.0:1787368105.796905:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788623232 00000100:00100000:0.0:1787368105.796948:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1787368105.796958:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2401:x1874190788623232:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:0.0:1787368105.796973:0:19223:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031d52 00000100:00080000:0.0:1787368105.796985:0:19223:0:(import.c:65:import_set_state_nolock()) ffff9c55acb12000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1787368105.797030:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787368105.797035:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1787368105.797207:0:19223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:0.0:1787368105.797379:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90bfb389-29f4-40ca-b84c-07db457328e3+2:2401:x1874190788623232:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 398us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368105.797388:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00010000:00010000:1.0:1787368105.799403:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787368105.805712:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 90bfb389-29f4-40ca-b84c-07db457328e3 00000020:00000080:0.0:1787368105.805721:0:18666:0:(genops.c:885:class_export_put()) final put ffff9c55acb15000/90bfb389-29f4-40ca-b84c-07db457328e3 00000001:00080000:0.0:1787368105.805751:0:18666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1787368105.805759:0:18666:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000020:00000080:1.0:1787368105.805799:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55acb15000/90bfb389-29f4-40ca-b84c-07db457328e3 for lustre-OST0000 00000020:00000080:1.0:1787368105.805855:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55acb11000 for lustre-OST0000 00010000:00010000:2.0:1787368105.886137:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368106.904600:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368106.907028:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787368106.907052:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808605824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787368106.907121:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368106.907197:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808605824 00000100:00100000:0.0:1787368106.907204:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808605824 00000100:00100000:0.0:1787368106.907260:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787368106.907269:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808605824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787368106.907301:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787368106.907347:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808605824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368106.907378:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787368106.907427:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808605824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787368106.907895:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808606208:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.907933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.907953:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808606720:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.907973:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.907990:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808607232:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908044:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787368106.908049:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808606080:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908116:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808606592:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908155:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808607104:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908176:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908203:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808606208 00000100:00100000:1.0:1787368106.908207:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808606208 00000100:00100000:1.0:1787368106.908242:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808606720 00000100:00100000:1.0:1787368106.908246:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808606720 00000100:00100000:1.0:1787368106.908265:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787368106.908271:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808606208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908310:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808606208:12345-0@lo:400:kworker.0 Request processed in 39us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.908317:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787368106.908331:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787368106.908337:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808606720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908385:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808606720:12345-0@lo:400:kworker.0 Request processed in 48us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.908392:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787368106.908410:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808606080 00000100:00100000:1.0:1787368106.908414:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808606080 00000100:00100000:1.0:1787368106.908434:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808606592 00000100:00100000:1.0:1787368106.908436:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808606592 00000100:00100000:1.0:1787368106.908449:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787368106.908454:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808606080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908485:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808606080:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.908491:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787368106.908512:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787368106.908518:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808606592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908545:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808606592:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.908551:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787368106.908575:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808605952:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908603:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908624:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808606464:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908645:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908672:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808606976:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908694:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908711:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787368106.908717:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808606336:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908739:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908753:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808606848:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908771:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908780:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808607360:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908824:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.908849:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808605952 00000100:00100000:1.0:1787368106.908852:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808605952 00000100:00100000:1.0:1787368106.908877:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787368106.908883:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:3654:x1874190808605952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.908917:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:3654:x1874190808605952:12345-0@lo:400:kworker.0 Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.908923:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787368106.908959:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808607232 00000100:00100000:1.0:1787368106.908963:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808607232 00000100:00100000:1.0:1787368106.908984:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808607104 00000100:00100000:1.0:1787368106.908987:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808607104 00000100:00100000:1.0:1787368106.908999:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808606464 00000100:00100000:1.0:1787368106.909002:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808606464 00000100:00100000:1.0:1787368106.909013:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808606976 00000100:00100000:1.0:1787368106.909015:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808606976 00000100:00100000:1.0:1787368106.909025:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808606848 00000100:00100000:1.0:1787368106.909027:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808606848 00000100:00100000:1.0:1787368106.909036:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808607360 00000100:00100000:1.0:1787368106.909038:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808607360 00000100:00100000:1.0:1787368106.909051:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787368106.909057:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808607232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909087:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808607232:12345-0@lo:400:kworker.0 Request processed in 30us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.909093:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787368106.909106:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787368106.909113:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808607104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909137:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808607104:12345-0@lo:400:kworker.0 Request processed in 26us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.909143:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787368106.909154:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787368106.909160:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808606464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909184:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808606464:12345-0@lo:400:kworker.0 Request processed in 25us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.909190:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787368106.909201:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787368106.909206:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808606976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909242:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808606976:12345-0@lo:400:kworker.0 Request processed in 35us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.909248:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787368106.909261:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787368106.909266:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808606848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909292:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808606848:12345-0@lo:400:kworker.0 Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.909298:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787368106.909309:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787368106.909315:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808607360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909342:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808607360:12345-0@lo:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.909347:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787368106.909404:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808606080:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909415:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808606592:0@lo:400:kworker.0 00010000:00080000:1.0:1787368106.909426:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55acbf6a00 x1874190808607104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368106.909436:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808607104:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909446:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934599 gen 2 00000004:00080000:1.0:1787368106.909451:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934599 00000100:00100000:1.0:1787368106.909468:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808606208:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909480:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808606720:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909489:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808607232:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909531:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808606848:0@lo:400:kworker.0 00010000:00080000:1.0:1787368106.909541:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cec000 x1874190808607360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368106.909549:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808607360:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909558:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808605952:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909567:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808606464:0@lo:400:kworker.0 00000100:00100000:1.0:1787368106.909575:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808606976:0@lo:400:kworker.0 00000100:00080000:2.0:1787368106.910050:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787368106.910056:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787368106.910058:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787368106.910061:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787368106.910073:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808606336 00000100:00100000:2.0:1787368106.910078:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808606336 00000100:00100000:2.0:1787368106.910119:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787368106.910127:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808606336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368106.910175:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808606336:12345-0@lo:400:kworker.0 Request processed in 49us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368106.910182:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787368106.910217:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787368106.910223:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368106.910233:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808607488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787368106.910268:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368106.910299:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808607488 00000100:00100000:2.0:1787368106.910304:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808607488 00000100:00100000:2.0:1787368106.910338:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787368106.910345:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808607488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787368106.910380:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787368106.910419:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808607488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368106.910425:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787368106.910453:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 2 00000004:00080000:2.0:1787368106.910458:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934601 00000004:00080000:2.0:1787368106.910472:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c55bc693b80, transno 8589934601 00000100:00100000:2.0:1787368106.910490:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808607488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787368106.910617:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808606336:0@lo:400:kworker.0 00000100:00100000:3.0:1787368106.914330:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787368106.914351:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808607616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787368106.914446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368106.914574:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808607616 00000100:00100000:1.0:1787368106.914582:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808607616 00000100:00100000:1.0:1787368106.914632:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787368106.914641:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808607616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787368106.914695:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787368106.914789:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808607616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368106.914796:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000001:00080000:0.0:1787368106.920621:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934674 is committed 00000020:00080000:0.0:1787368106.920686:0:17142:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c55b67433c0 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:0.0:1787368106.920692:0:17142:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55ad9ea900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c55b6743d80 00000020:00080000:0.0:1787368106.920696:0:17142:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c55ad9eab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c548447f200 00000020:00080000:0.0:1787368106.920711:0:17142:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00010000:00010000:2.0:1787368106.920822:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368106.920835:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368106.920843:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368106.920849:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368106.920854:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368106.920862:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368106.920877:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9c559aafe800) 00010000:00010000:2.0:1787368106.920881:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368106.920894:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368106.920901:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75200/0x66f5679bff032356 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787368106.921617:0:17202:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 4294967529 00000020:00080000:1.0:1787368106.921703:0:17202:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:3.0:1787368106.921828:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808607616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787368107.935288:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368108.294702:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368108.294805:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788623360 00000100:00100000:1.0:1787368108.294823:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788623360 00000100:00100000:1.0:1787368108.294909:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:1.0:1787368108.294919:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+13:15599:x1874190788623360:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787368108.295029:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+13:15599:x1874190788623360:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 112us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368108.295049:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00080000:2.0:1787368108.295245:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787368108.297280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368108.297392:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788623488 00000100:00100000:0.0:1787368108.297401:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788623488 00000100:00100000:0.0:1787368108.297474:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:0.0:1787368108.297486:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+5:15599:x1874190788623488:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787368108.297590:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d5a7807-1963-49fe-bc72-734aca1edb48+5:15599:x1874190788623488:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 106us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368108.297598:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00080000:2.0:1787368108.297662:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787368108.299605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368108.305486:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788623744 00000100:00100000:1.0:1787368108.305502:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788623744 00000100:00100000:1.0:1787368108.305664:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:1.0:1787368108.305677:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd756050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+13:15599:x1874190788623744:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787368108.305968:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd756050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+14:15599:x1874190788623744:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 293us (6370us total) trans 8589934675 rc 0/0 00000100:00100000:1.0:1787368108.305977:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00010000:00010000:2.0:1787368108.952656:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368109.464785:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787368109.464810:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808607744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368109.464881:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368109.465550:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808607744 00000100:00100000:0.0:1787368109.465559:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808607744 00000100:00100000:0.0:1787368109.465691:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787368109.465701:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808607744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787368109.465729:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787368109.465794:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808607744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368109.465801:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787368109.465914:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808607744:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787368109.466775:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787368109.981472:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368110.488732:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787368110.488758:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd7d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808607872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368110.488843:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368110.489008:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808607872 00000100:00100000:3.0:1787368110.489016:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808607872 00000100:00100000:3.0:1787368110.489074:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787368110.489084:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808607872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787368110.489122:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787368110.489173:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808607872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368110.489181:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787368110.489268:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd7d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808607872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368110.489709:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808608000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368110.489745:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368110.489920:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808608000 00000100:00100000:2.0:1787368110.489927:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808608000 00000100:00100000:2.0:1787368110.489968:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787368110.489975:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808608000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368110.490000:0:17904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787368110.490049:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808608000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368110.490055:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787368110.490172:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808608000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368110.899848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368110.899918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368110.899962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368110.900003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368110.900023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368110.900038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368110.900073:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368110.900160:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788624256 00000100:00100000:2.0:1787368110.900169:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788624256 00000100:00100000:2.0:1787368110.900233:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788624384 00000100:00100000:2.0:1787368110.900236:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788624384 00000100:00100000:2.0:1787368110.900256:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1787368110.900265:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2405:x1874190788624256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368110.900328:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2405:x1874190788624256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368110.900344:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1787368110.900390:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:2.0:1787368110.900397:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788624384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368110.900423:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788624384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368110.900428:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:0.0:1787368110.900572:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788623872 00000100:00100000:0.0:1787368110.900576:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788623872 00000100:00100000:0.0:1787368110.900614:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:0.0:1787368110.900621:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2404:x1874190788623872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368110.900656:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2404:x1874190788623872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368110.900671:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:0.0:1787368110.900699:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788624000 00000100:00100000:0.0:1787368110.900702:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788624000 00000100:00100000:0.0:1787368110.900722:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788624512 00000100:00100000:0.0:1787368110.900724:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788624512 00000100:00100000:0.0:1787368110.900733:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788624128 00000100:00100000:0.0:1787368110.900735:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788624128 00000100:00100000:0.0:1787368110.900743:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788624640 00000100:00100000:0.0:1787368110.900745:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788624640 00000100:00100000:0.0:1787368110.900757:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:0.0:1787368110.900762:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+14:2405:x1874190788624000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368110.900806:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+14:2405:x1874190788624000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368110.900813:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:0.0:1787368110.900823:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:0.0:1787368110.900828:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:2405:x1874190788624512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368110.900847:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+6:2405:x1874190788624512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368110.900852:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:0.0:1787368110.900862:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:0.0:1787368110.900868:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788624128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368110.900891:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2404:x1874190788624128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368110.900897:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:0.0:1787368110.900907:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:0.0:1787368110.900922:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788624640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368110.900946:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788624640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368110.900952:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00080000:3.0:1787368110.901469:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787368110.901474:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787368110.901476:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787368110.901478:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787368111.000624:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787368111.515267:0:19486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 90bfb389-29f4-40ca-b84c-07db457328e3 00000020:00000080:1.0:1787368111.515280:0:19486:0:(genops.c:885:class_export_put()) final put ffff9c55acb10000/90bfb389-29f4-40ca-b84c-07db457328e3 00000020:00000080:0.0:1787368111.515349:0:15931:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55acb10000/90bfb389-29f4-40ca-b84c-07db457328e3 for lustre-OST0001 00000020:00000080:0.0:1787368111.515428:0:15931:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55acb12000 for lustre-OST0001 00000001:02000400:0.0:1787368111.981069:0:20693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 23:08:31 (1787368111) 00000100:00100000:3.0:1787368112.025800:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808608128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787368112.025869:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368112.026260:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808608512:0@lo:400:kworker.0 00000100:00100000:1.0:1787368112.026293:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368112.026312:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808609024:0@lo:400:kworker.0 00000100:00100000:1.0:1787368112.026331:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368112.026387:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808609536:0@lo:400:kworker.0 00000100:00100000:1.0:1787368112.026414:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368112.026433:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787368112.026438:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808608384:0@lo:400:kworker.0 00000100:00100000:1.0:1787368112.026460:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368112.026480:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808608896:0@lo:400:kworker.0 00000100:00100000:1.0:1787368112.026500:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368112.026513:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808609408:0@lo:400:kworker.0 00000100:00100000:1.0:1787368112.026532:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368112.026558:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808608384 00000100:00100000:1.0:1787368112.026565:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808608384 00000100:00100000:2.0:1787368112.026927:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808608128 00000100:00100000:2.0:1787368112.026930:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808608128 00000100:00100000:2.0:1787368112.026968:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787368112.026978:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808608128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787368112.027006:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787368112.027050:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808608128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368112.027057:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787368112.027185:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808608256:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.027220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368112.027243:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787368112.027254:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808608384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368112.027294:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808608384:12345-0@lo:400:kworker.0 Request processed in 43us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368112.027301:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787368112.027338:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808608384:0@lo:400:kworker.0 00000100:00100000:0.0:1787368112.028702:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808608512 00000100:00100000:0.0:1787368112.028713:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808608512 00000100:00100000:3.0:1787368112.031715:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808608768:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.031788:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368112.031813:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808609280:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.031838:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368112.031860:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808609792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787368112.031882:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368112.031909:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787368112.031916:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808608640:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.031938:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368112.031955:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808609152:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.031977:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368112.031988:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808609664:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.032007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368112.032037:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808608768 00000100:00100000:3.0:1787368112.032045:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808608768 00000100:00100000:3.0:1787368112.032331:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787368112.032341:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808608768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.032420:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808608768:12345-0@lo:400:kworker.0 Request processed in 81us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368112.032428:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787368112.032450:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808609536 00000100:00100000:3.0:1787368112.032454:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808609536 00000100:00100000:3.0:1787368112.032475:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808609408 00000100:00100000:3.0:1787368112.032477:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808609408 00000100:00100000:3.0:1787368112.032488:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808609280 00000100:00100000:3.0:1787368112.032490:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808609280 00000100:00100000:3.0:1787368112.032501:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808608640 00000100:00100000:3.0:1787368112.032504:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808608640 00000100:00100000:3.0:1787368112.032512:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808609152 00000100:00100000:3.0:1787368112.032515:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808609152 00000100:00100000:3.0:1787368112.032551:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808609664 00000100:00100000:3.0:1787368112.032554:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808609664 00000100:00100000:3.0:1787368112.032571:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787368112.032578:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808609536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.033178:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808609536:12345-0@lo:400:kworker.0 Request processed in 598us (6761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368112.033187:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787368112.033203:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787368112.033210:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808609408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.033240:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808609408:12345-0@lo:400:kworker.0 Request processed in 31us (6707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368112.033245:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787368112.033256:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787368112.033262:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808609280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.033287:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874190808609280:12345-0@lo:400:kworker.0 Request processed in 25us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368112.033299:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787368112.033310:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787368112.033316:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808608640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.033343:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808608640:12345-0@lo:400:kworker.0 Request processed in 28us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368112.033349:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787368112.033378:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787368112.033385:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808609152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.033409:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808609152:12345-0@lo:400:kworker.0 Request processed in 25us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368112.033415:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787368112.033425:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787368112.033431:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808609664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.033455:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874190808609664:12345-0@lo:400:kworker.0 Request processed in 25us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368112.033461:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787368112.033480:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808609792 00000100:00100000:3.0:1787368112.033484:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808609792 00000100:00100000:3.0:1787368112.033509:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787368112.033516:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808609792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787368112.033536:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787368112.033711:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808609792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368112.033717:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787368112.033840:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54845b2a00 x1874190808609408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368112.033862:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808609408:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.033880:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808609536:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.033921:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808608128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787368112.033963:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808608640:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.033973:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808609152:0@lo:400:kworker.0 00010000:00080000:3.0:1787368112.033983:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54845b3800 x1874190808609664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368112.033992:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808609664:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.034016:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808608768:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.034027:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874190808609280:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.034040:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808609792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787368112.038228:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808609024 00000100:00100000:0.0:1787368112.038241:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808609024 00000100:00100000:2.0:1787368112.039380:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808608896 00000100:00100000:2.0:1787368112.039389:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808608896 00000100:00100000:2.0:1787368112.039411:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787368112.039425:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808608512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368112.039521:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808608512:12345-0@lo:400:kworker.0 Request processed in 101us (13226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368112.039529:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787368112.039564:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787368112.039572:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808609024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368112.039615:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808609024:12345-0@lo:400:kworker.0 Request processed in 45us (13283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368112.039642:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787368112.039667:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787368112.039672:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787368112.039675:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787368112.039678:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787368112.039693:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808608256 00000100:00100000:2.0:1787368112.039697:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808608256 00000100:00100000:2.0:1787368112.039734:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787368112.039740:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808608256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368112.039791:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808608256:12345-0@lo:400:kworker.0 Request processed in 51us (12570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368112.039797:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787368112.039855:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787368112.039862:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808608896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368112.039895:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808608896:12345-0@lo:400:kworker.0 Request processed in 33us (13394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368112.039901:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787368112.039913:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787368112.042792:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808608896:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.042812:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808608512:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.042823:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808609024:0@lo:400:kworker.0 00000100:00100000:3.0:1787368112.042879:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808608256:0@lo:400:kworker.0 00000100:00100000:2.0:1787368112.046463:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808609920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787368112.046534:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787368112.046855:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368112.048194:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808609920 00000100:00100000:1.0:1787368112.048204:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808609920 00000100:00100000:1.0:1787368112.048256:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787368112.048266:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808609920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787368112.048289:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787368112.048388:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808609920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368112.048395:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787368112.048836:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808609920:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1787368112.538104:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934675 is committed 00000020:00080000:0.0:1787368112.538121:0:17142:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:1.0:1787368112.538195:0:17202:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:1.0:1787368112.538221:0:17202:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:1.0:1787368113.048789:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787368113.112535:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787368113.112545:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787368113.112564:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1787368113.112574:0:17198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787368114.072855:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368114.585164:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808610048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787368114.585236:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368114.585305:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808610048 00000100:00100000:2.0:1787368114.585314:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808610048 00000100:00100000:2.0:1787368114.585417:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787368114.585428:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808610048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787368114.585456:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787368114.585511:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808610048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368114.585533:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787368114.585569:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808610048:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787368114.585800:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787368115.096551:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787368115.353431:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787368115.537297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368115.537382:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788624896 00000100:00100000:1.0:1787368115.537391:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788624896 00000100:00100000:1.0:1787368115.537464:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1787368115.537476:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+13:16568:x1874190788624896:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:1.0:1787368115.537741:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+14:16568:x1874190788624896:12345-192.168.203.4@tcp:35:umount.0 Request processed in 266us (452us total) trans 8589934676 rc 0/0 00000100:00100000:1.0:1787368115.537749:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00080000:0.0:1787368115.537979:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787368115.543200:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368115.543530:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788625152 00000100:00100000:1.0:1787368115.543539:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788625152 00000100:00100000:2.0:1787368115.543797:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1787368115.543809:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+14:16568:x1874190788625152:12345-192.168.203.4@tcp:35:umount.0 00000100:00100000:2.0:1787368115.544114:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+15:16568:x1874190788625152:12345-192.168.203.4@tcp:35:umount.0 Request processed in 307us (923us total) trans 8589934677 rc 0/0 00000100:00100000:2.0:1787368115.544122:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:3.0:1787368115.547838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368115.548293:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788625408 00000100:00100000:2.0:1787368115.548312:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788625408 00000100:00100000:2.0:1787368115.548411:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1787368115.548422:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2403:x1874190788625408:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368115.548438:0:18318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368115.548458:0:18318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613ae00/0x66f5679bff031cf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eacb expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368115.548474:0:18318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368115.548532:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:2403:x1874190788625408:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 111us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368115.548539:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:0.0:1787368115.549001:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368115.549124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368115.549433:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788625280 00000100:00100000:1.0:1787368115.549439:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788625280 00000100:00100000:1.0:1787368115.549493:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788625536 00000100:00100000:1.0:1787368115.549497:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788625536 00000100:00100000:1.0:1787368115.549517:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1787368115.549524:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+13:2403:x1874190788625280:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368115.549535:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368115.549548:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bd67f400/0x66f5679bff031ce9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea9a expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368115.549561:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368115.549613:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:2403:x1874190788625280:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 88us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368115.549620:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1787368115.549638:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1787368115.549670:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:2403:x1874190788625536:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368115.549678:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368115.549687:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581672400/0x66f5679bff031dad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb81 expref: 11 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368115.549697:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368115.549717:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:2403:x1874190788625536:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 59us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368115.549723:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1787368115.550543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368115.550568:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788625664 00000100:00100000:3.0:1787368115.550573:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788625664 00000100:00100000:3.0:1787368115.550642:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:3.0:1787368115.550652:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2401:x1874190788625664:12345-192.168.203.4@tcp:9:umount.0 00000020:00000080:3.0:1787368115.550680:0:19618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031d0c 00000100:00080000:3.0:1787368115.550688:0:19618:0:(import.c:65:import_set_state_nolock()) ffff9c5483628000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787368115.550729:0:19618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:3.0:1787368115.550855:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d5a7807-1963-49fe-bc72-734aca1edb48+2:2401:x1874190788625664:12345-192.168.203.4@tcp:9:umount.0 Request processed in 204us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368115.550862:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00010000:00010000:3.0:1787368115.550879:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787368115.550886:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787368115.556869:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368115.557052:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788625920 00000100:00100000:2.0:1787368115.557063:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788625920 00000100:00100000:2.0:1787368115.557142:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:2.0:1787368115.557152:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+6:2401:x1874190788625920:12345-192.168.203.4@tcp:9:umount.0 00000020:00000080:2.0:1787368115.557189:0:18670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031d13 00000020:00010000:2.0:1787368115.557197:0:18670:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c54824e5800: total 0 00000100:00080000:2.0:1787368115.557201:0:18670:0:(import.c:65:import_set_state_nolock()) ffff9c54824e1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787368115.557249:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1787368115.557450:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d5a7807-1963-49fe-bc72-734aca1edb48+4:2401:x1874190788625920:12345-192.168.203.4@tcp:9:umount.0 Request processed in 299us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368115.557459:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000020:00010000:1.0:1787368115.557807:0:17151:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c54824e5800: total 0 00010000:00010000:1.0:1787368115.557812:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368115.557848:0:17151:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c54824e5800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787368115.557901:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f40291a9/0x66f5679bff0323db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed33 expref: 3 pid: 19618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368115.557927:0:17151:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c54824e5800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787368115.557939:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368115.557940:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368115.557942:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787368115.558067:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368115.573979:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368115.574174:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788626688 00000100:00100000:3.0:1787368115.574183:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788626688 00000100:00100000:3.0:1787368115.574247:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:3.0:1787368115.574257:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+15:2401:x1874190788626688:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:3.0:1787368115.574289:0:17164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031cfe 00000020:00010000:3.0:1787368115.574316:0:17164:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c54824e3000: total 0 00000100:00080000:3.0:1787368115.574321:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9c54824e3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787368115.574351:0:17164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934677 00000020:00010000:0.0:1787368115.574529:0:18696:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c54824e3000: total 0 00010000:00010000:0.0:1787368115.574579:0:18696:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c54824e3000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787368115.574630:0:18696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c5582a23900) 00010000:00010000:0.0:1787368115.574634:0:18696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787368115.574643:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff031dc9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb88 expref: 14 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368115.574686:0:18696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368115.574689:0:18696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787368115.574693:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff031ea9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ebc7 expref: 13 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368115.574705:0:18696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368115.574708:0:18696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787368115.574711:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fa00/0x66f5679bff0322c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ece6 expref: 12 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368115.574725:0:18696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c5590ea9300) 00010000:00010000:0.0:1787368115.574727:0:18696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787368115.574730:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff03216c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ec92 expref: 11 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368115.574744:0:18696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368115.574746:0:18696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787368115.574750:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e75400/0x66f5679bff03239c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed1e expref: 10 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368115.574760:0:18696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9c54824f0a00) 00010000:00010000:0.0:1787368115.574762:0:18696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787368115.574766:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5483e74e00/0x66f5679bff0323c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed2c expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368115.574783:0:18696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c5582a23b00) 00010000:00010000:0.0:1787368115.574786:0:18696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368115.574808:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673800/0x66f5679bff031de5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb8f expref: 8 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368115.574828:0:18696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:0.0:1787368115.574830:0:18696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787368115.574835:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff031e24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb9d expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368115.574845:0:18696:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c54824e3000, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1787368115.574857:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368115.574859:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368115.574861:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368115.575289:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2401:x1874190788626688:12345-192.168.203.4@tcp:39:umount.0 Request processed in 1032us (1318us total) trans 8589934678 rc 0/0 00000100:00100000:3.0:1787368115.575310:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:2.0:1787368115.589123:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368115.589216:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788626816 00000100:00100000:0.0:1787368115.589226:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788626816 00000100:00100000:0.0:1787368115.589303:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:0.0:1787368115.589314:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+5:2401:x1874190788626816:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:0.0:1787368115.589347:0:17163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031d05 00000100:00080000:0.0:1787368115.589397:0:17163:0:(import.c:65:import_set_state_nolock()) ffff9c54824e4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787368115.589427:0:17163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1787368115.589643:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368115.589647:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d5a7807-1963-49fe-bc72-734aca1edb48+3:2401:x1874190788626816:12345-192.168.203.4@tcp:39:umount.0 Request processed in 334us (533us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787368115.589655:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00080000:3.0:1787368115.590155:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787368115.610403:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b507c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808610176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368115.610475:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368115.610533:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787368115.610540:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808610304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787368115.610565:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368115.610669:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808610176 00000100:00100000:3.0:1787368115.610677:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808610176 00000100:00100000:3.0:1787368115.610730:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808610304 00000100:00100000:3.0:1787368115.610733:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808610304 00000100:00100000:3.0:1787368115.610760:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787368115.610769:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808610176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787368115.610805:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787368115.610853:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808610176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368115.610861:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787368115.610878:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787368115.610884:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808610304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787368115.610898:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787368115.610924:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808610304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368115.610929:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787368115.610969:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808610304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368115.610979:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b507c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808610176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368116.022006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368116.022116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368116.022410:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788627072 00000100:00100000:1.0:1787368116.022419:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788627072 00000100:00100000:1.0:1787368116.022530:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788626944 00000100:00100000:1.0:1787368116.022533:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788626944 00000100:00100000:2.0:1787368116.022592:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:2.0:1787368116.022613:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788627072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1787368116.022687:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2404:x1874190788627072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368116.022696:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00080000:0.0:1787368116.023137:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787368116.023142:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787368116.023252:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:1.0:1787368116.023261:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+6:2404:x1874190788626944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1787368116.023317:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90bfb389-29f4-40ca-b84c-07db457328e3+6:2404:x1874190788626944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 58us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368116.023338:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00010000:00010000:1.0:1787368116.120852:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368117.144662:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b507c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808610432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787368117.144735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368117.144762:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808610432 00000100:00100000:2.0:1787368117.144770:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808610432 00000100:00100000:0.0:1787368117.144792:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787368117.144798:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808610560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787368117.144818:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787368117.144829:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808610432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787368117.144842:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787368117.144856:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00010000:00010000:0.0:1787368117.144897:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368117.144899:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c548278f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808610432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368117.144906:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787368117.144920:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808610560 00000100:00100000:0.0:1787368117.144938:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808610560 00000100:00100000:2.0:1787368117.144959:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b507c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808610432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787368117.144963:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787368117.144968:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808610560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787368117.144984:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00080000:2.0:1787368117.144987:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787368117.144990:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787368117.145020:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808610560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368117.145026:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787368117.145035:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808610560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787368117.145280:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368117.145291:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b507f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808610688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787368117.145321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368117.145431:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808610688 00000100:00100000:3.0:1787368117.145436:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808610688 00000100:00100000:3.0:1787368117.145476:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787368117.145484:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808610688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787368117.145504:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368117.145550:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808610688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368117.145557:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787368117.145746:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b507f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808610688:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787368117.145762:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787368117.147347:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b507f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808610816:0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.147427:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368117.147433:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b507ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808611072:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.147468:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368117.147469:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808611328:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.147488:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808611584:0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.147493:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368117.147507:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368117.147522:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808611840:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.147526:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787368117.147530:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b507c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808610944:0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.147543:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368117.147561:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787368117.147564:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368117.147566:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808611200:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.147579:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808611456:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.147611:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368117.147629:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808611968:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.147647:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368117.147671:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808611072 00000100:00100000:1.0:1787368117.147677:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808611072 00000100:00100000:1.0:1787368117.147714:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808611584 00000100:00100000:1.0:1787368117.147717:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808611584 00000100:00100000:1.0:1787368117.147739:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808611840 00000100:00100000:1.0:1787368117.147742:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808611840 00000100:00100000:2.0:1787368117.147749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368117.147755:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808611456 00000100:00100000:1.0:1787368117.147757:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808611456 00000100:00100000:2.0:1787368117.147768:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808611712:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.147768:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808611968 00000100:00100000:1.0:1787368117.147770:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808611968 00000100:00100000:1.0:1787368117.147784:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787368117.147787:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368117.147792:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808611072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.147806:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808611328 00000100:00100000:2.0:1787368117.147809:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808611328 00000100:00100000:2.0:1787368117.147836:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787368117.147837:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808611072:12345-0@lo:400:kworker.0 Request processed in 44us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368117.147842:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808611328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.147855:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787368117.147869:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808611712 00000100:00100000:1.0:1787368117.147872:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808611712 00000100:00100000:2.0:1787368117.147873:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808611328:12345-0@lo:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368117.147878:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787368117.147888:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787368117.147893:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808611584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.147894:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808610944 00000100:00100000:2.0:1787368117.147897:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808610944 00000100:00100000:2.0:1787368117.147917:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808611200 00000100:00100000:2.0:1787368117.147919:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808611200 00000100:00100000:1.0:1787368117.147920:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808611584:12345-0@lo:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368117.147942:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787368117.147948:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808610944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.148002:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808610944:12345-0@lo:400:kworker.0 Request processed in 54us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368117.148009:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787368117.148021:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787368117.148027:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808611200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.148052:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808611200:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368117.148057:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787368117.148094:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808611200:0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.148106:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808611328:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.148115:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787368117.148128:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787368117.148134:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808611840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.148156:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787368117.148163:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808611456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.148167:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808611840:12345-0@lo:400:kworker.0 Request processed in 35us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368117.148173:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787368117.148184:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787368117.148190:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808611968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.148191:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808611456:12345-0@lo:400:kworker.0 Request processed in 29us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368117.148196:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787368117.148209:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787368117.148214:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808611968:12345-0@lo:400:kworker.0 Request processed in 25us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368117.148215:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808611712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.148220:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1787368117.148236:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368117.148238:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808611712:12345-0@lo:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00080000:1.0:1787368117.148240:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787368117.148242:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787368117.148243:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787368117.148258:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b507c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808610944:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.148267:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808611456:0@lo:400:kworker.0 00010000:00080000:1.0:1787368117.148279:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54822c8000 x1874190808611968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787368117.148280:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54822c9f80 x1874190808611712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368117.148290:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808611712:0@lo:400:kworker.0 00000100:00100000:2.0:1787368117.148300:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808611840:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.148401:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808611968:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.148414:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b507ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808611072:0@lo:400:kworker.0 00000100:00100000:1.0:1787368117.148423:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808611584:0@lo:400:kworker.0 00000100:00100000:3.0:1787368117.148497:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808610816 00000100:00100000:3.0:1787368117.148502:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808610816 00000100:00100000:3.0:1787368117.148550:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787368117.148557:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808610816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368117.148612:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3ce871c-8318-4c29-9238-0157d9966155+24:3652:x1874190808610816:12345-0@lo:400:kworker.0 Request processed in 56us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368117.148619:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787368117.149143:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b507f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808610816:0@lo:400:kworker.0 00000100:00100000:0.0:1787368117.573965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368117.574011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368117.574054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368117.574224:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788627200 00000100:00100000:3.0:1787368117.574233:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788627200 00000100:00100000:3.0:1787368117.574285:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788627328 00000100:00100000:3.0:1787368117.574288:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788627328 00000100:00100000:3.0:1787368117.574298:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788627456 00000100:00100000:3.0:1787368117.574300:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788627456 00000100:00100000:3.0:1787368117.574313:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1787368117.574322:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+12:2402:x1874190788627200:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368117.574337:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368117.574396:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613a600/0x66f5679bff031d28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb0a expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368117.574413:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368117.574460:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+11:2402:x1874190788627200:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 139us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368117.574467:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1787368117.574494:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1787368117.574499:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+10:2405:x1874190788627328:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368117.574508:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368117.574516:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613aa00/0x66f5679bff031d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb3b expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368117.574525:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368117.574541:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+9:2405:x1874190788627328:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 42us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368117.574547:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1787368117.574559:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1787368117.574565:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+8:2405:x1874190788627456:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368117.574572:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368117.574581:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673e00/0x66f5679bff031da6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eb7a expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368117.574599:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368117.574616:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+7:2405:x1874190788627456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 51us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368117.574622:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1787368117.587178:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368117.587286:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788627712 00000100:00100000:1.0:1787368117.587296:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788627712 00000100:00100000:1.0:1787368117.587377:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:1.0:1787368117.587388:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+6:2401:x1874190788627712:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:1.0:1787368117.587423:0:18960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031d3d 00000020:00010000:1.0:1787368117.587431:0:18960:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c558660f800: total 0 00000100:00080000:1.0:1787368117.587436:0:18960:0:(import.c:65:import_set_state_nolock()) ffff9c55acb25800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787368117.587464:0:18960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934678 00000100:00100000:1.0:1787368117.587622:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90bfb389-29f4-40ca-b84c-07db457328e3+5:2401:x1874190788627712:12345-192.168.203.4@tcp:39:umount.0 Request processed in 235us (452us total) trans 8589934679 rc 0/0 00000100:00100000:1.0:1787368117.587631:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000020:00010000:3.0:1787368117.588116:0:17150:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c558660f800: total 0 00010000:00010000:3.0:1787368117.588163:0:17150:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c558660f800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787368117.588195:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5590ea9c00) 00010000:00010000:3.0:1787368117.588199:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787368117.588208:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff031e32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eba4 expref: 4 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368117.588250:0:17150:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c558660f800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787368117.588264:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368117.588266:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368117.588268:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368117.595448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368117.595844:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788627840 00000100:00100000:3.0:1787368117.595855:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788627840 00000100:00100000:3.0:1787368117.595919:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:3.0:1787368117.595931:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+5:2401:x1874190788627840:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:3.0:1787368117.595973:0:17164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031d44 00000100:00080000:3.0:1787368117.595985:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9c55acb27000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787368117.596016:0:17164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1787368117.596155:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90bfb389-29f4-40ca-b84c-07db457328e3+3:2401:x1874190788627840:12345-192.168.203.4@tcp:39:umount.0 Request processed in 225us (718us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787368117.596164:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00010000:00010000:1.0:1787368117.596251:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368117.628022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368117.628122:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788628096 00000100:00100000:2.0:1787368117.628132:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788628096 00000100:00100000:2.0:1787368117.628188:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00100000:2.0:1787368117.628198:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+7:2401:x1874190788628096:12345-192.168.203.4@tcp:251:umount.0 00000020:00000080:2.0:1787368117.628238:0:17154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031cdb 00000020:00010000:2.0:1787368117.628246:0:17154:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c548320c800: total 0 00000100:00080000:2.0:1787368117.628250:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9c548320c000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787368117.628324:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb621a7-65af-4d97-83fc-1ccec1c65d9c+3:2401:x1874190788628096:12345-192.168.203.4@tcp:251:umount.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368117.628331:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 172 00000020:00010000:0.0:1787368117.628894:0:18696:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c548320c800: total 0 00010000:00010000:0.0:1787368117.628899:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368117.628949:0:18696:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c548320c800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787368117.628981:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673600/0x66f5679bff031ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ea93 expref: 2 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368117.628996:0:18696:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c548320c800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787368117.629021:0:18696:0:(genops.c:885:class_export_put()) final put ffff9c548320c800/dcb621a7-65af-4d97-83fc-1ccec1c65d9c 00010000:00010000:0.0:1787368117.629043:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368117.629045:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368117.629047:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787368117.632933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548320c800/dcb621a7-65af-4d97-83fc-1ccec1c65d9c for MGS 00000020:00000080:2.0:1787368117.632994:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548320c000 for MGS 00010000:00010000:3.0:1787368118.168795:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368119.204953:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787368119.226483:0:20888:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787368119.234042:0:20888:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787368119.234096:0:20888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.234110:0:20888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.234129:0:20888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.234137:0:20888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.234163:0:20888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787368119.234169:0:20888:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787368119.234207:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787368119.234211:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787368119.234217:0:20888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787368119.234242:0:20888:0:(import.c:65:import_set_state_nolock()) ffff9c55a9341000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787368119.234274:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808612096:0@lo:39:umount.0 00000100:00100000:2.0:1787368119.234337:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787368119.234397:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368119.234406:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368119.234416:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d800 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787368119.234420:0:18696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368119.234430:0:18696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787368119.234450:0:18696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368119.234456:0:18696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787368119.234458:0:18696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787368119.234461:0:18696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787368119.234489:0:18696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368119.234495:0:18696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787368119.234523:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368119.234530:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff03189e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0318a5 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368119.234551:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368119.234553:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368119.234555:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368119.234562:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787368119.234582:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808612224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368119.234617:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368119.234660:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808612224 00000100:00100000:3.0:1787368119.234666:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808612224 00000100:00100000:3.0:1787368119.234721:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368119.234738:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3ce871c-8318-4c29-9238-0157d9966155+24:3653:x1874190808612224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368119.234751:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368119.234765:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e74200/0x66f5679bff0318a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff03189e expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368119.234783:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368119.234835:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3ce871c-8318-4c29-9238-0157d9966155+23:3653:x1874190808612224:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368119.234843:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368119.234877:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808612224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368119.239946:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808612096 00000100:00100000:0.0:1787368119.239959:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808612096 00000100:00100000:0.0:1787368119.240018:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787368119.240029:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874190808612096:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787368119.240057:0:18960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0318cf 00000100:00080000:0.0:1787368119.240065:0:18960:0:(import.c:65:import_set_state_nolock()) ffff9c55867de000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787368119.240187:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3650:x1874190808612096:12345-0@lo:39:umount.0 Request processed in 159us (5849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368119.240195:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000020:00000080:0.0:1787368119.240205:0:18960:0:(genops.c:885:class_export_put()) final put ffff9c55867d9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787368119.240229:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55867d9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787368119.240275:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55867de000 for lustre-MDT0000 00000100:00080000:0.0:1787368119.240313:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55a9341000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787368119.240322:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808612096:0@lo:39:umount.0 00010000:00010000:3.0:1787368119.240405:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787368119.241268:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787368119.241273:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787368119.241278:0:20888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787368119.244390:0:20888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244408:0:20888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244416:0:20888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244423:0:20888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244442:0:20888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368119.244448:0:20888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244454:0:20888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244460:0:20888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244476:0:20888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244489:0:20888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787368119.244495:0:20888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244503:0:20888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244509:0:20888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244514:0:20888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244530:0:20888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787368119.244537:0:20888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244544:0:20888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244551:0:20888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244557:0:20888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368119.244583:0:20888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787368119.244587:0:20888:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787368119.244621:0:20888:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787368119.244626:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787368119.244630:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368119.244635:0:20888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:1.0:1787368119.244638:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00080000:2.0:1787368119.244644:0:20888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c548320a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1787368119.244648:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787368119.244652:0:20888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c54810f8000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1787368119.244666:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613be00 already unused, calling callback (ffffffffc114ec20) 00000020:00080000:2.0:1787368119.244668:0:20888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c55bd40c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1787368119.244674:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787368119.244675:0:20888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c5481b98800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787368119.244690:0:20888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c558660f800 90bfb389-29f4-40ca-b84c-07db457328e3 192.168.203.4@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1787368119.244698:0:20888:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c54824e3000 2d5a7807-1963-49fe-bc72-734aca1edb48 192.168.203.4@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934675 stale:0 00000020:00080000:2.0:1787368119.244710:0:20888:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c55bd6d8000) has exports, disconnecting them 00010000:00010000:1.0:1787368119.244712:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787368119.244716:0:20888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c548320a000), last request at 1787368117 00000020:00000080:2.0:1787368119.244726:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031b06 10000000:00010000:1.0:1787368119.244727:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368119.244735:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787368119.244737:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1787368119.244740:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00080000:2.0:1787368119.244745:0:20888:0:(import.c:65:import_set_state_nolock()) ffff9c5483208800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787368119.244789:0:20888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c548320a000): rc 0 00000020:00000080:2.0:1787368119.244792:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c548320a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787368119.244801:0:20888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c54810f8000), last request at 1787368117 00000020:00000080:2.0:1787368119.244803:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031a6c 00000100:00080000:2.0:1787368119.244808:0:20888:0:(import.c:65:import_set_state_nolock()) ffff9c54810f9000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787368119.244815:0:20888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c54810f8000): rc 0 00000020:00000080:2.0:1787368119.244817:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c54810f8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787368119.244820:0:20888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c55bd40c000), last request at 1787368043 00000020:00000080:2.0:1787368119.244822:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0319bd 00000100:00080000:2.0:1787368119.244831:0:20888:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787368119.244838:0:20888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55bd40c000): rc 0 00000020:00000080:2.0:1787368119.244839:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55bd40c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787368119.244843:0:20888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c5481b98800), last request at 1787368043 00000020:00000080:2.0:1787368119.244846:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031962 00000100:00080000:2.0:1787368119.244849:0:20888:0:(import.c:65:import_set_state_nolock()) ffff9c55bd40e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787368119.244854:0:20888:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00010000:00010000:1.0:1787368119.244899:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.244907:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1787368119.244923:0:20888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c5481b98800): rc 0 00000004:00000080:2.0:1787368119.244930:0:20888:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffafad05583ae0 00010000:00010000:1.0:1787368119.244931:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.244941:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff0317ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0317f6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787368119.244947:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787368119.244952:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1787368119.244953:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787368119.244958:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.244964:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241cc00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368119.244966:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.244973:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368119.244989:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368119.244995:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787368119.244997:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787368119.244999:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787368119.245075:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245081:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368119.245089:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245095:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241cc00/0x66f5679bff031b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031b3e expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245105:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787368119.245108:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245114:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ac00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368119.245117:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245125:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368119.245132:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368119.245146:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787368119.245149:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787368119.245151:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787368119.245166:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245172:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368119.245188:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245194:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55b613ac00/0x66f5679bff031d98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031d9f expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245203:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368119.245206:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245212:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b200 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368119.245215:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245220:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368119.245225:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368119.245231:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787368119.245233:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787368119.245234:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787368119.245254:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245260:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368119.245267:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245274:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff0317e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0317e8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245282:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368119.245284:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368119.245286:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368119.245302:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808612352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368119.245386:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368119.245435:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787368119.245441:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808612480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368119.245465:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368119.245493:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808612736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368119.245517:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368119.245535:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787368119.245540:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808612608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368119.245559:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368119.245596:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808612352 00000100:00100000:1.0:1787368119.245601:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808612352 00000100:00100000:1.0:1787368119.245635:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808612480 00000100:00100000:1.0:1787368119.245638:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808612480 00000100:00100000:1.0:1787368119.245651:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808612736 00000100:00100000:1.0:1787368119.245653:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808612736 00000100:00100000:1.0:1787368119.245662:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808612608 00000100:00100000:1.0:1787368119.245670:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808612608 00000100:00100000:1.0:1787368119.245691:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787368119.245700:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+26:3651:x1874190808612352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368119.245713:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368119.245728:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e74000/0x66f5679bff0317f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0317ef expref: 26 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.245740:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1787368119.245833:0:20888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787368119.245849:0:20888:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787368119.245914:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787368119.245982:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787368119.245986:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934599 gen 3 00000004:00080000:2.0:1787368119.245997:0:20888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787368119.246066:0:20888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787368119.246077:0:20888:0:(import.c:65:import_set_state_nolock()) ffff9c55a9345000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787368119.246083:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787368119.246085:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 3 00000100:00100000:1.0:1787368119.246187:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+25:3651:x1874190808612352:12345-0@lo:103:ldlm_bl.0 Request processed in 488us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368119.246195:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787368119.246213:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787368119.246220:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+24:3651:x1874190808612480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368119.246228:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368119.246236:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613a800/0x66f5679bff031b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031b37 expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.246245:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368119.246264:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+23:3651:x1874190808612480:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368119.246270:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787368119.246281:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787368119.246286:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addbd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+22:3654:x1874190808612736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368119.246293:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368119.246300:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0317e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0317e1 expref: 22 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.246308:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368119.246340:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addbd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+21:3654:x1874190808612736:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368119.246347:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787368119.246407:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787368119.246413:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+20:3654:x1874190808612608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368119.246419:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368119.246429:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bd67fc00/0x66f5679bff031d9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031d98 expref: 20 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368119.246437:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368119.246458:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3ce871c-8318-4c29-9238-0157d9966155+19:3654:x1874190808612608:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368119.246464:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787368119.246502:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808612608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368119.246510:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808612736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368119.246537:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808612480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368119.246544:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808612352:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1787368119.247429:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548320a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787368119.247478:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54810f8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787368119.247499:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55bd40c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787368119.247520:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5483208800 for lustre-MDT0000 00000020:00000080:1.0:1787368119.247525:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54810f9000 for lustre-MDT0000 00000020:00000080:1.0:1787368119.247528:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55bd409800 for lustre-MDT0000 00010000:00010000:1.0:1787368119.247538:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368119.248367:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808612864:0@lo:39:umount.0 00000100:00100000:0.0:1787368119.248433:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368119.248477:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808612992:0@lo:9:umount.0 00000100:00100000:0.0:1787368119.248501:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368119.248542:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808612992 00000100:00100000:0.0:1787368119.248549:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808612992 00000100:00100000:0.0:1787368119.248611:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787368119.248621:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874190808612992:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787368119.248644:0:18672:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031b45 00000100:00080000:0.0:1787368119.248664:0:18672:0:(import.c:65:import_set_state_nolock()) ffff9c548320d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787368119.248704:0:18672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1787368119.248819:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3650:x1874190808612992:12345-0@lo:9:umount.0 Request processed in 199us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368119.248827:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787368119.248865:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55a9345000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787368119.248876:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787368119.248879:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787368119.248882:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808612992:0@lo:9:umount.0 00000004:00080000:2.0:1787368119.248964:0:20888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787368119.249027:0:20888:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787368119.249043:0:20888:0:(import.c:65:import_set_state_nolock()) ffff9c55867d7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787368119.249094:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c55bd6d8000) has no exports 00000100:00100000:1.0:1787368119.249289:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808612864 00000100:00100000:1.0:1787368119.249301:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808612864 00000100:00100000:1.0:1787368119.249338:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787368119.249345:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874190808612864:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787368119.249383:0:17167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0319e7 00000100:00080000:1.0:1787368119.249389:0:17167:0:(import.c:65:import_set_state_nolock()) ffff9c5483ce0800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787368119.249437:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808613120:0@lo:9:umount.0 00000100:00100000:0.0:1787368119.249467:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368119.249495:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808613120 00000100:00100000:0.0:1787368119.249499:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808613120 00000100:00100000:0.0:1787368119.249523:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787368119.249530:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874190808613120:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787368119.249541:0:18671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031b4c 00000100:00080000:0.0:1787368119.249546:0:18671:0:(import.c:65:import_set_state_nolock()) ffff9c54824e0800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1787368119.250484:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787368119.250489:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1787368119.253441:0:17167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000001:00000004:0.0:1787368119.256024:0:18671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:0.0:1787368119.256178:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3650:x1874190808613120:12345-0@lo:9:umount.0 Request processed in 6645us (6706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368119.256191:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787368119.256248:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787368119.256262:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787368119.256264:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787368119.256268:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808613120:0@lo:9:umount.0 00000100:00100000:1.0:1787368119.256669:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3650:x1874190808612864:12345-0@lo:39:umount.0 Request processed in 7322us (8232us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787368119.256678:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:1.0:1787368119.256702:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368119.256708:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368119.256758:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787368119.261480:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55834d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787368119.261495:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808612864:0@lo:39:umount.0 00000020:00080000:0.0:1787368119.268117:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c55bd6d8000) has no exports 00000020:00000080:0.0:1787368119.324847:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03183c 00000020:00000080:0.0:1787368119.324863:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55b6068800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787368119.325452:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787368119.325508:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b6068800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787368119.325531:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787368119.325541:0:20888:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787368119.325544:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c5482770000) has no exports 00000020:00000080:1.0:1787368119.325853:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031835 00000020:00000080:1.0:1787368119.325861:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5583e5e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787368119.325921:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5583e5e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787368119.325986:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368119.325993:0:20888:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787368119.325995:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5583e58000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787368119.325998:0:20888:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5583e58000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787368119.326001:0:20888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1787368119.705031:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368119.705056:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808613248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368119.705126:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368119.705331:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808613248 00000100:00100000:3.0:1787368119.705338:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808613248 00000100:00100000:3.0:1787368119.705429:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787368119.705439:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808613248:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787368119.705664:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787368119.705758:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787368119.705815:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808613248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 378us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368119.705823:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787368119.705917:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808613248:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787368120.216593:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368120.728831:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808613376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368120.728903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368120.729044:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808613376 00000100:00100000:2.0:1787368120.729053:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808613376 00000100:00100000:2.0:1787368120.729101:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787368120.729108:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874190808613376:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787368120.729115:0:17168:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787368120.729171:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874190808613376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (267us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787368120.729179:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:02020000:1.0:1787368120.729247:0:3652:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787368120.745667:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787368120.745676:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9c558335d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787368120.745699:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787368120.777583:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9c558335d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368120.777597:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1787368120.777607:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c558335d800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368120.777683:0:3652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b507c380 x1874190808613504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787368120.777872:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b507c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808613504:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787368120.777944:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368120.778042:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808613504 00000100:00100000:3.0:1787368120.778050:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808613504 00000100:00100000:3.0:1787368120.778087:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787368120.778095:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808613504:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787368120.778111:0:17167:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787368120.783996:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808613504:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 5890us (6040us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787368120.784011:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787368120.787003:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c558335d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787368120.787015:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787368120.787020:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b507c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808613504:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1787368121.240661:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787368121.754970:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787368121.754985:0:17895:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1787368121.754991:0:17895:0:(genops.c:885:class_export_put()) final put ffff9c5483ce2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787368121.755005:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 90bfb389-29f4-40ca-b84c-07db457328e3 00000001:00080000:2.0:1787368121.755011:0:17895:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1787368121.755013:0:17895:0:(genops.c:885:class_export_put()) final put ffff9c55acb24000/90bfb389-29f4-40ca-b84c-07db457328e3 00000001:00100000:2.0:1787368121.755018:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2d5a7807-1963-49fe-bc72-734aca1edb48 00000001:00080000:2.0:1787368121.755022:0:17895:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1787368121.755023:0:17895:0:(genops.c:885:class_export_put()) final put ffff9c54824e6000/2d5a7807-1963-49fe-bc72-734aca1edb48 00000020:00000080:1.0:1787368121.755455:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787368121.755519:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55acb24000/90bfb389-29f4-40ca-b84c-07db457328e3 for lustre-MDT0001 00000020:00000080:1.0:1787368121.755888:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54824e6000/2d5a7807-1963-49fe-bc72-734aca1edb48 for lustre-MDT0001 00000020:00000080:1.0:1787368121.755922:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5483ce0800 for lustre-MDT0001 00000020:00000080:1.0:1787368121.755927:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55acb27000 for lustre-MDT0001 00000020:00000080:1.0:1787368121.755930:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54824e4000 for lustre-MDT0001 00000001:00100000:3.0:1787368121.756196:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787368121.756201:0:17142:0:(genops.c:885:class_export_put()) final put ffff9c5481b98800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787368121.756216:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 90bfb389-29f4-40ca-b84c-07db457328e3 00000001:00080000:3.0:1787368121.756223:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934679 is committed 00000020:00000080:3.0:1787368121.756225:0:17142:0:(genops.c:885:class_export_put()) final put ffff9c558660f800/90bfb389-29f4-40ca-b84c-07db457328e3 00000001:00100000:3.0:1787368121.756229:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2d5a7807-1963-49fe-bc72-734aca1edb48 00000001:00080000:3.0:1787368121.756234:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934678 is committed 00000020:00000080:3.0:1787368121.756238:0:17142:0:(genops.c:885:class_export_put()) final put ffff9c54824e3000/2d5a7807-1963-49fe-bc72-734aca1edb48 00000020:00000080:0.0:1787368121.757498:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5481b98800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787368121.757542:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c558660f800/90bfb389-29f4-40ca-b84c-07db457328e3 for lustre-MDT0000 00000020:00000080:0.0:1787368121.757585:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54824e3000/2d5a7807-1963-49fe-bc72-734aca1edb48 for lustre-MDT0000 00000020:00000080:0.0:1787368121.757607:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55bd40e800 for lustre-MDT0000 00000020:00000080:0.0:1787368121.757612:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55acb25800 for lustre-MDT0000 00000020:00000080:0.0:1787368121.757615:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54824e3800 for lustre-MDT0000 00000001:00100000:1.0:1787368121.758911:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787368121.758918:0:18666:0:(genops.c:885:class_export_put()) final put ffff9c548320b800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787368121.758993:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2d5a7807-1963-49fe-bc72-734aca1edb48 00000020:00000080:1.0:1787368121.758997:0:18666:0:(genops.c:885:class_export_put()) final put ffff9c54824e5800/2d5a7807-1963-49fe-bc72-734aca1edb48 00000020:00000080:0.0:1787368121.759016:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548320b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:3.0:1787368121.759073:0:19486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787368121.759078:0:19486:0:(genops.c:885:class_export_put()) final put ffff9c54824e2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787368121.759101:0:19486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d5a7807-1963-49fe-bc72-734aca1edb48 00000020:00000080:3.0:1787368121.759104:0:19486:0:(genops.c:885:class_export_put()) final put ffff9c548362b000/2d5a7807-1963-49fe-bc72-734aca1edb48 00000020:00000080:0.0:1787368121.759120:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548320d000 for lustre-OST0000 00000020:00000080:0.0:1787368121.759127:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54824e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787368121.759144:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548362b000/2d5a7807-1963-49fe-bc72-734aca1edb48 for lustre-OST0001 00000020:00000080:0.0:1787368121.759158:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54824e0800 for lustre-OST0001 00000020:00000080:0.0:1787368121.759162:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5483628000 for lustre-OST0001 00000020:00000080:0.0:1787368121.759333:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54824e5800/2d5a7807-1963-49fe-bc72-734aca1edb48 for lustre-OST0000 00000020:00000080:0.0:1787368121.759382:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54824e1000 for lustre-OST0000 00000100:00080000:2.0:1787368122.264648:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787368122.264655:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787368122.264658:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c558335d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368122.264666:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 578 00000100:00080000:2.0:1787368122.264686:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787368122.264692:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c558335d800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368122.264726:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd8f2300 x1874190808613888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787368122.264817:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808614016:0@lo:400:kworker.0 00000100:00100000:3.0:1787368122.264843:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808613888:0@lo:38:kworker.0 00000100:00100000:3.0:1787368122.264881:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368122.264881:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368122.264976:0:17904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808613888 00000100:00100000:0.0:1787368122.264984:0:17904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808613888 00000100:00100000:0.0:1787368122.265021:0:17904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787368122.265028:0:17904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874190808613888:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787368122.265046:0:17904:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787368122.269386:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808614528:0@lo:400:kworker.0 00000100:00100000:2.0:1787368122.269450:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368122.269491:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787368122.269497:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808614144:0@lo:400:kworker.0 00000100:00100000:2.0:1787368122.269524:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368122.269544:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808614656:0@lo:400:kworker.0 00000100:00100000:2.0:1787368122.269582:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368122.269630:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808614528 00000100:00100000:2.0:1787368122.269637:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808614528 00000100:00100000:2.0:1787368122.269690:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808614656 00000100:00100000:2.0:1787368122.269694:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808614656 00000100:00100000:2.0:1787368122.269851:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787368122.269863:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808614528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368122.269917:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808614528:12345-0@lo:400:kworker.0 Request processed in 58us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368122.269924:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787368122.269942:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787368122.269946:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1874190808614656:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787368122.269952:0:17164:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787368122.269977:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1874190808614656:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787368122.269996:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787368122.270016:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808614016 00000100:00100000:2.0:1787368122.270020:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808614016 00000100:00100000:2.0:1787368122.270045:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808614144 00000100:00100000:2.0:1787368122.270047:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808614144 00000100:00100000:2.0:1787368122.270066:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787368122.270072:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808614016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368122.270106:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808614016:12345-0@lo:400:kworker.0 Request processed in 35us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368122.270112:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787368122.270123:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787368122.270129:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808614144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368122.270156:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808614144:12345-0@lo:400:kworker.0 Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368122.270161:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787368122.270206:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808614144:0@lo:400:kworker.0 00000100:00080000:2.0:1787368122.270217:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787368122.270221:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c5482222000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787368122.270225:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787368122.270433:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808613632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787368122.270485:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368122.270509:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808614272:0@lo:400:kworker.0 00000100:00100000:1.0:1787368122.270540:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368122.270586:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808614784:0@lo:400:kworker.0 00000100:00100000:1.0:1787368122.270613:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368122.270640:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787368122.270646:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808613760:0@lo:400:kworker.0 00000100:00100000:1.0:1787368122.270682:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368122.270719:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808614400:0@lo:400:kworker.0 00000100:00100000:1.0:1787368122.270739:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787368122.270774:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787368122.270778:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787368122.270781:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787368122.270798:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808613632 00000100:00100000:1.0:1787368122.270802:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808613632 00000100:00100000:1.0:1787368122.270837:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787368122.270849:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b507c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808613632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787368122.270871:0:18674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787368122.270904:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b507c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808613632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368122.270911:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787368122.270935:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808613760 00000100:00100000:1.0:1787368122.270938:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808613760 00000100:00100000:1.0:1787368122.270959:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787368122.270965:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+19:3653:x1874190808613760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368122.270991:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3ce871c-8318-4c29-9238-0157d9966155+19:3653:x1874190808613760:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368122.270997:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787368122.271019:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808614272 00000100:00100000:1.0:1787368122.271022:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808614272 00000100:00100000:1.0:1787368122.271033:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808614784 00000100:00100000:1.0:1787368122.271035:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808614784 00000100:00100000:1.0:1787368122.271052:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808614400 00000100:00100000:1.0:1787368122.271055:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808614400 00000100:00100000:1.0:1787368122.271064:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787368122.271087:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808614784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368122.271127:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808614784:12345-0@lo:400:kworker.0 Request processed in 43us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368122.271134:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787368122.271147:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787368122.271151:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1874190808614272:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787368122.271156:0:17163:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787368122.271180:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1874190808614272:12345-0@lo:400:kworker.0 Request processed in 27us (640us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787368122.271186:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787368122.271198:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787368122.271202:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1874190808614400:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787368122.271206:0:17163:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787368122.271227:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1874190808614400:12345-0@lo:400:kworker.0 Request processed in 24us (487us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787368122.271233:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1787368122.271249:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787368122.271269:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3ce871c-8318-4c29-9238-0157d9966155:3653:1874190808613760:0@lo:400:kworker.0 00000100:00080000:1.0:1787368122.271280:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787368122.271283:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9c54810f8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787368122.271287:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787368122.271292:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9c54810f8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368122.271295:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 515 00000100:00080000:1.0:1787368122.271301:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c54810f8800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368122.271326:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf6a00 x1874190808614912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368122.271483:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808614400:0@lo:400:kworker.0 00000100:00100000:1.0:1787368122.271509:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808613632:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787368122.271519:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787368122.271521:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9c548367b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787368122.271525:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787368122.271528:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9c548367b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368122.271531:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1787368122.271535:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c548367b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368122.271562:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf5180 x1874190808615040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368122.271572:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808614272:0@lo:400:kworker.0 00010000:00080000:1.0:1787368122.271585:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd8f1180 x1874190808614784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368122.271593:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808614784:0@lo:400:kworker.0 00000100:00100000:3.0:1787368122.271930:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808614912:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787368122.271963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368122.271992:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808615040:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787368122.272011:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368122.272088:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808614912 00000100:00100000:1.0:1787368122.272093:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808614912 00000100:00100000:1.0:1787368122.272114:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808615040 00000100:00100000:1.0:1787368122.272117:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808615040 00000100:00100000:1.0:1787368122.272129:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787368122.272134:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808614912:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787368122.272148:0:17163:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787368122.272180:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808614912:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 45us (216us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368122.272197:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787368122.272212:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787368122.272217:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808615040:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787368122.272225:0:17163:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787368122.272253:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808615040:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 35us (241us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368122.272259:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1787368122.272718:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54810f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368122.272724:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787368122.272728:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808614912:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1787368122.272737:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548367b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368122.272740:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787368122.272743:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808615040:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1787368122.295566:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c5482222000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368122.295576:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 531 00000100:00080000:2.0:1787368122.295586:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c5482222000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368122.295627:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd8f3100 x1874190808615168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787368122.295660:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808614656:0@lo:400:kworker.0 00000100:00100000:3.0:1787368122.295811:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808615168:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787368122.295891:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368122.295953:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808615168 00000100:00100000:3.0:1787368122.295961:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808615168 00000100:00100000:3.0:1787368122.295999:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787368122.296005:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808615168:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1787368122.296022:0:17163:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787368122.296063:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808615168:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 56us (172us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787368122.296070:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1787368122.296106:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5482222000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368122.296111:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787368122.296115:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808615168:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787368122.297208:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808614016:0@lo:400:kworker.0 00010000:00080000:2.0:1787368122.297223:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd8f2d80 x1874190808614528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368122.297242:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808614528:0@lo:400:kworker.0 00000100:00100000:1.0:1787368122.308113:0:17904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874190808613888:12345-0@lo:38:kworker.0 Request processed in 43074us (43222us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368122.308126:0:17904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787368122.308536:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c558335d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787368122.308544:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787368122.308548:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808613888:0@lo:38:kworker.0 00010000:00010000:3.0:1787368122.308574:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368123.352681:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368124.377227:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368124.825812:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368124.825837:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808615296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368124.825920:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368124.825950:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808615296 00000100:00100000:3.0:1787368124.825959:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808615296 00000100:00100000:3.0:1787368124.826044:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787368124.826055:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808615296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787368124.826082:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787368124.826132:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808615296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368124.826140:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787368124.826162:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808615296:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787368124.826261:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:1.0:1787368125.400624:0:20888:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5481082120 - data ffff9c5481c0f6c0/ffff9c55bd5c6c00 00010000:00010000:3.0:1787368125.400637:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787368125.400772:0:20888:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5483025840 - data ffff9c55b156e000/ffff9c55be97f400 00000001:00000004:1.0:1787368125.415857:0:20888:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00000100:00080000:2.0:1787368125.467043:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787368125.467052:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787368125.467066:0:20888:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c5483ea1180 x1874190808612864/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787368129 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368125.467093:0:20888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787368125.474795:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787368125.474804:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934599 gen 4 00000004:00080000:2.0:1787368125.474868:0:20888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787368125.474872:0:20888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787368125.479931:0:17186:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787368125.479938:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1787368125.479948:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787368125.481177:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787368125.481195:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 4 00000004:00080000:2.0:1787368125.481213:0:20888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787368125.481215:0:20888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787368125.481853:0:17188:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787368125.481858:0:17188:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 3 count 1 00000040:00080000:3.0:1787368125.481869:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787368125.487692:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031804 00000020:00000080:2.0:1787368125.487705:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5483db1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787368125.488498:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483db1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787368125.496852:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031819 00000020:00000080:3.0:1787368125.496867:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5483db4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787368125.498041:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787368125.498052:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787368125.498061:0:20888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787368125.498065:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c55bd6db370) has no exports 00000004:01000000:3.0:1787368125.498676:0:20888:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787368125.498687:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03187b 00000020:00000080:3.0:1787368125.498695:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55b1109000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787368125.504579:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483db4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787368125.505858:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787368125.505893:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787368125.505903:0:20888:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787368125.505908:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c54826bb370) has no exports 00000020:00000080:3.0:1787368125.505917:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031874 00000020:00000080:3.0:1787368125.505926:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55867d4000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787368125.506080:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b1109000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787368125.508637:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55867d4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787368125.509173:0:20888:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787368125.509179:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787368125.510975:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 5 00000004:00080000:3.0:1787368125.510990:0:20888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787368125.510993:0:20888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787368125.511060:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787368125.511071:0:20888:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787368125.511082:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031866 00000020:00000080:3.0:1787368125.511092:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55a9341800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787368125.511099:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787368125.511105:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787368125.511109:0:20888:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787368125.511113:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c54826b99b8) has no exports 00000020:00000080:3.0:1787368125.511119:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03185f 00000020:00000080:3.0:1787368125.511123:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55a9343800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787368125.511273:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55867d7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787368125.511282:0:36:0:(genops.c:885:class_export_put()) final put ffff9c55a9344800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787368125.511285:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a9344800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787368125.511295:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787368125.511400:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a9341800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787368125.511406:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a9343800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787368125.512368:0:20888:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787368125.512373:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787368125.512387:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934599 gen 5 00000004:00080000:3.0:1787368125.512391:0:20888:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787368125.512393:0:20888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787368125.512427:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787368125.512434:0:20888:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787368125.512469:0:20888:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787368125.512477:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031851 00000020:00000080:3.0:1787368125.512485:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55b606d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787368125.512490:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787368125.512494:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787368125.512499:0:20888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787368125.512502:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9c55b5ca19b8) has no exports 00000020:00000080:3.0:1787368125.512507:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03184a 00000020:00000080:3.0:1787368125.512511:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55b606f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787368125.512936:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55a9345000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787368125.512944:0:36:0:(genops.c:885:class_export_put()) final put ffff9c55b606a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787368125.512947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b606a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787368125.512951:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787368125.513013:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b606d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787368125.513018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b606f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787368125.513400:0:20888:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787368125.513405:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787368125.513408:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787368125.513413:0:20888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787368125.513459:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368125.513472:0:20888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787368125.513505:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368125.513510:0:20888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787368125.513513:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55834d1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787368125.513516:0:20888:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55834d1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787368125.513525:0:20888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787368125.513621:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031820 00000020:00000080:2.0:1787368125.513627:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5483db7000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787368125.513632:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787368125.513635:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368125.513650:0:20888:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787368125.513654:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c55b5ca4d28) has no exports 00000020:00000080:2.0:1787368125.513673:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368125.513676:0:20888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787368125.513680:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031827 00000020:00000080:2.0:1787368125.513683:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5483db6000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787368125.513690:0:20888:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c5483e3e800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787368125.513693:0:20888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5483e3e800 3 00000020:01000004:2.0:1787368125.513696:0:20888:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c5483e3e800 from lustre-MDT0000 00000020:00000080:2.0:1787368125.513712:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368125.513716:0:20888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787368125.513718:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5483db3800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787368125.513719:0:20888:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483db3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787368125.513725:0:20888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787368125.513754:0:20888:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787368125.513757:0:20888:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787368125.513759:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787368125.513762:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368125.513764:0:20888:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787368125.513770:0:20888:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c5483729800 b3ce871c-8318-4c29-9238-0157d9966155 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787368125.513775:0:20888:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c55bd6dcd28) has exports, disconnecting them 00000020:00080000:2.0:1787368125.513780:0:20888:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c5483729800), last request at 1787368030 00000020:00000080:2.0:1787368125.513800:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0317cc 00000020:00010000:2.0:1787368125.513804:0:20888:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c5483729800: total 2 00000100:00080000:2.0:1787368125.513809:0:20888:0:(import.c:65:import_set_state_nolock()) ffff9c548372d000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787368125.513825:0:20888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c5483729800): rc 0 00000020:00080000:2.0:1787368125.513829:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c55bd6dcd28) has no exports 00000100:00100000:2.0:1787368125.513889:0:17157:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c55bd529000:17157] 2 exiting: rc = 0 00000020:00000080:0.0:1787368125.514348:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55834d0000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787368125.514372:0:36:0:(genops.c:885:class_export_put()) final put ffff9c55b606e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787368125.514374:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b606e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787368125.514379:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787368125.514434:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483db7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787368125.514438:0:36:0:(genops.c:885:class_export_put()) final put ffff9c5483db6800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787368125.514440:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483db6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787368125.514443:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787368125.514461:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483db6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1787368125.514497:0:17150:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c5483729800: total 0 00010000:00010000:0.0:1787368125.514517:0:17150:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c5483729800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787368125.514554:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241d400/0x66f5679bff0317da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0317d3 expref: 14 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514568:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613ba00/0x66f5679bff031ac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031ac0 expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514578:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5581673c00/0x66f5679bff031d75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031d6e expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514588:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e74a00/0x66f5679bff0318eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0318e4 expref: 11 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514600:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55b613b800/0x66f5679bff031a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031a50 expref: 10 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514609:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bd67e600/0x66f5679bff031d83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031d7c expref: 9 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514618:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241c800/0x66f5679bff0319a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0319a1 expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514628:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e74800/0x66f5679bff0318f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff0318f2 expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514649:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5580030000/0x66f5679bff031d91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031d8a expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514661:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e74c00/0x66f5679bff031907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031900 expref: 5 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514684:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75c00/0x66f5679bff031af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031aea expref: 4 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514693:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75800/0x66f5679bff031b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031b29 expref: 3 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514704:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e74400/0x66f5679bff031a2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x66f5679bff031a26 expref: 2 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368125.514714:0:17150:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c5483729800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787368125.514728:0:17150:0:(genops.c:885:class_export_put()) final put ffff9c5483729800/b3ce871c-8318-4c29-9238-0157d9966155 00010000:00010000:0.0:1787368125.514743:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368125.514744:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368125.514746:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368125.514779:0:17154:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c558831de00:17154] 0 exiting: rc = 1 00000020:00000080:2.0:1787368125.515120:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483729800/b3ce871c-8318-4c29-9238-0157d9966155 for MGS 00000020:00000080:2.0:1787368125.515154:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548372d000 for MGS 00000100:00100000:2.0:1787368125.515434:0:17155:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c5588199000:17155] 1 exiting: rc = 0 00000100:00100000:0.0:1787368125.515729:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515737:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515743:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515749:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515762:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515769:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515775:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515781:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515787:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515794:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515801:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515807:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515813:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515819:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515825:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515833:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515851:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515857:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515863:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515869:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515874:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515880:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515885:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515891:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515896:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515901:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515908:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515915:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515920:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515925:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515932:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515937:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515943:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515948:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515953:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515958:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515964:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515969:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515974:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515979:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515984:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515989:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.515995:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516001:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516006:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516012:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516018:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516023:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516027:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516031:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516036:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516049:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516054:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516262:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516273:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516279:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516284:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516289:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516295:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516300:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516306:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516311:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516317:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368125.516322:0:20888:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787368125.518705:0:20888:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c559177a6c0 - data ffff9c55b1552a20/ffff9c55b11e5400 00000020:01000000:0.0:1787368125.518834:0:20888:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5483025900 - data ffff9c55b142bbd0/ffff9c55bc66a000 00000020:00000080:0.0:1787368125.519251:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0317b0 00000020:00000080:0.0:1787368125.519260:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5483e39000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787368125.519795:0:20888:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c5483e3e800 from MGS, refs=2 00000020:01000004:0.0:1787368125.519800:0:20888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5483e3e800 2 00000020:01000004:0.0:1787368125.519803:0:20888:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c5483e3e800 from MGS 00000020:00000080:0.0:1787368125.519829:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787368125.519837:0:20888:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787368125.519840:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5483e3d000/MGS 00000020:00000080:0.0:1787368125.519843:0:20888:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483e3d000/MGS for MGS 00000020:01000000:0.0:1787368125.519850:0:20888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787368125.519916:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787368125.519921:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787368125.519927:0:20888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787368125.519934:0:20888:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c55a0f10800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787368125.519941:0:20888:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9c559124cd28) has exports, disconnecting them 00000020:00080000:0.0:1787368125.519946:0:20888:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c55a0f10800), last request at 1787368030 00000020:00000080:0.0:1787368125.519950:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0318b3 00000020:00080000:0.0:1787368125.519975:0:20888:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55a0f10800): rc 0 00000020:00000080:0.0:1787368125.519981:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55a0f10800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787368125.520613:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483e39000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787368125.520622:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a0f10800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787368125.539494:0:20888:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787368125.539504:0:20888:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787368125.539509:0:20888:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787368125.539516:0:20888:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787368125.539558:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c55a9341000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787368125.539735:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368125.539745:0:20888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787368125.539751:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c55834d7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787368125.539755:0:20888:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55834d7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787368125.539760:0:20888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787368125.539844:0:20888:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5483e3e800 1 00000020:00000080:2.0:1787368125.539850:0:20888:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0317a2 00000020:00000080:2.0:1787368125.539856:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5483e3c800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787368125.539865:0:20888:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787368125.539872:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483e3c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787368125.539880:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368125.539884:0:20888:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787368125.539888:0:20888:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c55bd6d99b8) has no exports 00000040:00080000:1.0:1787368125.600932:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1787368125.843963:0:20888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368125.843978:0:20888:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787368125.843983:0:20888:0:(genops.c:885:class_export_put()) final put ffff9c5483e3e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787368125.843988:0:20888:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483e3e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787368125.843999:0:20888:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787368125.844136:0:20888:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c5483e38800 00000020:02000400:2.0:1787368125.844193:0:20888:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787368126.429707:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368127.387039:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787368127.387059:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808615424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787368127.387125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368127.387239:0:19965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808615424 00000100:00100000:3.0:1787368127.387246:0:19965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808615424 00000100:00100000:3.0:1787368127.387507:0:19965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787368127.387527:0:19965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808615424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787368127.387557:0:19965:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368127.387602:0:19965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808615424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368127.387609:0:19965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787368127.387669:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808615424:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787368127.389276:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787368127.391074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368127.391080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787368127.391084:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c558335d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368127.391092:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 579 00000100:00080000:0.0:1787368127.391097:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787368127.391103:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c558335d800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368127.391126:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b5074700 x1874190808615680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368127.391157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368127.391161:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787368127.391163:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c548367b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368127.391166:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 579 00000100:00080000:0.0:1787368127.391169:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787368127.391172:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c548367b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368127.391185:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b5075c00 x1874190808615936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368127.391319:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368127.391324:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787368127.391326:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c54810f8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368127.391329:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 579 00000100:00080000:0.0:1787368127.391332:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787368127.391336:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c54810f8800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368127.391351:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b5074a80 x1874190808616064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368127.391411:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368127.391414:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787368127.391415:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c5482222000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368127.391419:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 579 00000100:00080000:0.0:1787368127.391422:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787368127.391425:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c5482222000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368127.391438:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b5076300 x1874190808616320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368127.391470:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808615680:0@lo:38:kworker.0 00000100:00100000:0.0:1787368127.391542:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368127.391574:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808615936:0@lo:38:kworker.0 00000100:00100000:0.0:1787368127.391601:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368127.391620:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808616064:0@lo:38:kworker.0 00000100:00100000:0.0:1787368127.391640:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368127.391658:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808616320:0@lo:38:kworker.0 00000100:00100000:0.0:1787368127.391678:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368127.391713:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808615808:0@lo:400:kworker.0 00000100:00100000:0.0:1787368127.391740:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368127.391767:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787368127.391773:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808616192:0@lo:400:kworker.0 00000100:00100000:0.0:1787368127.391795:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368127.391828:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808615936 00000100:00100000:0.0:1787368127.391835:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808615936 00000100:00100000:0.0:1787368127.391859:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808616064 00000100:00100000:0.0:1787368127.391868:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808616064 00000100:00100000:0.0:1787368127.391880:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808616320 00000100:00100000:0.0:1787368127.391882:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808616320 00000100:00100000:0.0:1787368127.391890:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808616192 00000100:00100000:0.0:1787368127.391892:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808616192 00000100:00100000:0.0:1787368127.391926:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787368127.391936:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808616192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368127.391986:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808616192:12345-0@lo:400:kworker.0 Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368127.391994:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787368127.392011:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787368127.392015:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808615936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787368127.392030:0:17162:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787368127.406460:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808615680 00000100:00100000:1.0:1787368127.406476:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808615680 00000100:00100000:1.0:1787368127.406539:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787368127.406547:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808615680:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787368127.406570:0:17168:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787368127.406660:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808615680:12345-0@lo:38:kworker.0 Request processed in 112us (15117us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368127.407347:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787368127.408762:0:19223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808615808 00000100:00100000:1.0:1787368127.408773:0:19223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808615808 00000100:00100000:1.0:1787368127.408836:0:19223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787368127.408848:0:19223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808615808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368127.408922:0:19223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808615808:12345-0@lo:400:kworker.0 Request processed in 77us (17180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368127.408930:0:19223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787368127.408958:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787368127.408963:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808616064:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787368127.408981:0:17163:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787368127.409012:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808616064:12345-0@lo:38:kworker.0 Request processed in 47us (17371us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368127.409018:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787368127.409036:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787368127.409040:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808616320:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787368127.409048:0:17163:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787368127.409070:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874190808616320:12345-0@lo:38:kworker.0 Request processed in 28us (17391us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368127.409076:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787368127.409102:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808616448:0@lo:400:kworker.0 00000100:00100000:1.0:1787368127.409138:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368127.409167:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787368127.409174:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808615552:0@lo:400:kworker.0 00000400:00000100:1.0:1787368127.409204:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190808615552 offset 0 length 224: 4 00000100:00100000:1.0:1787368127.409232:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808616448 00000100:00100000:1.0:1787368127.409244:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808616448 00000100:00100000:1.0:1787368127.410539:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787368127.410550:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808616448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368127.410622:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808616448:12345-0@lo:400:kworker.0 Request processed in 74us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368127.410630:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1787368127.422443:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787368127.422452:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787368127.422499:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c55b5076a00 x1874190808616192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368127.422528:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808616192:0@lo:400:kworker.0 00000100:00100000:2.0:1787368127.422547:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808615808:0@lo:400:kworker.0 00010000:00080000:1.0:1787368127.425845:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c55b5077800 x1874190808616448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368127.425864:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808616448:0@lo:400:kworker.0 00000100:00080000:1.0:1787368127.426459:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c558335d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368127.426466:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787368127.426470:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808615680:0@lo:38:kworker.0 00000100:00080000:1.0:1787368127.426482:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54810f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368127.426486:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787368127.426489:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808616064:0@lo:38:kworker.0 00000100:00080000:1.0:1787368127.426499:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5482222000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368127.426502:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787368127.426505:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808616320:0@lo:38:kworker.0 00000100:00100000:0.0:1787368127.433676:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808615936:12345-0@lo:38:kworker.0 Request processed in 41650us (42065us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787368127.433691:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1787368127.434237:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548367b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787368127.434253:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787368127.434258:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808615936:0@lo:38:kworker.0 00010000:00010000:1.0:1787368127.448702:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368128.472474:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368129.496578:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787368129.700495:0:21090:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787368129.729330:0:21090:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787368129.729431:0:21090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.729457:0:21090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.729465:0:21090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.729472:0:21090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.729520:0:21090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787368129.729525:0:21090:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787368129.729557:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787368129.729563:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787368129.729570:0:21090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787368129.729578:0:21090:0:(import.c:65:import_set_state_nolock()) ffff9c548367b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787368129.729583:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787368129.729584:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00010000:00010000:3.0:1787368129.729817:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368129.729825:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368129.729839:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613bc00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787368129.729843:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368129.729851:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787368129.729858:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368129.729863:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787368129.729866:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787368129.729869:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787368129.729905:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368129.729911:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787368129.729936:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368129.729943:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55b613bc00/0x66f5679bff0319a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0319a8 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368129.729954:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368129.729956:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368129.729958:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368129.729972:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787368129.729989:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808616576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368129.730050:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368129.730157:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808616576 00000100:00100000:1.0:1787368129.730165:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808616576 00000100:00100000:1.0:1787368129.730212:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787368129.730220:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1874190808616576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787368129.730226:0:17149:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787368129 with bad export cookie 7418949880858744780 00000100:00100000:2.0:1787368129.730277:0:21090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787368129.735266:0:21090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.735285:0:21090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.735293:0:21090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.735300:0:21090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.735328:0:21090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368129.735335:0:21090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.735341:0:21090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.739199:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368129.739213:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.739226:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368129.739231:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.739240:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368129.739267:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368129.739273:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787368129.739275:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1787368129.739313:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.739319:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787368129.739373:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.739381:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff031900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031907 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.739397:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368129.739398:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368129.739400:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368129.739409:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787368129.739428:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808616704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368129.739516:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787368129.740244:0:21090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740250:0:21090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740290:0:21090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368129.740300:0:21090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740307:0:21090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740314:0:21090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740321:0:21090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740343:0:21090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787368129.740349:0:21090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740371:0:21090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740378:0:21090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740398:0:21090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368129.740410:0:21090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1787368129.740414:0:21090:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1787368129.740418:0:21090:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1787368129.740468:0:21090:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1787368129.740472:0:21090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1787368129.740477:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368129.740482:0:21090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787368129.740488:0:21090:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c548320b000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787368129.740493:0:21090:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c5483080000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787368129.740498:0:21090:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9c54826bcd28) has exports, disconnecting them 00000020:00080000:2.0:1787368129.740512:0:21090:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c548320b000), last request at 1787368127 00000020:00000080:2.0:1787368129.740519:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031b1b 00000100:00080000:2.0:1787368129.740535:0:21090:0:(import.c:65:import_set_state_nolock()) ffff9c548320f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787368129.740798:0:21090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c548320b000): rc 0 00000020:00000080:2.0:1787368129.740801:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c548320b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1787368129.740812:0:21090:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c5483080000), last request at 1787368127 00000020:00000080:2.0:1787368129.740816:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031a81 00000100:00080000:2.0:1787368129.740821:0:21090:0:(import.c:65:import_set_state_nolock()) ffff9c5483085000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787368129.740827:0:21090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c5483080000): rc 0 00000020:00000080:2.0:1787368129.740829:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5483080000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1787368129.740836:0:21090:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffafad01da7ae0 00000100:00080000:2.0:1787368129.740855:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787368129.740864:0:21090:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9c55bd8f1c00 x1874190808613376/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787368136 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368129.740887:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787368129.741647:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787368129.741656:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741666:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241da00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368129.741668:0:18696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741689:0:18696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368129.741696:0:18696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368129.741701:0:18696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787368129.741703:0:18696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787368129.741705:0:18696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787368129.741750:0:18696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741756:0:18696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787368129.741783:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741791:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff031b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031b30 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741806:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787368129.741811:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741816:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67ee00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368129.741819:0:18696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741825:0:18696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368129.741841:0:18696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368129.741847:0:18696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787368129.741849:0:18696:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787368129.741851:0:18696:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787368129.741865:0:18696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741871:0:18696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787368129.741888:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741895:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bd67ee00/0x66f5679bff031d8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff031d91 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741906:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368129.741909:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741915:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d200 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368129.741918:0:18696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741924:0:18696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368129.741930:0:18696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368129.741945:0:18696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787368129.741948:0:18696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787368129.741950:0:18696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787368129.741962:0:18696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741967:0:18696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787368129.741972:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741978:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241d200/0x66f5679bff0318f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x66f5679bff0318f9 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368129.741988:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368129.741990:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368129.741992:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368129.742013:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808617088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368129.742069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368129.742112:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808613376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787368129.742134:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787368129.742140:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808616960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368129.742175:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368129.742206:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808616704 00000100:00100000:0.0:1787368129.742212:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808616704 00000100:00100000:0.0:1787368129.742238:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808617088 00000100:00100000:0.0:1787368129.742240:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808617088 00000100:00100000:0.0:1787368129.742247:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808616960 00000100:00100000:0.0:1787368129.742249:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808616960 00000100:00100000:0.0:1787368129.742271:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787368129.742278:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1874190808616704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787368129.742284:0:18318:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787368129 with bad export cookie 7418949880858744780 00000100:00100000:0.0:1787368129.742322:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1874190808616704:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (2806us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787368129.742329:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787368129.742371:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787368129.742376:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1874190808617088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787368129.742380:0:18318:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787368129 with bad export cookie 7418949880858744780 00000100:00100000:0.0:1787368129.742410:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1874190808617088:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (340us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787368129.742415:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787368129.742429:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787368129.742433:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1874190808616960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787368129.742436:0:18318:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787368129 with bad export cookie 7418949880858744780 00000100:00100000:0.0:1787368129.743241:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1874190808616960:12345-0@lo:103:ldlm_bl.0 Request processed in 802us (1062us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787368129.743249:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787368129.743281:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808616832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368129.743323:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787368129.743683:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787368129.743687:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9c5584c45000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787368129.743692:0:3654:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787368129.744777:0:21090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787368129.744785:0:21090:0:(import.c:65:import_set_state_nolock()) ffff9c558335d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1787368129.745019:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787368129.745030:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548320b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787368129.745088:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483080000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787368129.745111:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548320f800 for lustre-MDT0001 00000020:00000080:3.0:1787368129.745115:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5483085000 for lustre-MDT0001 00000100:00080000:3.0:1787368129.745553:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787368129.745659:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787368129.745664:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787368129.745677:0:21090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787368129.745743:0:21090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787368129.745768:0:21090:0:(import.c:65:import_set_state_nolock()) ffff9c5585133000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787368129.745782:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787368129.745785:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1787368129.745793:0:21090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787368129.745858:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808617216:0@lo:9:umount.0 00000100:00100000:2.0:1787368129.745916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368129.745960:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808617216 00000100:00100000:2.0:1787368129.745966:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808617216 00000100:00100000:2.0:1787368129.746016:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787368129.746025:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874190808617216:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787368129.746919:0:18670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031aab 00000100:00080000:2.0:1787368129.746933:0:18670:0:(import.c:65:import_set_state_nolock()) ffff9c548362d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787368129.746979:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1787368129.747125:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3650:x1874190808617216:12345-0@lo:9:umount.0 Request processed in 1099us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368129.747135:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787368129.747173:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787368129.747203:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5585133000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787368129.747212:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787368129.747214:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787368129.747230:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808617216:0@lo:9:umount.0 00010000:00010000:2.0:1787368129.747258:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787368129.747266:0:21090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787368129.747281:0:21090:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787368129.747298:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808617344:0@lo:9:umount.0 00000100:00100000:2.0:1787368129.747517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787368129.747688:0:21090:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9c54826bcd28) has no exports 00010000:00010000:2.0:1787368129.749455:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368129.749475:0:18318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808616832 00000100:00100000:2.0:1787368129.749485:0:18318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808616832 00000100:00100000:2.0:1787368129.749533:0:18318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787368129.749550:0:18318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be959880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1874190808616832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787368129.749557:0:18318:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787368129 with bad export cookie 7418949880858744780 00000100:00100000:2.0:1787368129.749789:0:18318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be959880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1874190808616832:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (6464us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787368129.749797:0:18318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787368129.751673:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808617344 00000100:00100000:2.0:1787368129.751688:0:19618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808617344 00000100:00100000:2.0:1787368129.751773:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787368129.751783:0:19618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874190808617344:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787368129.751818:0:19618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031b53 00000100:00080000:2.0:1787368129.751828:0:19618:0:(import.c:65:import_set_state_nolock()) ffff9c5483208000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787368129.751870:0:19618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:2.0:1787368129.752054:0:19618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3650:x1874190808617344:12345-0@lo:9:umount.0 Request processed in 272us (4723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368129.752062:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1787368129.752082:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787368129.752118:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548277b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787368129.752144:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787368129.752146:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787368129.752151:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808617344:0@lo:9:umount.0 00010000:00010000:2.0:1787368129.755734:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787368129.759341:0:3654:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787368129.759346:0:3654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787368129.759371:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55b5077100 x1874190808615552/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787368143 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368129.759583:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808615552:0@lo:400:kworker.0 00000100:00100000:0.0:1787368129.759813:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c54822c8a80 x1874190808616576/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787368145 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368129.759825:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55b5075c00 x1874190808616704/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787368145 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368129.759834:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55b5077800 x1874190808617088/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787368145 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368129.759843:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55b5074700 x1874190808616960/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787368145 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368129.759849:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55b5074a80 x1874190808616832/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787368145 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368129.761089:0:3652:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c5584c45000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787368129.761118:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808617088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368129.763400:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3ce871c-8318-4c29-9238-0157d9966155:3652:1874190808616960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368129.763985:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3ce871c-8318-4c29-9238-0157d9966155:3651:1874190808616576:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1787368129.765838:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787368129.765846:0:3654:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787368129.765847:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787368129.765852:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9c5584c45000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368129.765860:0:3654:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1787368129.765870:0:3654:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c5584c45000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368129.767124:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55be959c00 x1874190808617472/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368129.767186:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808616832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368129.767192:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3ce871c-8318-4c29-9238-0157d9966155:3654:1874190808616704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368129.767246:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3ce871c-8318-4c29-9238-0157d9966155:3650:1874190808617472:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1787368129.767294:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190808617472 offset 0 length 520: 4 00000400:00000100:1.0:1787368129.788490:0:17149:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874190808616576 offset 224 length 224: 4 00000100:00100000:1.0:1787368129.788541:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1874190808616576:12345-0@lo:103:ldlm_bl.0 Request processed in 58319us (58489us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787368129.788553:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00080000:2.0:1787368129.804808:0:21090:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9c54826bcd28) has no exports 00000020:01000000:0.0:1787368129.904885:0:21090:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5481082a80 - data ffff9c55b1467510/ffff9c55a9137c00 00000020:01000000:0.0:1787368129.905041:0:21090:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c55bd48b060 - data ffff9c5591b3a288/ffff9c55b67e0800 00000001:00000004:0.0:1787368129.916426:0:21090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1787368129.947485:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787368129.947494:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787368129.947510:0:21090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787368129.952522:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787368129.952543:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787368129.952589:0:21090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787368129.952592:0:21090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787368129.952911:0:17903:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787368129.952916:0:17903:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787368129.952925:0:17903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1787368129.953858:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787368129.953863:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1787368129.954015:0:21090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787368129.954018:0:21090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787368129.962410:0:17906:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787368129.962417:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787368129.962428:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1787368129.963937:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031915 00000020:00000080:0.0:1787368129.963950:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5483ce3000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787368129.967993:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03192a 00000020:00000080:0.0:1787368129.968007:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5483ce0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787368129.970614:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1787368129.972294:0:21090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787368129.972306:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787368129.972316:0:21090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787368129.972320:0:21090:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c54826b8000) has no exports 00000004:01000000:0.0:1787368129.972510:0:21090:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787368129.972520:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03197e 00000020:00000080:0.0:1787368129.972528:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5583444800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787368129.972533:0:21090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787368129.972546:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787368129.972552:0:21090:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787368129.972554:0:21090:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c55b55419b8) has no exports 00000020:00000080:0.0:1787368129.972561:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031977 00000020:00000080:0.0:1787368129.972564:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5482778800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787368129.972852:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787368129.972862:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5583444800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787368129.972866:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5482778800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787368129.974039:0:21090:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787368129.974045:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787368129.974050:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1787368129.974056:0:21090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787368129.974059:0:21090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787368129.974114:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787368129.974121:0:21090:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787368129.974129:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031969 00000020:00000080:0.0:1787368129.974150:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5483ce7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787368129.974155:0:21090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787368129.974159:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787368129.974164:0:21090:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787368129.974168:0:21090:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c54827719b8) has no exports 00000020:00000080:0.0:1787368129.974173:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03195b 00000020:00000080:0.0:1787368129.974177:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5585136800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787368129.974563:0:21090:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787368129.974567:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787368129.974570:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787368129.974574:0:21090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787368129.974576:0:21090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787368129.974605:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787368129.974610:0:21090:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787368129.974622:0:21090:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787368129.974628:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff03194d 00000020:00000080:0.0:1787368129.974633:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c548277e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787368129.974637:0:21090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787368129.974640:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787368129.974785:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548277b000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787368129.974795:0:36:0:(genops.c:885:class_export_put()) final put ffff9c5483ce4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787368129.974798:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787368129.974809:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787368129.974900:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787368129.974907:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5585136800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787368129.974911:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5585133000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787368129.974916:0:36:0:(genops.c:885:class_export_put()) final put ffff9c548277a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787368129.974918:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548277a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787368129.974920:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787368129.974950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548277e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787368129.975063:0:21090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787368129.975068:0:21090:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9c55b5ca0000) has no exports 00000020:00000080:0.0:1787368129.975073:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031946 00000020:00000080:0.0:1787368129.975077:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5585134800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787368129.976040:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5585134800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787368129.988615:0:21090:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1787368129.988623:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787368129.988638:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787368129.988960:0:21090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787368129.989025:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368129.989037:0:21090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787368129.989046:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c558335d800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787368129.989056:0:36:0:(genops.c:885:class_export_put()) final put ffff9c5585131800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787368129.989060:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5585131800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787368129.989071:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787368129.989073:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368129.989076:0:21090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787368129.989079:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c55b88e8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787368129.989081:0:21090:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b88e8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787368129.991822:0:21090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787368129.991990:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031931 00000020:00000080:1.0:1787368129.992000:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5483ce5800/lustre-MDD0001_UUID 00000020:01000000:1.0:1787368129.992021:0:21090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787368129.992026:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787368129.992034:0:21090:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787368129.992038:0:21090:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c55b5543370) has no exports 00000020:00000080:1.0:1787368129.992063:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368129.992068:0:21090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787368129.992072:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031938 00000020:00000080:1.0:1787368129.992075:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5483ce3800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787368129.992082:0:21090:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55a0f12000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787368129.992091:0:21090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55a0f12000 2 00000020:01000004:1.0:1787368129.992094:0:21090:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c55a0f12000 from lustre-MDT0001 00000020:00000080:1.0:1787368129.992113:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368129.992116:0:21090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787368129.992118:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5483ce7800/lustre-MDT0001_UUID 00000020:00000080:1.0:1787368129.992121:0:21090:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce7800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787368129.992129:0:21090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787368129.992154:0:21090:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787368129.992157:0:21090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787368129.992160:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787368129.992163:0:21090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787368129.992169:0:21090:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c548367c000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787368129.992186:0:21090:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9c5482774d28) has exports, disconnecting them 00000020:00080000:1.0:1787368129.992191:0:21090:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c548367c000), last request at 1787368043 00000020:00000080:1.0:1787368129.992195:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0319b6 00000020:00080000:1.0:1787368129.992208:0:21090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c548367c000): rc 0 00000020:00000080:1.0:1787368129.992212:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c548367c000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787368129.992643:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce5800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787368129.992648:0:36:0:(genops.c:885:class_export_put()) final put ffff9c5483ce4800/lustre-MDD0001_UUID 00000020:00000080:2.0:1787368129.992651:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce4800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787368129.992655:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787368129.992806:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787368129.992811:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548367c000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787368129.993602:0:21090:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787368129.993608:0:21090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787368129.993612:0:21090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787368129.993617:0:21090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787368129.993638:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548367b000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787368129.993788:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368129.993796:0:21090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787368129.993811:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c548367c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787368129.993816:0:21090:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548367c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787368129.993820:0:21090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787368129.993871:0:21090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55a0f12000 1 00000020:00000080:2.0:1787368129.993876:0:21090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0318dd 00000020:00000080:2.0:1787368129.993882:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c548277d000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787368129.993891:0:21090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787368129.993898:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548277d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787368129.993906:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368129.993910:0:21090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787368129.993913:0:21090:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9c55b5ca3370) has no exports 00000020:00000080:2.0:1787368130.115314:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368130.115327:0:21090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787368130.115945:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c55b110e000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787368130.115951:0:21090:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b110e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787368130.115962:0:21090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787368130.116093:0:21090:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c55b110d800 00000020:01000000:2.0:1787368130.116114:0:21090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787368130.116119:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368130.116124:0:21090:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787368130.116127:0:21090:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c559124b370) has no exports 00000100:00100000:2.0:1787368130.116214:0:18960:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c55bd52ea00:18960] 3 exiting: rc = 0 00000100:00100000:0.0:1787368130.116277:0:17164:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c5585a3ca00:17164] 2 exiting: rc = 0 00000100:00100000:0.0:1787368130.116389:0:17162:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c55bc6cb600:17162] 0 exiting: rc = 1 00000100:00100000:1.0:1787368130.121005:0:17163:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c55bc6cb000:17163] 1 exiting: rc = 0 00000100:00100000:0.0:1787368130.121344:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121387:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121395:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121401:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121407:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121413:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121418:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121423:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121441:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121447:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121451:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121456:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121461:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121466:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121470:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121475:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121479:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121485:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121490:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121495:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121511:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121518:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121523:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121528:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121534:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121539:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121544:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121548:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121556:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121560:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121565:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121569:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121576:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121580:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121585:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121591:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121597:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121613:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121620:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121625:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121630:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121635:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121640:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121652:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121658:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121673:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121683:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121691:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121699:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121707:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121714:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121721:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121729:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121737:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121745:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121755:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121763:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121772:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121780:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121787:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121795:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121801:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121806:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.121811:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125433:0:17165:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c5585a3da00:17165] 0 exiting: rc = 1 00000100:00100000:0.0:1787368130.125595:0:17166:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c55bb6f6c00:17166] 1 exiting: rc = 0 00000100:00100000:2.0:1787368130.125838:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125847:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125854:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125860:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125867:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125876:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125881:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125885:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125891:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125910:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125916:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125921:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125926:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125931:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125936:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125941:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125946:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125951:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125956:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125962:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125966:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125971:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125977:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125981:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125986:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125991:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.125997:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126002:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126009:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126014:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126018:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126023:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126028:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126034:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126039:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126043:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126048:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126053:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126058:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126063:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126067:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126072:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126077:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126081:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126094:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126098:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126102:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126106:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126110:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126115:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126119:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126123:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126128:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126133:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126139:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126143:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126147:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126152:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126157:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126163:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126167:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126172:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126176:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126181:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.126712:0:17904:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9c548309a400:17904] 2 exiting: rc = 0 00000100:00100000:2.0:1787368130.126799:0:17168:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c55bb6f7200:17168] 1 exiting: rc = 0 00000100:00100000:0.0:1787368130.127050:0:17167:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c55bd562e00:17167] 0 exiting: rc = 1 00000100:00100000:2.0:1787368130.127137:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127144:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127150:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127157:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127163:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127168:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127174:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127179:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127185:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127201:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127208:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127213:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127285:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127301:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127307:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127313:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127319:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127325:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127330:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127336:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127342:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127419:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127427:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127434:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127441:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127449:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127455:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127460:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127466:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127472:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127478:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127485:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127491:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127522:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127530:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127536:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127542:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127550:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127556:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127561:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127567:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127573:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127580:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127586:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127591:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127612:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127619:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127624:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127637:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127643:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127649:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127656:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127714:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127721:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127727:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127733:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127739:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127763:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127770:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127775:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127782:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127788:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127794:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.127800:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.137884:0:17169:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c55bb6f6000:17169] 0 exiting: rc = 1 00000100:00100000:1.0:1787368130.138008:0:17170:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c55bb6f7e00:17170] 1 exiting: rc = 0 00000100:00100000:2.0:1787368130.138119:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138126:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138132:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138137:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138143:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138148:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138218:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138227:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138232:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138236:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138241:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138245:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138251:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138255:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138261:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138266:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138271:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138276:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138281:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138300:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138305:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138310:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138315:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138319:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138324:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138338:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138344:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138350:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138489:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138506:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138512:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138517:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138522:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138527:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138533:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138538:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138543:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138548:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138553:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138558:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138563:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138568:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138573:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138577:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138582:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138587:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138592:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138597:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138602:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138606:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138610:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138614:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138619:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138624:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138637:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138642:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138647:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138652:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138657:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138661:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138666:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138671:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138675:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.138680:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.139128:0:17172:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c55bb6a1000:17172] 1 exiting: rc = 0 00000100:00100000:1.0:1787368130.139317:0:17171:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c5582befa00:17171] 0 exiting: rc = 1 00000100:00100000:2.0:1787368130.139519:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139525:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139530:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139535:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139540:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139546:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139551:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139556:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139561:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139567:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139572:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139576:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139581:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139586:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139591:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139596:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139601:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139606:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139612:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139617:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139624:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139630:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139634:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139639:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139645:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139661:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139667:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139672:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139676:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139681:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139685:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139690:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139764:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139772:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139777:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139782:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139788:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139793:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139798:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139803:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139808:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139813:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139818:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139823:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139827:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139832:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139837:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139842:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139847:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139852:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139858:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139863:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139868:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139873:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139878:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139883:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139888:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139894:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139899:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139904:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139919:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139924:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.139929:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.140507:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.141014:0:17173:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c55bb6a0400:17173] 0 exiting: rc = 1 00000100:00100000:1.0:1787368130.141117:0:17174:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c55bb6a1200:17174] 1 exiting: rc = 0 00000100:00100000:2.0:1787368130.141292:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141298:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141303:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141308:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141314:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141320:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141324:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141593:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141603:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141608:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141613:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141619:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141624:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141630:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141635:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141640:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141645:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141650:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141655:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141660:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141666:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141671:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141676:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141681:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141687:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141692:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141767:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141775:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141780:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141785:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141791:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141811:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141816:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141821:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141825:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141831:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141837:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141843:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141848:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141852:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141857:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141861:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141867:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141872:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141876:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141881:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141886:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141891:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141896:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141900:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141906:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141911:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141916:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141920:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141925:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141929:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141934:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141939:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141944:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141949:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141954:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141959:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141963:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.141968:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787368130.142739:0:17175:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c55bb6a0000:17175] 0 exiting: rc = 1 00000100:00100000:0.0:1787368130.142910:0:17177:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c55bb6a1a00:17177] 2 exiting: rc = 0 00000100:00100000:1.0:1787368130.143222:0:17176:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c55bb6a0c00:17176] 1 exiting: rc = 0 00000100:00100000:2.0:1787368130.143327:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143468:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143486:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143491:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143505:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143513:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143518:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143523:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143529:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143534:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143540:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143545:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143550:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143555:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143560:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143565:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143570:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143575:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143580:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143853:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143860:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143883:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143889:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143894:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143899:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143904:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143909:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143914:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143919:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143925:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143930:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143935:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143940:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143944:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143949:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143953:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143958:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143973:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143977:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143982:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143987:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143993:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.143998:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144003:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144009:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144028:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144035:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144040:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144046:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144051:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144059:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144067:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144072:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144078:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144082:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144087:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144093:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144099:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144105:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144109:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144115:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144121:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144127:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368130.144133:0:21090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787368130.150295:0:21090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368130.150308:0:21090:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787368130.150314:0:21090:0:(genops.c:885:class_export_put()) final put ffff9c5584c43800/MDS_uuid 00000020:00000080:2.0:1787368130.150318:0:21090:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5584c43800/MDS_uuid for MDS 00000020:01000000:2.0:1787368130.150328:0:21090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787368130.150670:0:21090:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787368130.521383:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368131.544762:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787368132.504606:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368132.504615:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368132.504619:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368132.504622:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787368132.504687:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c54810f8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368132.504749:0:15931:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1787368132.504756:0:15931:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787368132.504762:0:15931:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c54810f8800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368132.504801:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55be958a80 x1874190808617600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368132.504863:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808617600:0@lo:38:kworker.0 00000400:00000100:3.0:1787368132.504913:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808617600 offset 0 length 520: 4 00000100:00080000:0.0:1787368132.505057:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368132.505060:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787368132.505063:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c5482222000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368132.505067:0:15931:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1787368132.505070:0:15931:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787368132.505073:0:15931:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c5482222000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368132.505086:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55be95a300 x1874190808617856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368132.505125:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808617728:0@lo:400:kworker.0 00000400:00000100:1.0:1787368132.505149:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808617728 offset 0 length 224: 4 00000100:00100000:3.0:1787368132.507192:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808617856:0@lo:38:kworker.0 00000400:00000100:3.0:1787368132.507244:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808617856 offset 0 length 520: 4 00000100:00100000:0.0:1787368132.513980:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808617984:0@lo:400:kworker.0 00000400:00000100:0.0:1787368132.514037:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808617984 offset 0 length 224: 4 00010000:00010000:2.0:1787368132.568572:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368133.594781:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787368134.043094:0:21291:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787368134.061499:0:21291:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787368134.061552:0:21291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368134.061568:0:21291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368134.061576:0:21291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368134.061584:0:21291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368134.061608:0:21291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787368134.061614:0:21291:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787368134.061650:0:21291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787368134.061662:0:21291:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55be958a80 x1874190808617600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787368152 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368134.061693:0:21291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787368134.061700:0:21291:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787368134.061706:0:21291:0:(import.c:65:import_set_state_nolock()) ffff9c54810f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787368134.061711:0:21291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787368134.061715:0:21291:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55be958a80 x1874190808617600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787368152 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368134.061723:0:21291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787368134.061726:0:21291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:0.0:1787368134.061838:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368134.061846:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368134.061854:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368134.061858:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368134.061867:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368134.061882:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368134.061888:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787368134.061891:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787368134.061894:0:17150:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787368134.061907:0:17150:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c5584c45000 00010000:00010000:0.0:1787368134.061911:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368134.061918:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff031a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031a57 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368134.061929:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368134.061931:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368134.061933:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368134.062057:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808617600:0@lo:38:kworker.0 00000100:00080000:1.0:1787368134.063897:0:21291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787368134.063912:0:21291:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55be95aa00 x1874190808617728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368134.063990:0:21291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787368134.063997:0:21291:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787368134.064021:0:21291:0:(import.c:65:import_set_state_nolock()) ffff9c5482227800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787368134.064437:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808618112:0@lo:39:umount.0 00000400:00000100:3.0:1787368134.064499:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808618112 offset 0 length 224: 4 00000100:00100000:0.0:1787368134.064885:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808617728:0@lo:400:kworker.0 00010000:00010000:2.0:1787368134.616596:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787368135.576793:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787368135.576802:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368135.576806:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787368135.576809:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787368135.576918:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787368135.576938:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808618240:0@lo:400:kworker.0 00000400:00000100:3.0:1787368135.576988:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808618240 offset 0 length 224: 4 00000001:00100000:1.0:1787368135.578645:0:18666:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787368135.578653:0:18666:0:(genops.c:885:class_export_put()) final put ffff9c5483629000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787368135.578810:0:15931:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483629000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787368135.578857:0:15931:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c548362d000 for lustre-OST0000 00000001:00100000:1.0:1787368135.579099:0:19486:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787368135.579103:0:19486:0:(genops.c:885:class_export_put()) final put ffff9c5483209000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787368135.579171:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483209000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787368135.579202:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5483208000 for lustre-OST0001 00010000:00010000:0.0:1787368135.640509:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368136.664666:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787368137.625546:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787368137.625572:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368137.625575:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787368137.625578:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787368137.626170:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808618368:0@lo:400:kworker.0 00000400:00000100:3.0:1787368137.626228:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808618368 offset 0 length 224: 4 00010000:00010000:2.0:1787368137.688663:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368138.712531:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368139.163767:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368129/real 1787368129] req@ffff9c55be959c00 x1874190808617472/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787368139 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368139.163800:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55be959c00 x1874190808617472/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787368139 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787368139.163836:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5584c45000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787368139.163864:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787368139.163868:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3ce871c-8318-4c29-9238-0157d9966155:3650:1874190808617472:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1787368139.163948:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787368139.163954:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787368139.163957:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c5584c45000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368139.163963:0:15931:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 587 00000100:00080000:1.0:1787368139.163969:0:15931:0:(import.c:589:import_select_connection()) MGC192.168.203.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787368139.163977:0:15931:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c5584c45000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368139.164013:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf5f80 x1874190808618496/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368139.164044:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787368139.164048:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787368139.164157:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808618624:0@lo:400:kworker.0 00000400:00000100:2.0:1787368139.164207:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808618624 offset 0 length 224: 4 00000100:00100000:0.0:1787368139.164473:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3ce871c-8318-4c29-9238-0157d9966155:3650:1874190808618496:0@lo:250:kworker.0 00000400:00000100:0.0:1787368139.164504:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190808618496 offset 0 length 520: 4 00010000:00010000:0.0:1787368139.736511:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368140.761222:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368141.784507:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368142.809697:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368143.832600:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368144.280501:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368134/real 1787368134] req@ffff9c55acbf6a00 x1874190808618112/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787368144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368144.280549:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55acbf6a00 x1874190808618112/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787368144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368144.280572:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5482227800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787368144.280591:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808618112:0@lo:39:umount.0 00000100:00080000:1.0:1787368144.280678:0:21291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787368144.280682:0:21291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787368144.280687:0:21291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787368144.281629:0:21291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368144.281644:0:21291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368144.281652:0:21291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368144.281659:0:21291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368144.281700:0:21291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368144.281708:0:21291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368144.281714:0:21291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368144.281720:0:21291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368144.281727:0:21291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368144.281750:0:21291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787368144.281754:0:21291:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787368144.281775:0:21291:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787368144.281780:0:21291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787368144.281784:0:21291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787368144.281788:0:21291:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787368144.281793:0:21291:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9c55b8aacd28) has no exports 00000020:00080000:1.0:1787368144.281816:0:21291:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9c55b8aacd28) has no exports 00000100:00080000:0.0:1787368144.281853:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368144.281859:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368144.281861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368144.281864:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787368144.282047:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368144.282056:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368144.282077:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368144.282081:0:18696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368144.282092:0:18696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368144.282099:0:18696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368144.282105:0:18696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787368144.282108:0:18696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787368144.282110:0:18696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787368144.282125:0:18696:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c5584c45000 00010000:00010000:2.0:1787368144.282130:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368144.282138:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f600/0x66f5679bff031a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031a2d expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368144.282165:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368144.282170:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368144.282176:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368144.282179:0:18696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368144.282186:0:18696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368144.282192:0:18696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368144.282198:0:18696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787368144.282200:0:18696:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787368144.282202:0:18696:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787368144.282209:0:18696:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c5584c45000 00010000:00010000:2.0:1787368144.282212:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368144.282218:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff031d7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031d83 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368144.282226:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368144.282228:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368144.282230:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368144.282243:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368144.282260:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808618752:0@lo:400:kworker.0 00000400:00000100:2.0:1787368144.282329:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808618752 offset 0 length 224: 4 00000020:01000000:1.0:1787368144.283546:0:21291:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5481082360 - data ffff9c55b162bbd0/ffff9c55acb7ac00 00000020:01000000:1.0:1787368144.283675:0:21291:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c548358a720 - data ffff9c55b16d7d80/ffff9c55bead6000 00010000:00010000:3.0:1787368144.284450:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787368144.304793:0:21291:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787368144.321724:0:21291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031a3b 00000020:00000080:1.0:1787368144.321738:0:21291:0:(genops.c:885:class_export_put()) final put ffff9c54810fc000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787368144.321800:0:21291:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55bd40d800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787368144.321804:0:21291:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bd40d800 2 00000020:01000004:1.0:1787368144.321807:0:21291:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c55bd40d800 from lustre-OST0000 00000020:00000080:1.0:1787368144.321844:0:21291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368144.321854:0:21291:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787368144.321858:0:21291:0:(genops.c:885:class_export_put()) final put ffff9c558fb4b800/lustre-OST0000_UUID 00000020:00000080:1.0:1787368144.321861:0:21291:0:(genops.c:844:class_export_destroy()) destroying export ffff9c558fb4b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787368144.321867:0:21291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787368144.321921:0:21291:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787368144.321926:0:21291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787368144.321930:0:21291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787368144.321935:0:21291:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787368144.321942:0:21291:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c5483081000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787368144.321948:0:21291:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9c55b8aa99b8) has exports, disconnecting them 00000020:00080000:1.0:1787368144.321954:0:21291:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c5483081000), last request at 1787368058 00000020:00000080:1.0:1787368144.321959:0:21291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031a65 00000020:00080000:1.0:1787368144.321968:0:21291:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c5483081000): rc 0 00000020:00000080:1.0:1787368144.321972:0:21291:0:(genops.c:885:class_export_put()) final put ffff9c5483081000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787368144.323209:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54810fc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787368144.329432:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483081000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787368144.333529:0:21291:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787368144.333539:0:21291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787368144.333543:0:21291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787368144.333560:0:21291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787368144.333783:0:21291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787368144.333793:0:21291:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787368144.333802:0:21291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787368144.333810:0:21291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787368144.333815:0:21291:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787368144.333824:0:21291:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c5482226000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787368144.333831:0:21291:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9c55b5540000) has exports, disconnecting them 00000020:00080000:3.0:1787368144.333836:0:21291:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c5482226000), last request at 1787368058 00000020:00000080:3.0:1787368144.333839:0:21291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031a7a 00000020:00080000:3.0:1787368144.333852:0:21291:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c5482226000): rc 0 00000020:00000080:3.0:1787368144.333857:0:21291:0:(genops.c:885:class_export_put()) final put ffff9c5482226000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787368144.334325:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c54810f8800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787368144.334333:0:36:0:(genops.c:885:class_export_put()) final put ffff9c54810fe000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787368144.334336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c54810fe000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787368144.334341:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787368144.334439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5482226000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787368144.335925:0:21291:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787368144.335931:0:21291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787368144.335935:0:21291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787368144.335940:0:21291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787368144.335963:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5482227800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787368144.336113:0:21291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368144.336120:0:21291:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787368144.336124:0:21291:0:(genops.c:885:class_export_put()) final put ffff9c5482222800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787368144.336127:0:21291:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5482222800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787368144.336132:0:21291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787368144.336179:0:21291:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55bd40d800 1 00000020:00000080:2.0:1787368144.336185:0:21291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031a18 00000020:00000080:2.0:1787368144.336191:0:21291:0:(genops.c:885:class_export_put()) final put ffff9c55a35c7000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787368144.336199:0:21291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787368144.336206:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a35c7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787368144.336213:0:21291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368144.336218:0:21291:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787368144.336221:0:21291:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9c5482773370) has no exports 00000020:00000080:2.0:1787368144.378187:0:21291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368144.378199:0:21291:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787368144.378212:0:21291:0:(genops.c:885:class_export_put()) final put ffff9c5483ce1000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787368144.378217:0:21291:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483ce1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787368144.378227:0:21291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787368144.378332:0:21291:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c5483ce1800 00000020:02000400:2.0:1787368144.378424:0:21291:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787368144.858653:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368145.882316:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368146.904600:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368147.928566:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787368147.940135:0:21493:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787368147.962708:0:21493:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787368147.962805:0:21493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368147.962820:0:21493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368147.962826:0:21493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368147.962833:0:21493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368147.962853:0:21493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787368147.962868:0:21493:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787368147.962891:0:21493:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787368147.962901:0:21493:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55be95a300 x1874190808617856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787368152 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368147.962916:0:21493:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787368147.962920:0:21493:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787368147.962925:0:21493:0:(import.c:65:import_set_state_nolock()) ffff9c5482222000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787368147.962929:0:21493:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787368147.962932:0:21493:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55be95a300 x1874190808617856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787368152 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368147.962939:0:21493:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787368147.962941:0:21493:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:3.0:1787368147.963052:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808617856:0@lo:38:kworker.0 00010000:00010000:2.0:1787368147.963648:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368147.963656:0:18696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368147.963666:0:18696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368147.963670:0:18696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368147.963679:0:18696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368147.963686:0:18696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368147.963692:0:18696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787368147.963694:0:18696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787368147.963696:0:18696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787368147.963710:0:18696:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c5584c45000 00010000:00010000:2.0:1787368147.963714:0:18696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368147.963721:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55b613b000/0x66f5679bff031aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031af1 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368147.963745:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368147.963747:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368147.963748:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787368147.964019:0:21493:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787368147.964027:0:21493:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55be95b800 x1874190808617984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368147.964055:0:21493:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55acbf7800 x1874190808618240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368151 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368147.964066:0:21493:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55acbf4380 x1874190808618368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368147.964072:0:21493:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55acbf7480 x1874190808618624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368155 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368147.964083:0:21493:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55be959c00 x1874190808618752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368160 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368147.964091:0:21493:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787368147.964095:0:21493:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787368147.964115:0:21493:0:(import.c:65:import_set_state_nolock()) ffff9c5483209800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787368147.964122:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808617984:0@lo:400:kworker.0 00000100:00100000:2.0:1787368147.964150:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808618752:0@lo:400:kworker.0 00000100:00100000:2.0:1787368147.964158:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808618624:0@lo:400:kworker.0 00000100:00100000:3.0:1787368147.964188:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808618368:0@lo:400:kworker.0 00000100:00100000:3.0:1787368147.964195:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874190808618240:0@lo:400:kworker.0 00000100:00100000:3.0:1787368147.964227:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808618880:0@lo:39:umount.0 00000400:00000100:3.0:1787368147.964271:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190808618880 offset 0 length 224: 4 00010000:00010000:3.0:1787368148.957671:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787368149.400950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368149.400960:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787368149.983194:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368151.000679:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368152.024653:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368153.052053:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368154.073701:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368154.136525:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368139/real 1787368139] req@ffff9c55acbf5f80 x1874190808618496/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787368154 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368154.136559:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55acbf5f80 x1874190808618496/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787368154 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368154.136579:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5584c45000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368154.136604:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787368154.136609:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3ce871c-8318-4c29-9238-0157d9966155:3650:1874190808618496:0@lo:250:kworker.0 00000100:00080000:0.0:1787368154.136693:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b3ce871c-8318-4c29-9238-0157d9966155->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787368154.136699:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787368154.136701:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c5584c45000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368154.136706:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 596 00000100:00080000:0.0:1787368154.136710:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.104@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787368154.136716:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c5584c45000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368154.136748:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55be95aa00 x1874190808619008/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368154.136820:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3ce871c-8318-4c29-9238-0157d9966155:3650:1874190808619008:0@lo:250:kworker.0 00000400:00000100:3.0:1787368154.136876:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190808619008 offset 0 length 520: 4 00010000:00010000:3.0:1787368155.096589:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368156.120969:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368157.144683:0:18696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368157.210142:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368147/real 1787368147] req@ffff9c55acbf4a80 x1874190808618880/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787368157 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368157.210175:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55acbf4a80 x1874190808618880/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787368157 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368157.210195:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5483209800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787368157.210213:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808618880:0@lo:39:umount.0 00000100:00080000:1.0:1787368157.210248:0:21493:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787368157.210268:0:21493:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787368157.210273:0:21493:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787368157.211231:0:21493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368157.211245:0:21493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368157.211253:0:21493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368157.211259:0:21493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368157.211287:0:21493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368157.211294:0:21493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368157.211301:0:21493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368157.211307:0:21493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368157.211323:0:21493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368157.211345:0:21493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787368157.211350:0:21493:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787368157.211396:0:21493:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00010000:00010000:3.0:1787368157.211398:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000000:1.0:1787368157.211401:0:21493:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787368157.211413:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1787368157.211417:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787368157.211420:0:21493:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787368157.211426:0:21493:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9c55b8aa8000) has no exports 00000020:00080000:1.0:1787368157.211448:0:21493:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9c55b8aa8000) has no exports 00010000:00010000:2.0:1787368157.211549:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368157.211556:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368157.211565:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368157.211569:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368157.211578:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368157.211584:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368157.211590:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787368157.211592:0:17151:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787368157.211594:0:17151:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787368157.211607:0:17151:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c5584c45000 00010000:00010000:2.0:1787368157.211617:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368157.211624:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bd67f000/0x66f5679bff031d6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031d75 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368157.211641:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368157.211643:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368157.211650:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368157.211676:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787368157.211679:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368157.211686:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787368157.211691:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368157.211696:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787368157.211698:0:17150:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787368157.211699:0:17150:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787368157.211706:0:17150:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c5584c45000 00010000:00010000:3.0:1787368157.211708:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368157.211714:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bd67e000/0x66f5679bff031ac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff031ac7 expref: -99 pid: 19485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368157.211722:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368157.211724:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368157.211725:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787368157.213257:0:21493:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c548358a180 - data ffff9c55b1439438/ffff9c55acb3b000 00000020:01000000:1.0:1787368157.213757:0:21493:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c5481082720 - data ffff9c5481cacca8/ffff9c55bd5c6800 00100000:10000000:1.0:1787368157.222296:0:21493:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787368157.236097:0:21493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031ad5 00000020:00000080:0.0:1787368157.236117:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c548349f000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787368157.236138:0:21493:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c5483083000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787368157.236141:0:21493:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5483083000 2 00000020:01000004:0.0:1787368157.236145:0:21493:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c5483083000 from lustre-OST0001 00000020:00000080:0.0:1787368157.236173:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787368157.236182:0:21493:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787368157.236185:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c558fb4f800/lustre-OST0001_UUID 00000020:00000080:0.0:1787368157.236188:0:21493:0:(genops.c:844:class_export_destroy()) destroying export ffff9c558fb4f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787368157.236194:0:21493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1787368157.236298:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548349f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1787368157.236306:0:21493:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b3ce871c-8318-4c29-9238-0157d9966155->MGS 00010000:00010000:0.0:1787368157.236332:0:21493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0318eb expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368157.236347:0:21493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0318eb expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368157.236374:0:21493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787368157.236377:0:21493:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787368157.236380:0:21493:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787368157.236392:0:21493:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c5584c45000 00010000:00010000:0.0:1787368157.236396:0:21493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241dc00/0x66f5679bff0318e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0318eb expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368157.236519:0:21493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368157.236530:0:21493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368157.236535:0:21493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787368157.236537:0:21493:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787368157.236539:0:21493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787368157.236550:0:21493:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c5584c45000 00010000:00010000:2.0:1787368157.236553:0:21493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55b613a200/0x66f5679bff0317d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x66f5679bff0317da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787368157.236569:0:21493:0:(import.c:65:import_set_state_nolock()) ffff9c5584c45000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787368157.236573:0:21493:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787368157.236575:0:21493:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787368157.236576:0:21493:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787368157.236579:0:21493:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787368157.236588:0:21493:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c55be95aa00 x1874190808619008/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787368174 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787368157.236604:0:21493:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787368157.236614:0:21493:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:3.0:1787368157.236708:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3ce871c-8318-4c29-9238-0157d9966155:3650:1874190808619008:0@lo:250:kworker.0 10000000:01000000:2.0:1787368157.236771:0:21493:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787368157.236777:0:21493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff0317be 00000020:00000080:2.0:1787368157.236782:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c5584c40000/b3ce871c-8318-4c29-9238-0157d9966155 00000020:01000000:2.0:1787368157.236796:0:21493:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.104@tcp (flags='') 00000020:00000080:2.0:1787368157.236801:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368157.236806:0:21493:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787368157.236810:0:21493:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c5591248000) has no exports 10000000:01000000:2.0:1787368157.236829:0:17159:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1787368157.236911:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5584c40000/b3ce871c-8318-4c29-9238-0157d9966155 for MGC192.168.203.104@tcp 10000000:01000000:3.0:1787368157.236935:0:21493:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.104@tcp: client import never connected 00000100:00080000:3.0:1787368157.236938:0:21493:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787368157.236946:0:21493:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787368157.236949:0:21493:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787368157.236951:0:21493:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787368157.236976:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5584c45000 for MGC192.168.203.104@tcp 00000020:00000080:3.0:1787368157.237002:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787368157.237006:0:21493:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.104@tcp (uuid b3ce871c-8318-4c29-9238-0157d9966155) 00000020:00000080:3.0:1787368157.237009:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c5483e3a800/b3ce871c-8318-4c29-9238-0157d9966155 00000020:00000080:3.0:1787368157.237011:0:21493:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483e3a800/b3ce871c-8318-4c29-9238-0157d9966155 for MGC192.168.203.104@tcp 00000020:01000000:3.0:1787368157.237014:0:21493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.104@tcp (b3ce871c-8318-4c29-9238-0157d9966155) 00000020:01000000:3.0:1787368157.237241:0:21493:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787368157.237245:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787368157.237249:0:21493:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787368157.237253:0:21493:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c55b6780000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787368157.237258:0:21493:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9c55b5544d28) has exports, disconnecting them 00000020:00080000:3.0:1787368157.237262:0:21493:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c55b6780000), last request at 1787368073 00000020:00000080:3.0:1787368157.237267:0:21493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031aff 00000020:00080000:3.0:1787368157.237282:0:21493:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c55b6780000): rc 0 00000020:00000080:3.0:1787368157.237286:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c55b6780000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787368157.237324:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b6780000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787368157.237929:0:21493:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787368157.237933:0:21493:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787368157.237937:0:21493:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787368157.237941:0:21493:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787368157.238067:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368157.238072:0:21493:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787368157.238077:0:21493:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787368157.238081:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368157.238084:0:21493:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787368157.238088:0:21493:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c5483499000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787368157.238094:0:21493:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9c55912fcd28) has exports, disconnecting them 00000020:00080000:2.0:1787368157.238097:0:21493:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c5483499000), last request at 1787368073 00000020:00000080:2.0:1787368157.238100:0:21493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031b14 00000020:00080000:2.0:1787368157.238110:0:21493:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c5483499000): rc 0 00000020:00000080:2.0:1787368157.238114:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c5483499000/lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787368157.246224:0:21493:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787368157.246233:0:21493:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787368157.246238:0:21493:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787368157.246245:0:21493:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787368157.249660:0:18696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787368157.250391:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:0.0:1787368157.253423:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5482222000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787368157.253443:0:36:0:(genops.c:885:class_export_put()) final put ffff9c55b6787000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787368157.253447:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b6787000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787368157.253471:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787368157.253539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483499000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1787368157.253545:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c5483209800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787368157.255748:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787368157.256128:0:17145:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c5585569200:17145] 0 exiting: rc = 1 00000100:00100000:2.0:1787368157.256821:0:17146:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c5585568800:17146] 1 exiting: rc = 0 00000100:00100000:3.0:1787368157.257019:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787368157.257269:0:18318:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c55a03fe400:18318] 3 exiting: rc = 0 00000100:00100000:2.0:1787368157.257341:0:17148:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c5585568c00:17148] 1 exiting: rc = 0 00000100:00100000:3.0:1787368157.257445:0:17149:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c548334d000:17149] 2 exiting: rc = 0 00000100:00100000:2.0:1787368157.258592:0:17147:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c5585569000:17147] 0 exiting: rc = 1 00000100:00100000:2.0:1787368157.259044:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259052:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259068:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259075:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259084:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259091:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259100:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259112:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259123:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259129:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259134:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259139:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259144:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259150:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259155:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259159:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259164:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259169:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259175:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259182:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259188:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259194:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259204:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259209:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259213:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259218:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259224:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259232:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259238:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259243:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259248:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259253:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259258:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259263:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259268:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259272:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259277:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259288:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259293:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259298:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259304:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259308:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259325:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259331:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259336:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259342:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259348:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259374:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259384:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259393:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259510:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259519:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259580:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259586:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259591:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259603:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259608:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259614:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259620:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259627:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259758:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259764:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259823:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.259832:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787368157.272100:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787368157.272113:0:21493:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1787368157.272119:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c548320d800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1787368157.272123:0:21493:0:(genops.c:844:class_export_destroy()) destroying export ffff9c548320d800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1787368157.272129:0:21493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1787368157.272194:0:21493:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5483083000 1 00000020:00000080:2.0:1787368157.272200:0:21493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x66f5679bff031ab9 00000020:00000080:2.0:1787368157.272214:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c55b6785000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787368157.272236:0:21493:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787368157.272241:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787368157.272246:0:21493:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787368157.272249:0:21493:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9c55912499b8) has no exports 00000020:00000080:0.0:1787368157.272348:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55b6785000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787368157.309148:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368157.309162:0:21493:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787368157.309167:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c5483086800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787368157.309172:0:21493:0:(genops.c:844:class_export_destroy()) destroying export ffff9c5483086800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787368157.309182:0:21493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787368157.309910:0:21493:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c5483087000 00000020:01000000:1.0:1787368157.309931:0:21493:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787368157.309936:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787368157.309941:0:21493:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787368157.309945:0:21493:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9c55b8aab370) has no exports 00000020:00000080:1.0:1787368157.309975:0:21493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787368157.309982:0:21493:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787368157.309985:0:21493:0:(genops.c:885:class_export_put()) final put ffff9c55a35c0000/OSS_uuid 00000020:00000080:1.0:1787368157.309987:0:21493:0:(genops.c:844:class_export_destroy()) destroying export ffff9c55a35c0000/OSS_uuid for OSS 00000020:01000000:1.0:1787368157.309991:0:21493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787368157.310235:0:18671:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c55b67bfc00:18671] 1 exiting: rc = 0 00000100:00100000:0.0:1787368157.310335:0:18672:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c55bdb8a000:18672] 2 exiting: rc = 0 00000100:00080000:2.0:1787368157.310476:0:17158:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787368157.310607:0:19618:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9c5483252400:19618] 4 exiting: rc = 0 00000100:00100000:2.0:1787368157.310677:0:19223:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c55bd6e1a00:19223] 3 exiting: rc = 0 00000100:00100000:3.0:1787368157.310895:0:18670:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c55b67be000:18670] 0 exiting: rc = 1 00000100:00100000:1.0:1787368157.311060:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311068:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311073:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311078:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311083:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311088:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311094:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311099:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311104:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311110:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311117:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311134:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311139:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311144:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311149:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311153:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311158:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311163:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311168:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311173:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311178:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311184:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311189:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311194:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311199:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311204:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311209:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311214:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311219:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311223:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311228:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311234:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311239:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311243:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311247:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311251:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311270:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311276:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311280:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311285:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311290:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311295:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311301:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311306:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311319:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311326:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311340:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311346:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311351:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311381:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311386:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311391:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311396:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311401:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311405:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311410:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311415:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311419:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311424:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311431:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311435:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311440:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311445:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.311450:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.312953:0:18674:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c55bdb89200:18674] 1 exiting: rc = 0 00000100:00100000:3.0:1787368157.313145:0:19965:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c54834c3600:19965] 2 exiting: rc = 0 00000100:00100000:0.0:1787368157.313271:0:18673:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c55b6748200:18673] 0 exiting: rc = 1 00000100:00100000:1.0:1787368157.313676:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313684:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313689:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313695:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313699:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313704:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313710:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313715:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313720:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313726:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313731:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313736:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313742:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313747:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313752:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313757:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313775:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313780:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313786:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313791:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313796:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313800:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313805:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313809:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313814:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313818:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313822:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313827:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313832:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313837:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313842:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313847:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313853:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313857:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313862:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313866:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313871:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313875:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313880:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313884:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313889:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313893:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313897:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313902:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313907:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313911:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313915:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313919:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313924:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313929:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313933:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313944:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313948:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313953:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313957:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313961:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313966:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313971:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313975:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313980:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313985:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313990:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.313995:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.314000:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787368157.315125:0:18675:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c55bd6e1200:18675] 0 exiting: rc = 1 00000100:00100000:0.0:1787368157.315409:0:18676:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c55b6748800:18676] 1 exiting: rc = 0 00000100:00100000:2.0:1787368157.315692:0:18677:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c55bd53d000:18677] 2 exiting: rc = 0 00000100:00100000:1.0:1787368157.316214:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316222:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316237:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316245:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316264:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316272:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316277:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316285:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316292:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316298:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316304:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316309:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316326:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316331:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316336:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316342:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316348:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316382:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316390:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316396:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316402:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316407:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316427:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316433:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316439:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.316446:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317082:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317091:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317097:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317102:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317106:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317112:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317117:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317123:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317129:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317134:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317139:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317144:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317150:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317155:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317160:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317165:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317171:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317176:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317181:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317186:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317191:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317196:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317202:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317207:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317226:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317232:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317237:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317242:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317247:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317265:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317271:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317285:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317300:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317307:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317321:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317327:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317332:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.317345:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787368157.324097:0:18678:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c5582d10600:18678] 0 exiting: rc = 1 00000100:00100000:2.0:1787368157.324180:0:18679:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c558673b200:18679] 1 exiting: rc = 0 00000100:00100000:1.0:1787368157.324553:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324561:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324566:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324571:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324576:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324581:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324587:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324592:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324596:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324601:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324607:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324612:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324617:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324622:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324627:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324632:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.324637:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325108:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325117:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325122:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325127:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325132:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325137:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325142:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325147:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325152:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325157:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325161:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325176:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325181:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325186:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325191:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325196:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325201:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325205:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325210:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325214:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325218:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325223:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325227:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325232:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325237:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325242:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325246:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325251:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325255:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325260:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325266:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325271:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325275:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325280:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325285:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325290:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325294:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325299:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325304:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325308:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325321:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325327:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325332:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325337:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325342:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325348:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.325378:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326270:0:18681:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c558675f400:18681] 1 exiting: rc = 0 00000100:00100000:2.0:1787368157.326522:0:18680:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c55bdb8ba00:18680] 0 exiting: rc = 1 00000100:00100000:1.0:1787368157.326835:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326852:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326878:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326885:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326891:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326897:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326903:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326908:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326915:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326921:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326926:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326932:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326938:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326944:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326964:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326971:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326977:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326983:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326989:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.326994:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327000:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327005:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327011:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327016:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327022:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327027:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327047:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327054:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327060:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327065:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327070:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327075:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327080:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327098:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327104:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327109:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327114:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327120:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327139:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327146:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327151:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327156:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327162:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327172:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327179:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327185:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327191:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327196:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327202:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327208:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327228:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327234:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327240:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327246:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327252:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327258:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327263:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327268:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327274:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327279:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327285:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327291:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327297:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787368157.327309:0:21493:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787368157.343671:0:21493:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787368174.065755:0:22258:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787368183.557146:0:22857:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787368183.557153:0:22857:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787368183.557160:0:22857:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787368183.557266:0:22857:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c55acbc7800 00000020:01000004:3.0:1787368183.557282:0:22857:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787368183.557291:0:22857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787368183.557305:0:22857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c55b5ca3370) 00000020:00000080:3.0:1787368183.557319:0:22857:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787368183.654561:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787368183.655165:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787368183.658113:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1787368183.659115:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787368183.659467:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787368183.660266:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787368183.660751:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787368183.661148:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787368183.661571:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787368183.661775:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787368183.661999:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787368183.662348:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787368183.662763:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787368183.663149:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787368183.663724:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787368183.669818:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.670384:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.670758:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1787368183.671301:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.672812:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787368183.673823:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1787368183.674305:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.674764:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.675013:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.675401:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1787368183.675871:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.676145:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.676457:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.676941:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787368183.677264:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787368183.683644:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787368183.684094:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787368183.684817:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787368183.685436:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787368183.685795:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787368183.686391:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787368183.686864:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787368183.687176:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787368183.687491:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787368183.687880:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787368183.688183:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787368183.688851:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787368183.689179:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787368183.689510:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787368183.690651:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787368183.691032:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787368183.691384:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787368183.694346:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787368183.695217:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787368183.695643:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787368183.696476:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787368183.696962:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787368183.697374:0:22857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1787368183.698031:0:22857:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787368183.698655:0:22857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787368183.698664:0:22857:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787368183.698675:0:22857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff0323e9 00000020:01000004:2.0:1787368183.698682:0:22857:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787368183.698687:0:22857:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787368183.698692:0:22857:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c55acbc7800 from MGS 00000020:01000004:2.0:1787368183.698696:0:22857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787368183.698706:0:22857:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c55b8aa99b8) 00000020:00000080:2.0:1787368183.698716:0:22857:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787368183.698772:0:22857:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55acbc7800 from MGS, refs=2 00080000:01000000:2.0:1787368183.698776:0:22857:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787368183.698780:0:22857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff0323f7 00000100:00100000:2.0:1787368183.698876:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787368183.699001:0:22857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787368183.699007:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787368183.702197:0:22857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787368183.702211:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787368183.703181:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787368183.703730:0:22857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787368183.703736:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787368183.705727:0:22857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787368183.705738:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787368183.706272:0:22857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787368183.706289:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787368183.707001:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368183.707004:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368183.707006:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368183.707403:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368183.707405:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368183.707407:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368183.708029:0:22857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1787368183.718762:0:22857:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:0.0:1787368183.719142:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787368183.729210:0:22870:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787368183.729426:0:22857:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787368183.729490:0:22857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787368183.733240:0:22857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787368183.734147:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787368183.735250:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787368183.735259:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787368183.736142:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787368183.736150:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787368183.742939:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787368183.742957:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787368183.744885:0:22857:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787368183.744909:0:22857:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.104@tcp' 00000020:01000004:0.0:1787368183.744911:0:22857:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787368183.744940:0:22857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.104@tcp (typ=mgc) 00000020:00000080:0.0:1787368183.744953:0:22857:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.104@tcp (ffff9c55912fb370) 00000020:00000080:0.0:1787368183.744968:0:22857:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787368183.745045:0:22857:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c548211f000@MGC192.168.203.104@tcp: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368183.745191:0:22857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.104@tcp-0 is initialized 00000040:01000000:0.0:1787368183.745197:0:22857:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787368183.749765:0:22874:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787368183.749807:0:22875:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787368183.750257:0:22857:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.104@tcp (uuid cdb7fc68-6ac7-4a03-989c-ef7cf48653be) 00000020:00000080:1.0:1787368183.750378:0:22857:0:(genops.c:1385:class_connect()) connect: client cdb7fc68-6ac7-4a03-989c-ef7cf48653be, cookie 0x66f5679bff032405 00000100:00080000:1.0:1787368183.750395:0:22857:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787368183.750401:0:22857:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c548211f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368183.750435:0:22857:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf5c00 x1874190808619136/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368183.750461:0:22857:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cdb7fc68-6ac7-4a03-989c-ef7cf48653be->MGS 00000020:01000004:1.0:1787368183.750488:0:22857:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787368183.750493:0:22857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787368183.750507:0:22857:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c55912499b8) 00000020:00000080:1.0:1787368183.750519:0:22857:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787368183.750758:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3650:1874190808619136:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787368183.750829:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368183.752440:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808619136 00000100:00100000:2.0:1787368183.752452:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808619136 00000100:00100000:2.0:1787368183.752733:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787368183.752741:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3650:x1874190808619136:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787368183.752770:0:22871:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cdb7fc68-6ac7-4a03-989c-ef7cf48653be@0@lo t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:2.0:1787368183.752801:0:22871:0:(genops.c:1385:class_connect()) connect: client cdb7fc68-6ac7-4a03-989c-ef7cf48653be, cookie 0x66f5679bff032413 00000100:00080000:2.0:1787368183.752936:0:22871:0:(import.c:65:import_set_state_nolock()) ffff9c55a35c7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787368183.753030:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+5:3650:x1874190808619136:12345-0@lo:250:mount.lustre.0 Request processed in 288us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368183.753038:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787368183.753730:0:3650:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787368183.753740:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1787368183.753750:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787368183.753755:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787368183.753759:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c548211f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787368183.753762:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787368183.753766:0:3650:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787368183.753771:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3650:1874190808619136:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787368183.762740:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787368183.763014:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787368183.763020:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787368183.766477:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787368183.766492:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787368183.767340:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787368183.767349:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787368183.769038:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787368183.769834:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787368183.769922:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787368183.770987:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787368183.770996:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787368183.836562:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787368183.836776:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787368183.836783:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787368183.842680:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787368183.842696:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787368183.843679:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787368183.844009:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787368183.844015:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787368183.844771:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787368183.844778:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787368183.845591:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787368183.845753:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787368183.845758:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787368183.846661:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787368183.846669:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787368183.847627:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787368183.847793:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787368183.847799:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787368183.848594:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787368183.848604:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787368183.868005:0:22857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787368183.868538:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787368183.868546:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787368183.871007:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787368183.871033:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787368183.871917:0:22857:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787368183.871937:0:22857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787368183.873018:0:22857:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787368183.873046:0:22857:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787368183.873052:0:22857:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787368183.873171:0:22857:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787368183.873203:0:22857:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787368183.873207:0:22857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787368183.873209:0:22857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787368183.873210:0:22857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787368183.873211:0:22857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787368183.873212:0:22857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787368183.873213:0:22857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787368183.873225:0:22857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787368183.873226:0:22857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787368183.873228:0:22857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787368183.873229:0:22857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787368183.873231:0:22857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787368183.873233:0:22857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787368183.873234:0:22857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787368183.873235:0:22857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787368183.873237:0:22857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787368183.873237:0:22857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787368183.873238:0:22857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787368183.873239:0:22857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787368183.873240:0:22857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787368183.873241:0:22857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787368183.873242:0:22857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787368183.873267:0:22857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787368183.873287:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be958380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787368183.873394:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368183.873434:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368183.873440:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808619264 00000100:00100000:1.0:1787368183.873449:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808619264 00000100:00100000:1.0:1787368183.873496:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787368183.873506:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+5:22857:x1874190808619264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787368183.873554:0:22873:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787368183.873557:0:22873:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787368183.873560:0:22873:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787368183.874064:0:22894:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787368183.874537:0:22873:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1787368183.885202:0:22895:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787368183.885210:0:22895:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787368183.885212:0:22895:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787368183.885215:0:22895:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787368183.885619:0:22895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787368183.885829:0:22873:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787368183.885839:0:22873:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787368183.887892:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+5:22857:x1874190808619264:12345-0@lo:253:mount.lustre.0 Request processed in 14380us (14529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368183.887906:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787368183.887998:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be958380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619264:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787368183.888013:0:22857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787368183.888016:0:22857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787368183.888017:0:22857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787368183.888018:0:22857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368183.888020:0:22857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368183.888021:0:22857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368183.888022:0:22857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368183.888023:0:22857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787368183.888024:0:22857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787368183.888026:0:22857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368183.888027:0:22857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787368183.888045:0:22857:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c55acbc7800 from lustre-MDT0000 10000000:01000000:3.0:1787368183.888072:0:22857:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787368183.888074:0:22857:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787368183.888078:0:22857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c55912fb370 10000000:01000000:3.0:1787368183.888082:0:22857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787368183.888089:0:22857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c55912fb370 from 1 10000000:01000000:3.0:1787368183.888092:0:22857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787368183.888147:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368183.888158:0:22857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368183.888167:0:22857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368183.888185:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787368183.888230:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368183.888266:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a9386840 going to sleep for 11 seconds 00000100:00100000:2.0:1787368183.888540:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808619392 00000100:00100000:2.0:1787368183.888547:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808619392 00000100:00100000:2.0:1787368183.888584:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787368183.888593:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+5:22857:x1874190808619392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368183.888605:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368183.888621:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75400/0x66f5679bff032421 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03241a expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368183.888642:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75400/0x66f5679bff032421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03241a expref: 6 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368183.888653:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75400/0x66f5679bff032421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03241a expref: 6 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368183.888662:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75400, rc 0) 00000100:00100000:2.0:1787368183.888708:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+6:22857:x1874190808619392:12345-0@lo:101:mount.lustre.0 Request processed in 116us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368183.888714:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787368183.888794:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368183.888807:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368183.888816:0:22857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368183.888947:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368183.888974:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368183.889000:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a9386840 going to sleep for 11 seconds 00000100:00100000:1.0:1787368183.889164:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808619520 00000100:00100000:1.0:1787368183.889169:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808619520 00000100:00100000:1.0:1787368183.889206:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787368183.889213:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+6:22857:x1874190808619520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368183.889528:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619520:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787368183.889556:0:22857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787368183.889566:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368183.889575:0:22857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368183.889593:0:22857:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c55acbc7800 10000000:01000000:3.0:1787368183.889597:0:22857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787368183.889601:0:22857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c55acbc7800 10000000:01000000:3.0:1787368183.889603:0:22857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787368183.889606:0:22857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c55acbc7800 from 1 10000000:01000000:3.0:1787368183.889609:0:22857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787368183.889628:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff032428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368183.889635:0:22857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff032428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368183.889645:0:22857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff032428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368183.889660:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787368183.889976:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368183.890007:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a9386840 going to sleep for 11 seconds 00000100:00100000:2.0:1787368183.893060:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808619648 00000100:00100000:2.0:1787368183.893074:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808619648 00000100:00100000:2.0:1787368183.893152:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787368183.893162:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+7:22857:x1874190808619648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368183.893177:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368183.893196:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75000/0x66f5679bff03242f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032428 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368183.893413:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+8:22857:x1874190808619520:12345-0@lo:501:mount.lustre.0 Request processed in 4198us (4436us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787368183.893422:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787368183.893442:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75000/0x66f5679bff03242f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032428 expref: 7 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368183.893454:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75000/0x66f5679bff03242f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032428 expref: 7 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368183.893463:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75000, rc 0) 00000100:00100000:2.0:1787368183.893690:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+7:22857:x1874190808619648:12345-0@lo:101:mount.lustre.0 Request processed in 529us (3713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368183.893698:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787368183.893837:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619648:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368183.893863:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff032428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03242f expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368183.893872:0:22857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff032428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03242f expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368183.893889:0:22857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787368183.895968:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff032428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03242f expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368183.895983:0:22857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241d800/0x66f5679bff032428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03242f expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368183.895992:0:22857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787368183.895999:0:22857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787368183.896006:0:22857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c55acbc7800 10000000:01000000:0.0:1787368183.896009:0:22857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787368183.896013:0:22857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787368183.896015:0:22857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787368183.896050:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff032436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368183.896058:0:22857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff032436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368183.896069:0:22857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff032436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368183.896089:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368183.896427:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368183.896462:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684780 going to sleep for 11 seconds 00000100:00100000:1.0:1787368183.896834:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808619776 00000100:00100000:1.0:1787368183.896841:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808619776 00000100:00100000:1.0:1787368183.896892:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787368183.896900:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+7:22857:x1874190808619776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368183.896922:0:22873:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368183.896937:0:22873:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55814a0a00/0x66f5679bff03243d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032436 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368183.896961:0:22873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55814a0a00/0x66f5679bff03243d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032436 expref: 8 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368183.896972:0:22873:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55814a0a00/0x66f5679bff03243d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032436 expref: 8 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368183.896980:0:22873:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0a00, rc 0) 00000100:00100000:1.0:1787368183.897033:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+8:22857:x1874190808619776:12345-0@lo:101:mount.lustre.0 Request processed in 134us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368183.897041:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787368183.897076:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368183.897093:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff032436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03243d expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368183.897101:0:22857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff032436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03243d expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368183.897186:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368183.897211:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368183.897417:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5598213240 going to sleep for 11 seconds 00000100:00100000:3.0:1787368183.897579:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808619904 00000100:00100000:3.0:1787368183.897585:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808619904 00000100:00100000:3.0:1787368183.897624:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787368183.897632:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+8:22857:x1874190808619904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368183.897775:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+9:22857:x1874190808619904:12345-0@lo:501:mount.lustre.0 Request processed in 143us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368183.897782:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787368183.897867:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808619904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368183.897910:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808620032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368183.897955:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368183.897977:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684540 going to sleep for 11 seconds 00000100:00100000:1.0:1787368183.898166:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808620032 00000100:00100000:1.0:1787368183.898171:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808620032 00000100:00100000:1.0:1787368183.898201:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368183.898209:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+9:22857:x1874190808620032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368183.900451:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+9:22857:x1874190808620032:12345-0@lo:503:mount.lustre.0 Request processed in 2233us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368183.900465:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787368183.900524:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808620032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368183.900910:0:22896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22896:1874190808620160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787368183.900971:0:22896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368183.901009:0:22896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5598213480 going to sleep for 11 seconds 00000100:00100000:3.0:1787368183.901029:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808620160 00000100:00100000:3.0:1787368183.901036:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808620160 00000100:00100000:3.0:1787368183.901180:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787368183.901189:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+9:22896:x1874190808620160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368183.904795:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+9:22896:x1874190808620160:12345-0@lo:502:llog_process_th.0 Request processed in 3597us (3814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368183.904810:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787368183.904918:0:22896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22896:1874190808620160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787368183.904966:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368183.904978:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368183.904981:0:22896:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787368183.904987:0:22896:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787368183.904990:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787368183.905006:0:22896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c55b8aab370) 00000020:00000080:2.0:1787368183.905026:0:22896:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787368183.905032:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787368183.905144:0:22896:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787368183.905151:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff03244b 00000020:00000080:2.0:1787368183.905762:0:22896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787368183.905769:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368183.905773:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368183.905775:0:22896:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787368183.905778:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368183.905782:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368183.905784:0:22896:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787368183.905788:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787368183.905796:0:22896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c55b8aa8000) 00000020:00000080:2.0:1787368183.905808:0:22896:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787368183.905813:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787368183.905815:0:22896:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787368183.905818:0:22896:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787368183.905824:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787368183.905871:0:22896:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55acbc7800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787368183.905883:0:22896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c55b8aacd28) 00000020:00000080:2.0:1787368183.905891:0:22896:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787368183.905963:0:22896:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787368183.905969:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff032460 00000020:00000080:2.0:1787368183.906080:0:22896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787368183.906086:0:22896:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787368183.906091:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x66f5679bff032467 00080000:01000000:2.0:1787368183.906232:0:22896:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787368183.906237:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff03246e 00010000:00010000:2.0:1787368184.040709:0:22896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787368184.041424:0:22896:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934679 00000001:00080000:2.0:1787368184.041706:0:22896:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787368184.042561:0:22896:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c55bd6d99b8) 00000020:00000080:2.0:1787368184.042578:0:22896:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787368184.042678:0:22896:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787368184.042686:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff03247c 00000020:00000080:2.0:1787368184.043608:0:22896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787368184.047257:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x66f5679bff032483 00000020:00000080:2.0:1787368184.047736:0:22896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787368184.047748:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368184.047755:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.047757:0:22896:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787368184.047760:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787368184.047763:0:22896:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787368184.047765:0:22896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368184.047767:0:22896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368184.047769:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787368184.047771:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.047772:0:22896:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787368184.047775:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368184.047780:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.047781:0:22896:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787368184.047785:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787368184.047826:0:22896:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787368184.050541:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368184.060180:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368184.060190:0:22896:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787368184.060202:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368184.060211:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368184.060213:0:22896:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787368184.060216:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787368184.060222:0:22896:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:0.0:1787368184.060252:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368184.060268:0:22896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c55912f8000) 00000020:00000080:0.0:1787368184.060345:0:22896:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787368184.060367:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787368184.060473:0:22896:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787368184.060481:0:22896:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787368184.060488:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff032491 00010000:00080000:0.0:1787368184.060520:0:22896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55bd409800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1787368184.067898:0:22896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1787368184.070858:0:22896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787368184.070871:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787368184.070911:0:22896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787368184.071728:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff032498 00000100:00080000:0.0:1787368184.071740:0:22896:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368184.071746:0:22896:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55bd409800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368184.071783:0:22896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55be95bb80 x1874190808620288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368184.071879:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808620288:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787368184.072152:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787368184.072293:0:22896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787368184.072391:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368184.072398:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368184.072400:0:22896:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787368184.072403:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787368184.072406:0:22896:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1787368184.072408:0:22896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368184.072409:0:22896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368184.072410:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787368184.072413:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368184.072415:0:22896:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787368184.072417:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787368184.072422:0:22896:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787368184.072425:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368184.072426:0:22896:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787368184.072429:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787368184.072433:0:22896:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1787368184.072453:0:22896:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787368184.072456:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368184.072470:0:22896:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c55912f99b8) 00000020:00000080:0.0:1787368184.072489:0:22896:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787368184.072494:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787368184.072573:0:22896:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787368184.072580:0:22896:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787368184.072587:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff0324a6 00010000:00080000:0.0:1787368184.072615:0:22896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5481b9f000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368184.072819:0:22896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1787368184.074176:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808620288 00000100:00100000:2.0:1787368184.074186:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808620288 00000100:00100000:2.0:1787368184.074218:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787368184.074226:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808620288:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1787368184.074245:0:22883:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1787368184.074465:0:22896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787368184.075202:0:22896:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787368184.092858:0:22896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368184.093147:0:22896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787368184.098920:0:22896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1787368184.101568:0:22902:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787368184.101586:0:22902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787368184.102475:0:22896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787368184.102487:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787368184.102524:0:22896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787368184.102542:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff0324ad 00000100:00080000:1.0:1787368184.102553:0:22896:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787368184.102567:0:22896:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c5481b9f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368184.102618:0:22896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf7b80 x1874190808620416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368184.102640:0:22896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787368184.102696:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787368184.102700:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368184.102702:0:22896:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787368184.102705:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787368184.102708:0:22896:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787368184.102710:0:22896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787368184.102712:0:22896:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787368184.102713:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787368184.102716:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368184.102717:0:22896:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787368184.102720:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787368184.102723:0:22896:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787368184.102727:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368184.102728:0:22896:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787368184.102730:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787368184.102735:0:22896:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1787368184.102757:0:22896:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787368184.102760:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787368184.102771:0:22896:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c5591248000) 00000020:00000080:1.0:1787368184.102782:0:22896:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787368184.102786:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787368184.102839:0:22896:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787368184.102845:0:22896:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787368184.102850:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x66f5679bff0324bb 00010000:00080000:1.0:1787368184.102878:0:22896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c54845c9000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1787368184.103086:0:22896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787368184.103161:0:22896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787368184.103183:0:22896:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787368184.103408:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808620416:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787368184.103460:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808620416 offset 0 length 520: 4 00000040:00080000:1.0:1787368184.106145:0:22896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787368184.106344:0:22896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787368184.106825:0:22896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:2.0:1787368184.108806:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808620288:12345-0@lo:38:llog_process_th.0 Request processed in 34574us (36649us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787368184.108821:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787368184.108931:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787368184.108937:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787368184.108941:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808620288:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787368184.110533:0:22904:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787368184.110540:0:22904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787368184.112323:0:22896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787368184.112340:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787368184.112729:0:22896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787368184.112751:0:22896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff0324c2 00000100:00080000:1.0:1787368184.112762:0:22896:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787368184.112767:0:22896:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c54845c9000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368184.112801:0:22896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf7100 x1874190808620544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368184.112855:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808620544:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787368184.112908:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808620544 offset 0 length 520: 4 00000100:00080000:1.0:1787368184.112974:0:22896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787368184.113031:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787368184.113035:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368184.113037:0:22896:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787368184.113040:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787368184.113044:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368184.113046:0:22896:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787368184.113049:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787368184.113051:0:22896:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787368184.113053:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787368184.113055:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368184.113056:0:22896:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787368184.113058:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787368184.113061:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368184.113062:0:22896:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787368184.113065:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787368184.113093:0:22896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22896:1874190808620672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368184.113155:0:22896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368184.113173:0:22896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483435540 going to sleep for 11 seconds 00000100:00100000:2.0:1787368184.116219:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808620672 00000100:00100000:2.0:1787368184.116235:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808620672 00000100:00100000:2.0:1787368184.116304:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787368184.116315:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+9:22896:x1874190808620672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787368184.116509:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+9:22896:x1874190808620672:12345-0@lo:502:llog_process_th.0 Request processed in 195us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368184.116517:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787368184.118099:0:22896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22896:1874190808620672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787368184.118151:0:22896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787368184.118160:0:22896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368184.118162:0:22896:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787368184.118166:0:22896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787368184.118508:0:22857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787368184.118532:0:22857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787368184.118547:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff032436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03243d expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.118558:0:22857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68bc00/0x66f5679bff032436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03243d expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368184.118565:0:22857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55acbc7800 from 1 10000000:01000000:2.0:1787368184.118568:0:22857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787368184.118614:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.118622:0:22857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.118632:0:22857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368184.118666:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808620800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368184.118723:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368184.118762:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582af2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368184.118874:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808620800 00000100:00100000:3.0:1787368184.118880:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808620800 00000100:00100000:3.0:1787368184.118931:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368184.118941:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+9:22857:x1874190808620800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368184.118953:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368184.118966:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0324c9 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368184.118987:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0324c9 expref: 10 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368184.118997:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0324c9 expref: 10 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368184.119015:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ce00, rc 0) 00000100:00100000:3.0:1787368184.119053:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+10:22857:x1874190808620800:12345-0@lo:101:mount.lustre.0 Request processed in 114us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368184.119059:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787368184.119205:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808620800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368184.119217:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.119226:0:22857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368184.126069:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808620928:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787368184.126164:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368184.126255:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55a9386840 going to sleep for 11 seconds 00000100:00100000:3.0:1787368184.127391:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808620928 00000100:00100000:3.0:1787368184.127403:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808620928 00000100:00100000:3.0:1787368184.127459:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787368184.127470:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+10:22857:x1874190808620928:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787368184.127493:0:22871:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787368184.127499:0:22871:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787368184.127738:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+10:22857:x1874190808620928:12345-0@lo:256:mount.lustre.0 Request processed in 269us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368184.127747:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787368184.127907:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808620928:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787368184.129054:0:22857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787368184.129112:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368184.129123:0:22857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368184.129140:0:22857:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55acbc7800 from 1 10000000:01000000:0.0:1787368184.129143:0:22857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787368184.129180:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368184.129186:0:22857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368184.129195:0:22857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368184.129215:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787368184.129265:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368184.129319:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684780 going to sleep for 11 seconds 00000100:00100000:2.0:1787368184.129447:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808621056 00000100:00100000:2.0:1787368184.129454:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808621056 00000100:00100000:2.0:1787368184.129503:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368184.129513:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+10:22857:x1874190808621056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368184.129525:0:22873:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368184.129538:0:22873:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0324d7 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.129559:0:22873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0324d7 expref: 11 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.129568:0:22873:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0324d7 expref: 11 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.129587:0:22873:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75e00, rc 0) 00000100:00100000:2.0:1787368184.129632:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22857:x1874190808621056:12345-0@lo:101:mount.lustre.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368184.129649:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787368184.129795:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368184.129808:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368184.129816:0:22857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368184.129889:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368184.129917:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368184.132710:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684780 going to sleep for 11 seconds 00000100:00100000:2.0:1787368184.132862:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808621184 00000100:00100000:2.0:1787368184.132872:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808621184 00000100:00100000:2.0:1787368184.132949:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787368184.132960:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22857:x1874190808621184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368184.133141:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22857:x1874190808621184:12345-0@lo:501:mount.lustre.0 Request processed in 183us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368184.133150:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787368184.133394:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368184.133443:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368184.133500:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368184.133517:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bc684780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368184.133594:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808621312 00000100:00100000:3.0:1787368184.133598:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808621312 00000100:00100000:3.0:1787368184.133628:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368184.133635:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22857:x1874190808621312:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368184.133715:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22857:x1874190808621312:12345-0@lo:503:mount.lustre.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368184.133722:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787368184.133858:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368184.136190:0:22906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22906:1874190808621440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787368184.136286:0:22906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368184.136333:0:22906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582af2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787368184.136475:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808621440 00000100:00100000:3.0:1787368184.136481:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808621440 00000100:00100000:3.0:1787368184.136536:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787368184.136546:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22906:x1874190808621440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368184.137219:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22906:x1874190808621440:12345-0@lo:502:llog_process_th.0 Request processed in 673us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368184.137229:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787368184.137411:0:22906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22906:1874190808621440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787368184.137441:0:22906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368184.137452:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.137454:0:22906:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787368184.137461:0:22906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55acbc7800 00000020:00000080:2.0:1787368184.137463:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787368184.137470:0:22906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368184.137473:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.137474:0:22906:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787368184.137477:0:22906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368184.137479:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.137480:0:22906:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787368184.137483:0:22906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55acbc7800 00000020:00000080:2.0:1787368184.137485:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787368184.137542:0:22906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368184.137545:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.137546:0:22906:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787368184.137558:0:22906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368184.137561:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.137563:0:22906:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787368184.137566:0:22906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55acbc7800 00000020:00000080:2.0:1787368184.137568:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787368184.137601:0:22906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368184.137604:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.137606:0:22906:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787368184.137608:0:22906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368184.137611:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.137612:0:22906:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787368184.137616:0:22906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55acbc7800 00000020:00000080:2.0:1787368184.137618:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787368184.137657:0:22906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22906:1874190808621568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787368184.137700:0:22906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368184.137729:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808621568 00000100:00100000:2.0:1787368184.137734:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808621568 00000100:00100000:2.0:1787368184.137762:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787368184.137770:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22906:x1874190808621568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787368184.137850:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22906:x1874190808621568:12345-0@lo:502:llog_process_th.0 Request processed in 80us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368184.137857:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787368184.137894:0:22906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582af2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787368184.137907:0:22906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22906:1874190808621568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787368184.139380:0:22906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368184.139391:0:22906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368184.139393:0:22906:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787368184.139398:0:22906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787368184.139498:0:22857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787368184.139584:0:22857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787368184.139611:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368184.139778:0:22857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368184.139835:0:22857:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787368184.139838:0:22857:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c55acbc7800 10000000:01000000:1.0:1787368184.139842:0:22857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c55acbc7800 10000000:01000000:1.0:1787368184.139846:0:22857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787368184.139852:0:22857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55acbc7800 from 1 10000000:01000000:1.0:1787368184.139855:0:22857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787368184.139891:0:22857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0e00/0x66f5679bff0324e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368184.139900:0:22857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a0e00/0x66f5679bff0324e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368184.139911:0:22857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a0e00/0x66f5679bff0324e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368184.139932:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368184.140562:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368184.140601:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483435a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368184.143071:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808621696 00000100:00100000:3.0:1787368184.143087:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808621696 00000100:00100000:3.0:1787368184.143154:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787368184.143165:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22857:x1874190808621696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368184.143183:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368184.143200:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241de00/0x66f5679bff0324ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0324e5 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368184.143225:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241de00/0x66f5679bff0324ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0324e5 expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368184.143236:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241de00/0x66f5679bff0324ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0324e5 expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368184.143245:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241de00, rc 0) 00000100:00100000:3.0:1787368184.143706:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22857:x1874190808621696:12345-0@lo:101:mount.lustre.0 Request processed in 541us (3144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368184.143713:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787368184.144802:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368184.144828:0:22857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a0e00/0x66f5679bff0324e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0324ec expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368184.144841:0:22857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0e00/0x66f5679bff0324e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0324ec expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368184.144928:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368184.145334:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368184.145464:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483435a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787368184.147073:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808621824 00000100:00100000:2.0:1787368184.147093:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808621824 00000100:00100000:2.0:1787368184.147158:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787368184.147170:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22857:x1874190808621824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368184.147333:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22857:x1874190808621824:12345-0@lo:501:mount.lustre.0 Request processed in 166us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368184.147341:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787368184.147440:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368184.147490:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368184.147540:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368184.147579:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808621952 00000100:00100000:1.0:1787368184.147583:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483435a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787368184.147585:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808621952 00000100:00100000:2.0:1787368184.147769:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787368184.147778:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22857:x1874190808621952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368184.147861:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22857:x1874190808621952:12345-0@lo:503:mount.lustre.0 Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368184.147868:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787368184.148444:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808621952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368184.151387:0:22908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22908:1874190808622080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368184.151466:0:22908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368184.151505:0:22908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368184.151543:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808622080 00000100:00100000:2.0:1787368184.151550:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808622080 00000100:00100000:2.0:1787368184.151591:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787368184.152001:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22908:x1874190808622080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787368184.152148:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22908:x1874190808622080:12345-0@lo:502:llog_process_th.0 Request processed in 547us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368184.152156:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787368184.152598:0:22908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22908:1874190808622080:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787368184.152958:0:22908:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787368184.152974:0:22908:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c559124b370) 00000020:00000080:1.0:1787368184.152996:0:22908:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787368184.153095:0:22908:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55acbc7800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787368184.153098:0:22908:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55acbc7800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787368184.153108:0:22908:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55acbc7800 4 00010000:00080000:1.0:1787368184.153159:0:22908:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5592d23000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1787368184.159998:0:22908:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1787368184.160211:0:22908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787368184.160255:0:22908:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787368184.160269:0:22908:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x66f5679bff0324fa 00000100:00080000:1.0:1787368184.160279:0:22908:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787368184.160286:0:22908:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c5592d23000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368184.160321:0:22908:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf4e00 x1874190808622208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368184.160352:0:22908:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787368184.160413:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808622208:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787368184.160487:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368184.160586:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808622208 00000100:00100000:3.0:1787368184.160593:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808622208 00000100:00100000:3.0:1787368184.160627:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787368184.160641:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808622208:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787368184.160693:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808622208:12345-0@lo:38:llog_process_th.0 Request processed in 52us (206us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787368184.160700:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787368184.160735:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787368184.160744:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5592d23000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368184.160747:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787368184.160751:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808622208:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787368184.163928:0:22908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22908:1874190808622336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368184.164022:0:22908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368184.164069:0:22908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67240 going to sleep for 11 seconds 00000100:00100000:3.0:1787368184.164566:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808622336 00000100:00100000:3.0:1787368184.164586:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808622336 00000100:00100000:3.0:1787368184.164641:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787368184.164652:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22908:x1874190808622336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787368184.164804:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22908:x1874190808622336:12345-0@lo:502:llog_process_th.0 Request processed in 154us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368184.172915:0:22908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22908:1874190808622336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368184.173098:0:22908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22908:1874190808622464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368184.173184:0:22908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368184.173225:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808622464 00000100:00100000:1.0:1787368184.173231:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808622464 00000100:00100000:1.0:1787368184.173274:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787368184.173283:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+13:22908:x1874190808622464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787368184.173405:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+13:22908:x1874190808622464:12345-0@lo:502:llog_process_th.0 Request processed in 121us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368184.173414:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787368184.173458:0:22908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368184.174848:0:22908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22908:1874190808622464:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787368184.174906:0:22908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787368184.174985:0:22857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787368184.175004:0:22857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787368184.175024:0:22857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0e00/0x66f5679bff0324e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0324ec expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368184.175036:0:22857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a0e00/0x66f5679bff0324e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0324ec expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787368184.175085:0:22857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787368184.175087:0:22857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787368184.175088:0:22857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368184.175089:0:22857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368184.175091:0:22857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368184.175092:0:22857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368184.175093:0:22857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787368184.175095:0:22857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787368184.175096:0:22857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368184.175098:0:22857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787368184.175101:0:22857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787368184.175104:0:22857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787368184.175105:0:22857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787368184.175106:0:22857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368184.175108:0:22857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368184.175109:0:22857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368184.175110:0:22857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368184.175111:0:22857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787368184.175112:0:22857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787368184.175113:0:22857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368184.175114:0:22857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787368184.175145:0:22857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787368184.175162:0:22857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808622592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787368184.175219:0:22857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368184.175249:0:22857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67240 going to sleep for 11 seconds 00000100:00100000:1.0:1787368184.175269:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808622592 00000100:00100000:1.0:1787368184.175279:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808622592 00000100:00100000:1.0:1787368184.175317:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787368184.175325:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+13:22857:x1874190808622592:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787368184.175349:0:22872:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787368184.175378:0:22872:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787368184.177139:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 20000000:01000000:1.0:1787368184.183551:0:22872:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787368184.183571:0:22872:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787368184.184006:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22857:x1874190808622592:12345-0@lo:253:mount.lustre.0 Request processed in 8677us (8782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368184.184019:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787368184.184087:0:22857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22857:1874190808622592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787368184.184101:0:22857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787368184.184104:0:22857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787368184.184105:0:22857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787368184.184107:0:22857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368184.184108:0:22857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368184.184109:0:22857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368184.184111:0:22857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368184.184112:0:22857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787368184.184113:0:22857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787368184.184115:0:22857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368184.184116:0:22857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787368184.184137:0:22857:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787368184.185195:0:22894:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787368184.185202:0:22894:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787368184.185224:0:22894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.185240:0:22894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0324c9 expref: 11 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.185264:0:22894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.185301:0:22894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0324c9 expref: 11 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.185317:0:22894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0324c9 expref: 11 pid: 22872 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368184.185331:0:22894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808622720:0@lo:104: 00000100:00100000:2.0:1787368184.185400:0:22894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368184.185436:0:22894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c890c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368184.185473:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808622720 00000100:00100000:2.0:1787368184.185480:0:22861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808622720 00000100:00100000:2.0:1787368184.185519:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787368184.185528:0:22861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808622720:12345-0@lo:104: 00010000:00010000:2.0:1787368184.185540:0:22861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.185587:0:22861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787368184.185592:0:22861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808622720:12345-0@lo:104: Request processed in 66us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368184.185599:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787368184.185951:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368184.185959:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368184.185966:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368184.185970:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368184.185979:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368184.185998:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368184.186004:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787368184.186046:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368184.186053:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787368184.186075:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368184.186082:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0324c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0324d0 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368184.186102:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368184.186104:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368184.186404:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368184.186446:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787368184.186458:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808622848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787368184.186504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368184.186859:0:22894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808622720:0@lo:104: 00010000:00010000:2.0:1787368184.186878:0:22894:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368184.186936:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808622848 00000100:00100000:2.0:1787368184.186947:0:22863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808622848 00010000:00010000:2.0:1787368184.186968:0:22863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0324c9 expref: 12 pid: 22872 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368184.187003:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787368184.187012:0:22863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:3652:x1874190808622848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368184.187024:0:22863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368184.187029:0:22863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0324c9 expref: 12 pid: 22872 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187038:0:22863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0324c9 expref: 12 pid: 22872 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187052:0:22863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241ce00/0x66f5679bff0324d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0324c9 expref: 12 pid: 22872 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187063:0:22863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187071:0:22863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787368184.187083:0:22863:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001881412s 00010000:00010000:2.0:1787368184.187088:0:22863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187095:0:22863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187102:0:22863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187138:0:22863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187145:0:22863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368184.187149:0:22863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187158:0:22863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187172:0:22863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187181:0:22863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368184.187219:0:22863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:3652:x1874190808622848:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368184.187227:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787368184.187244:0:22894:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187251:0:22894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368184.187258:0:22894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e74600/0x66f5679bff032501 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368184.187284:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808622848:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787368184.226331:0:22857:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:0.0:1787368184.227165:0:22857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787368184.227482:0:22918:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1787368184.227487:0:22918:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1787368184.227749:0:22919:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787368184.227890:0:22857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1787368184.228342:0:22919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787368184.228449:0:22920:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c55bd8f3800 x1874190808622976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368184.228460:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000040:01000000:0.0:1787368184.228730:0:22857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787368184.228951:0:22857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787368184.229554:0:22857:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787368184.229565:0:22857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787368184.231744:0:22857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368184.237933:0:22857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787368184.238227:0:22919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787368184.238437:0:22919:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1787368184.241607:0:22857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787368184.241692:0:22857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787368184.242511:0:22857:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1787368184.243044:0:22857:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1787368184.245820:0:22857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787368184.247973:0:22857:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787368184.248016:0:22857:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafad01c6f988 00100000:10000000:3.0:1787368184.248025:0:22857:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787368184.252144:0:22857:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787368184.252163:0:22857:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787368184.252182:0:22857:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787368184.252203:0:22857:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787368184.255148:0:22857:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787368184.255437:0:22857:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787368184.730877:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787368185.112482:0:22875:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787368185.112490:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55acbc7800 from 11 10000000:01000000:3.0:1787368185.112496:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787368185.112538:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368185.112554:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368185.112566:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368185.112615:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808623104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787368185.112679:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368185.112716:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb5943c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368185.112737:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808623104 00000100:00100000:3.0:1787368185.112744:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808623104 00000100:00100000:3.0:1787368185.112791:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787368185.112800:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+11:22875:x1874190808623104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368185.112813:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368185.112826:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032508 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368185.112848:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032508 expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368185.112858:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032508 expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368185.112866:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241dc00, rc 0) 00000100:00100000:3.0:1787368185.112903:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22875:x1874190808623104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368185.112910:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787368185.112962:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808623104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368185.112975:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368185.112984:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368185.113028:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808623232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787368185.113057:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368185.113080:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb5943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368185.113214:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808623232 00000100:00100000:0.0:1787368185.113219:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808623232 00000100:00100000:0.0:1787368185.113252:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787368185.113259:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22875:x1874190808623232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787368185.113272:0:22872:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787368185.113288:0:22872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787368185.113291:0:22872:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787368185.113459:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:22875:x1874190808623232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368185.113466:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787368185.113488:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808623232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787368185.113524:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787368185.113531:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368185.113539:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368185.240952:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000040:00080000:3.0:1787368185.241489:0:22914:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787368185.241494:0:22914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787368185.247331:0:22914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:0.0:1787368185.247348:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787368185.758444:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787368186.264503:0:22914:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787368186.264512:0:22914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787368186.264677:0:22914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 1 00000040:00080000:0.0:1787368186.264709:0:22914:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787368186.264876:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1787368186.265046:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00010000:00010000:1.0:1787368186.781880:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368187.288774:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00010000:00010000:0.0:1787368187.805213:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368188.312451:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00010000:00010000:0.0:1787368188.824627:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787368188.901295:0:23163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787368189.336552:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787368189.336559:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787368189.336563:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368189.336571:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 641 00000100:00080000:1.0:1787368189.336577:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787368189.336584:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55bd409800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368189.336606:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf6680 x1874190808623488/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368189.336615:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787368189.336628:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808623360:0@lo:400:kworker.0 00000100:00080000:1.0:1787368189.336637:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368189.336641:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368189.336643:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368189.336646:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368189.336648:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787368189.336651:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787368189.336652:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c5592d23000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368189.336657:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c5592d23000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368189.336668:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf6300 x1874190808623616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368189.336695:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368189.336754:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808623488:0@lo:38:kworker.0 00000100:00100000:0.0:1787368189.336777:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000100:00100000:3.0:1787368189.336831:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368189.336858:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808623616:0@lo:38:kworker.0 00000100:00100000:3.0:1787368189.336909:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368189.336968:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808623616 00000100:00100000:2.0:1787368189.336977:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808623616 00000100:00100000:1.0:1787368189.336985:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808623360 00000100:00100000:1.0:1787368189.336988:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808623360 00000100:00100000:2.0:1787368189.337014:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787368189.337014:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787368189.337021:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874190808623616:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787368189.337021:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:3651:x1874190808623360:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787368189.337041:0:22880:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 646 last 0 00000020:00000080:2.0:1787368189.337077:0:22880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x66f5679bff032516 00000100:00100000:1.0:1787368189.337081:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:3651:x1874190808623360:12345-0@lo:400:kworker.0 Request processed in 60us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368189.337088:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00100000:2.0:1787368189.337091:0:22880:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787368189.337173:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808623488 00000100:00100000:0.0:1787368189.337184:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808623488 00000100:00100000:0.0:1787368189.337227:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787368189.337232:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808623488:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1787368189.337243:0:22880:0:(import.c:65:import_set_state_nolock()) ffff9c5586609000 : changing import state from RECOVER to FULL 00010000:00020000:0.0:1787368189.337254:0:22884:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787368189.337336:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808623360:0@lo:400:kworker.0 00000100:00100000:0.0:1787368189.337493:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808623488:12345-0@lo:38:kworker.0 Request processed in 259us (661us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787368189.337500:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368189.338190:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874190808623616:12345-0@lo:38:kworker.0 Request processed in 1166us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368189.338199:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787368189.341686:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787368189.341699:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787368189.341704:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808623488:0@lo:38:kworker.0 00010000:00080000:0.0:1787368189.341743:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c55acbf6300 x1874190808623616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787368189.341761:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787368189.341769:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787368189.341775:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787368189.341779:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5592d23000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787368189.341785:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874190808623616:0@lo:38:kworker.0 00000020:00000004:2.0:1787368189.685963:0:23215:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787368189.686187:0:23215:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787368189.848560:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368190.361405:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000020:00000004:2.0:1787368190.612159:0:23265:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787368190.613756:0:23265:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787368190.875252:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368191.386027:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00010000:00010000:0.0:1787368191.900699:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368192.408435:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00010000:00010000:1.0:1787368192.931757:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368193.432716:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00010000:00010000:1.0:1787368193.947138:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368194.456609:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000100:00080000:3.0:1787368194.456819:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787368194.456825:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787368194.456829:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368194.456836:0:15931:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:3.0:1787368194.456842:0:15931:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787368194.456850:0:15931:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55bd409800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368194.456874:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c54822c9880 x1874190808623872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787368194.456893:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368194.456897:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368194.456900:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368194.456903:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787368194.456943:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368184/real 1787368184] req@ffff9c55acbf7100 x1874190808620544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368194 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368194.456966:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55acbf7100 x1874190808620544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368194 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368194.456985:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368184/real 1787368184] req@ffff9c55acbf7b80 x1874190808620416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368194 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368194.456998:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55acbf7b80 x1874190808620416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368194 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368194.457029:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808623872:0@lo:38:kworker.0 00000100:00100000:1.0:1787368194.457030:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808624000:0@lo:400:kworker.0 00000100:00100000:0.0:1787368194.457124:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808623744:0@lo:400:kworker.0 00000100:00100000:3.0:1787368194.463241:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368194.463256:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368194.463346:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808623744 00000100:00100000:0.0:1787368194.463371:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808623744 00000100:00100000:0.0:1787368194.463421:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787368194.463430:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:3653:x1874190808623744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368194.463487:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:3653:x1874190808623744:12345-0@lo:400:kworker.0 Request processed in 58us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368194.463494:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787368194.463542:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808623744:0@lo:400:kworker.0 00000100:00100000:0.0:1787368194.463577:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808623872 00000100:00100000:0.0:1787368194.463581:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808623872 00000100:00100000:0.0:1787368194.463598:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368194.463603:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808623872:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787368194.463620:0:22883:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787368194.463664:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808623872:12345-0@lo:38:kworker.0 Request processed in 59us (430us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787368194.463670:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787368194.469125:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368194.469646:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808624000 00000100:00100000:2.0:1787368194.469654:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808624000 00000100:00100000:2.0:1787368194.469699:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787368194.469716:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808624000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368194.469797:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874190808624000:12345-0@lo:400:kworker.0 Request processed in 83us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368194.469805:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787368194.469851:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c54822c9c00 x1874190808624000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368194.469865:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874190808624000:0@lo:400:kworker.0 00000100:00080000:3.0:1787368194.471679:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368194.471691:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787368194.471696:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808623872:0@lo:38:kworker.0 00000100:00080000:3.0:1787368194.471703:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368194.471723:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368194.471727:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808620544:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787368194.471732:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368194.471738:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368194.471741:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808620416:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787368194.472083:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368194.472089:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787368194.472092:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368194.472097:0:15931:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 641 00000100:00080000:2.0:1787368194.472101:0:15931:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787368194.472107:0:15931:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c5481b9f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368194.472139:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd8f1880 x1874190808624128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787368194.472163:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368194.472166:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787368194.472168:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368194.472172:0:15931:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 641 00000100:00080000:2.0:1787368194.472174:0:15931:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787368194.472178:0:15931:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c54845c9000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368194.472191:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd8f0a80 x1874190808624256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368194.472877:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808624128:0@lo:8:kworker.0 00000400:00000100:3.0:1787368194.472938:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808624128 offset 0 length 520: 4 00000100:00100000:3.0:1787368194.472974:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808624256:0@lo:8:kworker.0 00000400:00000100:3.0:1787368194.473417:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808624256 offset 0 length 520: 4 00010000:00010000:1.0:1787368194.968550:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368195.480507:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00010000:00010000:1.0:1787368195.994165:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787368196.506739:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787368196.508250:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00010000:00010000:1.0:1787368197.016665:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787368197.312074:0:23610:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787368197.312078:0:23610:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787368197.312080:0:23610:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787368197.312204:0:23610:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c5483678000 00000020:01000004:2.0:1787368197.312219:0:23610:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787368197.312230:0:23610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787368197.312243:0:23610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c55bd6dcd28) 00000020:00000080:2.0:1787368197.312259:0:23610:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787368197.416119:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787368197.426093:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787368197.428548:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787368197.431256:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787368197.433589:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787368197.436045:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787368197.437752:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787368197.446994:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787368197.448200:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787368197.448662:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787368197.449031:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787368197.449297:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787368197.449707:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787368197.450069:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787368197.450515:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787368197.450716:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787368197.451597:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787368197.452504:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787368197.453179:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787368197.454601:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787368197.455305:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787368197.456145:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787368197.456563:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1787368197.456759:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787368197.457154:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787368197.458382:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787368197.458723:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1787368197.459140:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787368197.459502:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787368197.459737:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787368197.460132:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787368197.460480:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787368197.460701:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787368197.461049:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787368197.462163:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787368197.462652:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1787368197.462960:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787368197.463239:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787368197.463768:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787368197.464068:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787368197.464298:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1787368197.464953:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1787368197.465209:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787368197.465576:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787368197.465957:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787368197.466292:0:23610:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:01000000:0.0:1787368197.472754:0:23610:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787368197.473139:0:23610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787368197.473150:0:23610:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787368197.473161:0:23610:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff032524 00000020:01000004:0.0:1787368197.473168:0:23610:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787368197.473186:0:23610:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787368197.473190:0:23610:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787368197.473195:0:23610:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787368197.473221:0:23610:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787368197.473224:0:23610:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787368197.492542:0:23610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787368197.492588:0:23610:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787368197.492593:0:23610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787368197.492594:0:23610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787368197.492596:0:23610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368197.492597:0:23610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368197.492598:0:23610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368197.492600:0:23610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368197.492601:0:23610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787368197.492603:0:23610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368197.492604:0:23610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787368197.492607:0:23610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787368197.492609:0:23610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787368197.492610:0:23610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787368197.492611:0:23610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368197.492613:0:23610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368197.492614:0:23610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368197.492615:0:23610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368197.492616:0:23610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787368197.492618:0:23610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368197.492618:0:23610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787368197.492655:0:23610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787368197.492677:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787368197.492786:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368197.492827:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368197.493277:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808624384 00000100:00100000:3.0:1787368197.493292:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808624384 00000100:00100000:3.0:1787368197.493349:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787368197.493565:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:23610:x1874190808624384:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787368197.493597:0:22871:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787368197.493601:0:22871:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787368197.493608:0:22871:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787368197.494075:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:23610:x1874190808624384:12345-0@lo:253:mount.lustre.0 Request processed in 626us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.494084:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787368197.494193:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624384:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787368197.494204:0:23610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787368197.494207:0:23610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787368197.494209:0:23610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787368197.494210:0:23610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368197.494211:0:23610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368197.494212:0:23610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368197.494213:0:23610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368197.494214:0:23610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787368197.494216:0:23610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368197.494217:0:23610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787368197.494240:0:23610:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c5483678000 from lustre-MDT0001 10000000:01000000:1.0:1787368197.494263:0:23610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787368197.494266:0:23610:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787368197.494273:0:23610:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c55912fb370 local copy 00010000:00010000:1.0:1787368197.494282:0:23610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368197.494535:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368197.494568:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368197.494598:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.494696:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808624512 00000100:00100000:0.0:1787368197.494702:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808624512 00000100:00100000:0.0:1787368197.494740:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787368197.494749:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:23610:x1874190808624512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368197.495130:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:23610:x1874190808624512:12345-0@lo:501:mount.lustre.0 Request processed in 380us (558us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787368197.495138:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787368197.497614:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624512:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787368197.497665:0:23610:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787368197.497729:0:23610:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787368197.497738:0:23610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.497748:0:23610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368197.497780:0:23610:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c5483678000 10000000:01000000:1.0:1787368197.497785:0:23610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787368197.497790:0:23610:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c55912fb370 10000000:01000000:1.0:1787368197.497793:0:23610:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787368197.497796:0:23610:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c55912fb370 from 1 10000000:01000000:1.0:1787368197.497799:0:23610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787368197.497832:0:23610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03252b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.497944:0:23610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03252b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.497967:0:23610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03252b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368197.497986:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368197.498310:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368197.498928:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787368197.499553:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808624640 00000100:00100000:3.0:1787368197.499561:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808624640 00000100:00100000:3.0:1787368197.499710:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787368197.499719:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+12:23610:x1874190808624640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368197.499734:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368197.499750:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241c400/0x66f5679bff032532 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03252b expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368197.499773:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241c400/0x66f5679bff032532 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03252b expref: 13 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368197.499784:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241c400/0x66f5679bff032532 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03252b expref: 13 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368197.499792:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c400, rc 0) 00000100:00100000:3.0:1787368197.499856:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+13:23610:x1874190808624640:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.499863:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787368197.499930:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368197.499945:0:23610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03252b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032532 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.499954:0:23610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03252b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032532 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368197.499971:0:23610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787368197.499987:0:23610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03252b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032532 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.499994:0:23610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a0200/0x66f5679bff03252b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032532 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368197.500005:0:23610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c5483678000 10000000:01000000:1.0:1787368197.500009:0:23610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787368197.500178:0:23610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c5483678000 from 1 10000000:01000000:1.0:1787368197.500190:0:23610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787368197.500214:0:23610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1200/0x66f5679bff032539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.500222:0:23610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a1200/0x66f5679bff032539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.500242:0:23610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a1200/0x66f5679bff032539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368197.500260:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368197.500294:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368197.500526:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787368197.500689:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808624768 00000100:00100000:2.0:1787368197.500694:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808624768 00000100:00100000:2.0:1787368197.500722:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787368197.500730:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+13:23610:x1874190808624768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368197.500737:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368197.500755:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74a00/0x66f5679bff032540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032539 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.500771:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74a00/0x66f5679bff032540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032539 expref: 14 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.500780:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74a00/0x66f5679bff032540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032539 expref: 14 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.500787:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74a00, rc 0) 00000100:00100000:2.0:1787368197.500828:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+14:23610:x1874190808624768:12345-0@lo:101:mount.lustre.0 Request processed in 98us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368197.500932:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368197.500943:0:23610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a1200/0x66f5679bff032539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032540 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.500950:0:23610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a1200/0x66f5679bff032539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032540 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368197.500960:0:23610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787368197.500970:0:23610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1200/0x66f5679bff032539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032540 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.500977:0:23610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a1200/0x66f5679bff032539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032540 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368197.500983:0:23610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787368197.500987:0:23610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787368197.500991:0:23610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c5483678000 10000000:01000000:1.0:1787368197.500994:0:23610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787368197.500997:0:23610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787368197.500999:0:23610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787368197.501011:0:23610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1a00/0x66f5679bff032547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.501035:0:23610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a1a00/0x66f5679bff032547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.501065:0:23610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a1a00/0x66f5679bff032547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368197.501078:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368197.501104:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368197.501113:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787368197.501410:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787368197.501438:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808624896 00000100:00100000:2.0:1787368197.501442:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808624896 00000100:00100000:2.0:1787368197.501458:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787368197.501464:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+14:23610:x1874190808624896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368197.501471:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368197.501478:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74600/0x66f5679bff03254e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032547 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.501493:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74600/0x66f5679bff03254e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032547 expref: 15 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.501500:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74600/0x66f5679bff03254e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032547 expref: 15 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.501507:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74600, rc 0) 00000100:00100000:2.0:1787368197.501535:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808624896:12345-0@lo:101:mount.lustre.0 Request processed in 72us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368197.501561:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787368197.501813:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808624896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368197.501825:0:23610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a1a00/0x66f5679bff032547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03254e expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.501833:0:23610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a1a00/0x66f5679bff032547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03254e expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368197.503568:0:23610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1787368197.504151:0:23610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787368197.514785:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787368197.514912:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1787368197.514932:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1787368197.514946:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1787368197.514962:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1787368197.514978:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1787368197.514992:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1787368197.515006:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1787368197.515089:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1787368197.515110:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1787368197.515123:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1787368197.515133:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1787368197.515144:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1787368197.515155:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1787368197.515165:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1787368197.515175:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1787368197.515250:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1787368197.515266:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1787368197.515277:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1787368197.515288:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1787368197.515299:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1787368197.515310:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1787368197.515932:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1787368197.515945:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1787368197.515956:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1787368197.515966:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1787368197.515977:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1787368197.515988:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1787368197.516000:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1787368197.516011:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1787368197.516104:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1787368197.516115:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1787368197.516126:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1787368197.516137:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1787368197.516149:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1787368197.516159:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1787368197.516170:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1787368197.516180:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1787368197.516255:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1787368197.516267:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1787368197.516278:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1787368197.516289:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1787368197.516299:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1787368197.516310:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1787368197.516334:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1787368197.516339:0:23610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1787368197.516639:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808625024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368197.516698:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.516774:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b543ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.516819:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808625024 00000100:00100000:0.0:1787368197.516825:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808625024 00000100:00100000:0.0:1787368197.516971:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787368197.516981:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808625024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368197.517119:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808625024:12345-0@lo:501:mount.lustre.0 Request processed in 139us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.517126:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787368197.517198:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808625024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368197.517227:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808625152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368197.517262:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.517685:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b543ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368197.517778:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808625152 00000100:00100000:3.0:1787368197.517783:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808625152 00000100:00100000:1.0:1787368197.517832:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787368197.517849:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808625152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368197.519629:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808625152:12345-0@lo:503:mount.lustre.0 Request processed in 1775us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368197.519641:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787368197.519756:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808625152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787368197.520315:0:23610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787368197.520619:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808625280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368197.520670:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.520743:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b543ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368197.521337:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808625280 00000100:00100000:3.0:1787368197.521345:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808625280 00000100:00100000:3.0:1787368197.521515:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787368197.521525:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808625280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368197.522521:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808625280:12345-0@lo:502:mount.lustre.0 Request processed in 996us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.522530:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787368197.523145:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808625280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368197.523639:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787368197.523670:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1787368197.523685:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1787368197.523698:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1787368197.523711:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1787368197.523722:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1787368197.523734:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1787368197.523747:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1787368197.523833:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1787368197.523925:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1787368197.523942:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1787368197.523955:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1787368197.523968:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1787368197.523982:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1787368197.523996:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1787368197.524007:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1787368197.524097:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1787368197.524116:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1787368197.524128:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1787368197.524140:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1787368197.524150:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1787368197.524162:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1787368197.524173:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1787368197.524265:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1787368197.524283:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1787368197.524296:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1787368197.524308:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1787368197.524661:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1787368197.524677:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1787368197.524689:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1787368197.524700:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1787368197.524727:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1787368197.524738:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1787368197.524749:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1787368197.524954:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1787368197.524974:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1787368197.524988:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1787368197.525002:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1787368197.525090:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1787368197.525110:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1787368197.525124:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1787368197.525138:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1787368197.525151:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1787368197.525165:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1787368197.525269:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808625408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368197.525521:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.525599:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b543ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368197.525642:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808625408 00000100:00100000:1.0:1787368197.525650:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808625408 00000100:00100000:1.0:1787368197.525698:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787368197.525707:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808625408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368197.526124:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808625408:12345-0@lo:502:mount.lustre.0 Request processed in 417us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368197.526133:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787368197.526265:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808625408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368197.526556:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1787368197.526567:0:23610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787368197.527602:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368197.527613:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.527616:0:23614:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787368197.527621:0:23614:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787368197.527624:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368197.527637:0:23614:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c55912fcd28) 00000020:00000080:0.0:1787368197.527655:0:23614:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787368197.527662:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787368197.527742:0:23614:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787368197.527749:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff03255c 00000100:00100000:3.0:1787368197.528576:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000020:00000080:0.0:1787368197.530632:0:23614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787368197.530643:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368197.530649:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.530651:0:23614:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787368197.530654:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368197.530659:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.530660:0:23614:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787368197.530664:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368197.530678:0:23614:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c54826bcd28) 00000020:00000080:0.0:1787368197.530696:0:23614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787368197.530713:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787368197.530715:0:23614:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787368197.530717:0:23614:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787368197.530723:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787368197.530956:0:23614:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5483678000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787368197.530969:0:23614:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c54826b8000) 00000020:00000080:0.0:1787368197.530979:0:23614:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787368197.531126:0:23614:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787368197.531134:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff032571 00000020:00000080:0.0:1787368197.531310:0:23614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787368197.531317:0:23614:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787368197.531566:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x66f5679bff032578 00080000:01000000:0.0:1787368197.531575:0:23614:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787368197.531578:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff03257f 00010000:00010000:2.0:1787368197.622219:0:23614:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787368197.622944:0:23614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787368197.623308:0:23614:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787368197.633271:0:23614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787368197.633293:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368197.633301:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.633303:0:23614:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787368197.633307:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368197.633329:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.633331:0:23614:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787368197.633335:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787368197.633384:0:23614:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:2.0:1787368197.633432:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787368197.633449:0:23614:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c55bd6d8000) 00000020:00000080:2.0:1787368197.633479:0:23614:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787368197.633485:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787368197.633599:0:23614:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787368197.633607:0:23614:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787368197.633615:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff03258d 00010000:00080000:2.0:1787368197.633660:0:23614:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5483ce4800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1787368197.635460:0:23614:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787368197.637174:0:23614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787368197.637324:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787368197.637555:0:23614:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787368197.637578:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff032594 00000100:00080000:2.0:1787368197.637589:0:23614:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787368197.637595:0:23614:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c5483ce4800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368197.637632:0:23614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd8f2d80 x1874190808625536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787368197.637661:0:23614:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787368197.637759:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368197.637764:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.637766:0:23614:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787368197.637769:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787368197.637772:0:23614:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787368197.637774:0:23614:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368197.637777:0:23614:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368197.637779:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787368197.637782:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.637783:0:23614:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787368197.637786:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368197.637791:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.637799:0:23614:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787368197.637804:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787368197.637837:0:23614:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787368197.637852:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368197.637855:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.637857:0:23614:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787368197.637859:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787368197.637861:0:23614:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1787368197.637863:0:23614:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368197.637864:0:23614:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787368197.637866:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787368197.637868:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.637870:0:23614:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787368197.637872:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787368197.637876:0:23614:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787368197.637879:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.637881:0:23614:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787368197.637885:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787368197.637888:0:23614:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:2.0:1787368197.637912:0:23614:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787368197.637915:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787368197.637927:0:23614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c55bd6db370) 00000020:00000080:2.0:1787368197.637939:0:23614:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787368197.637945:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787368197.638001:0:23614:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787368197.638007:0:23614:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000100:00100000:3.0:1787368197.638127:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808625536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787368197.638204:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1787368197.638349:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff0325a2 00010000:00080000:2.0:1787368197.638510:0:23614:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55bc6bf800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1787368197.638714:0:23614:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1787368197.639822:0:23614:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787368197.640010:0:23614:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787368197.641822:0:23614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787368197.642242:0:23614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:1.0:1787368197.642494:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808625536 00000100:00100000:1.0:1787368197.642511:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808625536 00000100:00100000:1.0:1787368197.642611:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787368197.642620:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808625536:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787368197.642657:0:22883:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:1.0:1787368197.642696:0:22883:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff0325a9 00000004:00100000:1.0:1787368197.642713:0:22883:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787368197.642718:0:22883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:2.0:1787368197.642929:0:23614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:0.0:1787368197.643032:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787368197.643045:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787368197.643048:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368197.643054:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:0.0:1787368197.643058:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787368197.643063:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55bd409800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368197.643095:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55be959f80 x1874190808625664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368197.643120:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368197.643124:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368197.643126:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368197.643129:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787368197.643165:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808625792:0@lo:400:kworker.0 00000100:00100000:0.0:1787368197.643255:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368197.643308:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808625792 00000100:00100000:2.0:1787368197.643557:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808625664:0@lo:38:kworker.0 00000100:00100000:2.0:1787368197.643589:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368197.643623:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808625792 00000100:00100000:0.0:1787368197.643671:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787368197.643680:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808625792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368197.643727:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808625792:12345-0@lo:400:kworker.0 Request processed in 49us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.643734:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787368197.643770:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c55be959180 x1874190808625792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368197.643782:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808625792:0@lo:400:kworker.0 00000040:00080000:0.0:1787368197.644277:0:23619:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787368197.644282:0:23619:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787368197.645926:0:23614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787368197.645940:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787368197.645990:0:23614:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787368197.646025:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff0325b0 00000100:00080000:0.0:1787368197.646046:0:23614:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368197.646053:0:23614:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c55bc6bf800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368197.646090:0:23614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55be959180 x1874190808625920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368197.646106:0:23614:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787368197.646174:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368197.646179:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.646180:0:23614:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787368197.646193:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787368197.646196:0:23614:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1787368197.646205:0:23614:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368197.646208:0:23614:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368197.646210:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787368197.646219:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.646221:0:23614:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787368197.646224:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787368197.646228:0:23614:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787368197.646231:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.646232:0:23614:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787368197.646235:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787368197.646245:0:23614:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1787368197.646268:0:23614:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787368197.646271:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787368197.646283:0:23614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c54826b99b8) 00000020:00000080:0.0:1787368197.646295:0:23614:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787368197.646300:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1787368197.646574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368197.646579:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368197.646582:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368197.646585:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:0.0:1787368197.646705:0:23614:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787368197.646711:0:23614:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787368197.646717:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x66f5679bff0325be 00010000:00080000:0.0:1787368197.646754:0:23614:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55bc50b800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368197.646969:0:23614:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787368197.647056:0:23614:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787368197.647074:0:23614:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1787368197.647269:0:22884:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787368197.649780:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808625920:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787368197.649864:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808625920 offset 0 length 520: 4 00000100:00080000:0.0:1787368197.650757:0:22883:0:(import.c:65:import_set_state_nolock()) ffff9c55bc509800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368197.650835:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874190808625536:12345-0@lo:38:llog_process_th.0 Request processed in 8214us (12629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.650846:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787368197.651005:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787368197.651024:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787368197.651032:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787368197.651045:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787368197.651047:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5483ce4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787368197.651067:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808625536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787368197.651243:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808626048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368197.651280:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368197.651338:0:22884:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:00080000:1.0:1787368197.652548:0:23614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787368197.652897:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808625664 00000100:00100000:3.0:1787368197.652904:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808625664 00000100:00100000:3.0:1787368197.652942:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368197.652949:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808625664:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787368197.653032:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874190808625664:12345-0@lo:38:kworker.0 Request processed in 83us (9442us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787368197.653047:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1787368197.653178:0:23614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787368197.653330:0:23614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00100000:3.0:1787368197.653587:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787368197.653595:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368197.653599:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787368197.653603:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808625664:0@lo:38:kworker.0 00000040:00080000:3.0:1787368197.654342:0:23622:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787368197.654347:0:23622:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1787368197.655032:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808626048 00000100:00100000:0.0:1787368197.655047:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808626048 00000100:00100000:0.0:1787368197.655098:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787368197.655107:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1874190808626048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787368197.655145:0:22884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787368197.655252:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1874190808626048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.655259:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787368197.655638:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808626048:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1787368197.656107:0:23614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787368197.656119:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787368197.656160:0:23614:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787368197.656271:0:23614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff0325c5 00000100:00080000:2.0:1787368197.656280:0:23614:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787368197.656285:0:23614:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c55bc50b800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368197.656733:0:23614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd8f2680 x1874190808626176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368197.656791:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808626176:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787368197.656847:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808626176 offset 0 length 520: 4 00000100:00080000:2.0:1787368197.656900:0:23614:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787368197.656966:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368197.656974:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.656976:0:23614:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787368197.656979:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368197.656983:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.656984:0:23614:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787368197.656987:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787368197.656989:0:23614:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787368197.656991:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368197.656993:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.656995:0:23614:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787368197.656997:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368197.656999:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.657000:0:23614:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787368197.657003:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787368197.657051:0:23614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368197.657055:0:23614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368197.657057:0:23614:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787368197.657060:0:23614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1787368197.657111:0:23610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787368197.657140:0:23610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787368197.657161:0:23610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a1a00/0x66f5679bff032547 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03254e expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.657172:0:23610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a1a00/0x66f5679bff032547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03254e expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368197.657180:0:23610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c5483678000 from 1 10000000:01000000:2.0:1787368197.657191:0:23610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787368197.657215:0:23610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.657223:0:23610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.657243:0:23610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368197.657259:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368197.657294:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.657308:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.657573:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808626304 00000100:00100000:0.0:1787368197.657579:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808626304 00000100:00100000:0.0:1787368197.657618:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787368197.657626:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+15:23610:x1874190808626304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368197.657637:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368197.657650:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0325cc expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.657672:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0325cc expref: 16 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.657682:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0325cc expref: 16 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.657690:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68be00, rc 0) 00000100:00100000:0.0:1787368197.657733:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+16:23610:x1874190808626304:12345-0@lo:101:mount.lustre.0 Request processed in 108us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.657739:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787368197.657812:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368197.657826:0:23610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.657835:0:23610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368197.658853:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626432:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787368197.658900:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.658929:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.659083:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808626432 00000100:00100000:0.0:1787368197.659089:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808626432 00000100:00100000:0.0:1787368197.659125:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787368197.659133:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+16:23610:x1874190808626432:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787368197.659150:0:22873:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787368197.659165:0:22873:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787368197.659172:0:22873:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787368197.659265:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+16:23610:x1874190808626432:12345-0@lo:256:mount.lustre.0 Request processed in 132us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.659273:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787368197.659556:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626432:0@lo:256:mount.lustre.0 00000100:00080000:1.0:1787368197.660547:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368197.660554:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368197.660557:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368197.660560:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 10000000:01000000:2.0:1787368197.660748:0:23610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787368197.660801:0:23610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.660813:0:23610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368197.660821:0:23610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5483678000 from 1 10000000:01000000:2.0:1787368197.660824:0:23610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787368197.660900:0:23610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.660909:0:23610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.660919:0:23610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368197.660937:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368197.660983:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.661012:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.661250:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808626560 00000100:00100000:0.0:1787368197.661256:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808626560 00000100:00100000:0.0:1787368197.661335:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787368197.661345:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+16:23610:x1874190808626560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368197.661378:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368197.661488:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0325da expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.661512:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0325da expref: 17 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.661522:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0325da expref: 17 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.661530:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ae00, rc 0) 00000100:00100000:0.0:1787368197.661568:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808626560:12345-0@lo:101:mount.lustre.0 Request processed in 225us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.661575:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787368197.661648:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368197.661661:0:23610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.661669:0:23610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787368197.662803:0:23610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787368197.663067:0:23610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787368197.663246:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787368197.663269:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787368197.663282:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787368197.663295:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787368197.663306:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787368197.663554:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787368197.663586:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787368197.663601:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787368197.663614:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787368197.663627:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787368197.663653:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787368197.663672:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787368197.663678:0:23610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1787368197.663749:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368197.663802:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.664020:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787368197.664098:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808626688 00000100:00100000:1.0:1787368197.664104:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808626688 00000100:00100000:1.0:1787368197.664145:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787368197.664154:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808626688:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368197.664275:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808626688:12345-0@lo:501:mount.lustre.0 Request processed in 122us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368197.664283:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787368197.664591:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368197.664623:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368197.664663:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.664680:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787368197.664753:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808626816 00000100:00100000:1.0:1787368197.664757:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808626816 00000100:00100000:1.0:1787368197.664774:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787368197.664779:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808626816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368197.664854:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808626816:12345-0@lo:503:mount.lustre.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368197.664861:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787368197.664947:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626816:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787368197.665618:0:23610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787368197.665676:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368197.665717:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.665741:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787368197.665792:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808626944 00000100:00100000:1.0:1787368197.665797:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808626944 00000100:00100000:1.0:1787368197.665820:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787368197.665828:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808626944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368197.665912:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808626944:12345-0@lo:502:mount.lustre.0 Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368197.665919:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787368197.665993:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808626944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368197.666167:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787368197.666306:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1787368197.666478:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1787368197.666491:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1787368197.666503:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1787368197.666514:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1787368197.666526:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1787368197.666537:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1787368197.666561:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787368197.666573:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1787368197.666583:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1787368197.666606:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368197.666638:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.666666:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.666732:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808627072 00000100:00100000:0.0:1787368197.666737:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808627072 00000100:00100000:0.0:1787368197.666763:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787368197.666769:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808627072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368197.666846:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808627072:12345-0@lo:502:mount.lustre.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.666861:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787368197.666974:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368197.667009:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1787368197.667148:0:23610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787368197.668135:0:23624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368197.668145:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.668148:0:23624:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787368197.668155:0:23624:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c5483678000 00000020:00000080:0.0:1787368197.668157:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787368197.668164:0:23624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368197.668166:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.668167:0:23624:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787368197.668170:0:23624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368197.668171:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.668173:0:23624:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787368197.668175:0:23624:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c5483678000 00000020:00000080:0.0:1787368197.668177:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787368197.668495:0:23624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368197.668499:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.668500:0:23624:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787368197.668503:0:23624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368197.668506:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.668507:0:23624:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787368197.668510:0:23624:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c5483678000 00000020:00000080:0.0:1787368197.668512:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787368197.673528:0:23624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368197.673540:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.673542:0:23624:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787368197.673547:0:23624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368197.673551:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.673553:0:23624:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787368197.673558:0:23624:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c5483678000 00000020:00000080:0.0:1787368197.673560:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787368197.673616:0:23624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368197.673619:0:23624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368197.673628:0:23624:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787368197.673631:0:23624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1787368197.674282:0:23610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787368197.674327:0:23610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787368197.674348:0:23610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.674386:0:23610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368197.674612:0:23610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787368197.674615:0:23610:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c5483678000 10000000:01000000:2.0:1787368197.674618:0:23610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c5483678000 10000000:01000000:2.0:1787368197.674622:0:23610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787368197.674628:0:23610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c5483678000 from 1 10000000:01000000:2.0:1787368197.674631:0:23610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787368197.674665:0:23610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e75c00/0x66f5679bff0325e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.674674:0:23610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e75c00/0x66f5679bff0325e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.674685:0:23610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e75c00/0x66f5679bff0325e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368197.674708:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368197.674779:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.674823:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.675275:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808627200 00000100:00100000:0.0:1787368197.675282:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808627200 00000100:00100000:0.0:1787368197.675346:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787368197.675379:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:23610:x1874190808627200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368197.675510:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368197.675526:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68aa00/0x66f5679bff0325ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0325e8 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.675552:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68aa00/0x66f5679bff0325ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0325e8 expref: 18 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.675563:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68aa00/0x66f5679bff0325ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0325e8 expref: 18 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.675572:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68aa00, rc 0) 00000100:00100000:0.0:1787368197.675622:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627200:12345-0@lo:101:mount.lustre.0 Request processed in 268us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.675629:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787368197.676545:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368197.676563:0:23610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e75c00/0x66f5679bff0325e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0325ef expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.676573:0:23610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e75c00/0x66f5679bff0325e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0325ef expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787368197.686339:0:23610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1787368197.687784:0:23610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787368197.690790:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1787368197.690879:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1787368197.690903:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1787368197.690917:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1787368197.690931:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1787368197.690945:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1787368197.690978:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1787368197.690993:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1787368197.691007:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1787368197.691020:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1787368197.691033:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1787368197.691059:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1787368197.691073:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1787368197.691087:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1787368197.691099:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1787368197.691111:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1787368197.691123:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1787368197.691137:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1787368197.691149:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1787368197.691163:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1787368197.691176:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1787368197.691202:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1787368197.691231:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1787368197.691247:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1787368197.691261:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1787368197.691275:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1787368197.691287:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1787368197.691300:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1787368197.691312:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1787368197.691324:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1787368197.691351:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1787368197.693769:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1787368197.693810:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1787368197.693823:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1787368197.693833:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1787368197.693842:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1787368197.693851:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1787368197.693863:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1787368197.693887:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1787368197.693898:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1787368197.693907:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1787368197.693917:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1787368197.693927:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1787368197.693937:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1787368197.693947:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1787368197.693958:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1787368197.693968:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1787368197.693979:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1787368197.694177:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1787368197.694204:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1787368197.694219:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1787368197.694224:0:23610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1787368197.694331:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368197.694825:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368197.694874:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808627328 00000100:00100000:3.0:1787368197.694880:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808627328 00000100:00100000:3.0:1787368197.694930:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787368197.694939:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368197.695065:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627328:12345-0@lo:501:mount.lustre.0 Request processed in 127us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.695086:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787368197.695127:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55855510c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368197.695148:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368197.695186:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368197.695224:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368197.696971:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55855510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.697125:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808627456 00000100:00100000:0.0:1787368197.697133:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808627456 00000100:00100000:0.0:1787368197.697191:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787368197.697201:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368197.697760:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627456:12345-0@lo:503:mount.lustre.0 Request processed in 559us (2534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.697769:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787368197.701784:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787368197.702281:0:23610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787368197.702613:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368197.702687:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368197.702731:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808627584 00000100:00100000:3.0:1787368197.702736:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808627584 00000100:00100000:3.0:1787368197.702784:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787368197.702793:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368197.702888:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627584:12345-0@lo:502:mount.lustre.0 Request processed in 96us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.702897:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787368197.702938:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55855510c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368197.702954:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787368197.703207:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1787368197.703234:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1787368197.703248:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1787368197.703260:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1787368197.703272:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1787368197.703286:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1787368197.703510:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1787368197.703533:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1787368197.703546:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1787368197.703559:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1787368197.703572:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1787368197.703585:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1787368197.703597:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1787368197.703609:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1787368197.703621:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1787368197.703634:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1787368197.703660:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1787368197.703676:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1787368197.703691:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1787368197.703705:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1787368197.703718:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1787368197.703731:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1787368197.703744:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1787368197.703757:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1787368197.703771:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1787368197.703783:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1787368197.703796:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1787368197.703809:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1787368197.703821:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1787368197.703832:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1787368197.703844:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1787368197.703856:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1787368197.703882:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1787368197.703897:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1787368197.703910:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1787368197.703923:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1787368197.703936:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1787368197.703950:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1787368197.703964:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1787368197.703990:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1787368197.704003:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1787368197.704940:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1787368197.704969:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1787368197.704981:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1787368197.704992:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1787368197.705003:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1787368197.705096:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1787368197.705115:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1787368197.705252:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368197.705557:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368197.705605:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808627712 00000100:00100000:3.0:1787368197.705613:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808627712 00000100:00100000:3.0:1787368197.706053:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787368197.706065:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5592fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368197.706197:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5592fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627712:12345-0@lo:502:mount.lustre.0 Request processed in 134us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.706205:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787368197.712460:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55855510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.712508:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368197.712797:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1787368197.712828:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1787368197.712865:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be958e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368197.712934:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368197.712975:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808627840 00000100:00100000:0.0:1787368197.712981:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808627840 00000100:00100000:0.0:1787368197.713044:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787368197.713054:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5592fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368197.713161:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5592fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808627840:12345-0@lo:502:mount.lustre.0 Request processed in 108us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.713169:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787368197.713228:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548239c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.713243:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be958e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808627840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368197.713281:0:23610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1787368197.713288:0:23610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787368197.715383:0:23629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787368197.715526:0:23629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c54826bb370) 00000020:00000080:0.0:1787368197.715549:0:23629:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787368197.715624:0:23629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5483678000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787368197.715628:0:23629:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c5483678000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787368197.715630:0:23629:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5483678000 3 00010000:00080000:0.0:1787368197.715662:0:23629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5483744000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1787368197.726314:0:23629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1787368197.726557:0:23629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787368197.726614:0:23629:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787368197.726628:0:23629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x66f5679bff0325fd 00000100:00080000:1.0:1787368197.726638:0:23629:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787368197.726644:0:23629:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c5483744000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368197.726680:0:23629:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf6d80 x1874190808627968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368197.726714:0:23629:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787368197.726765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787368197.726769:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787368197.726771:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368197.726777:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55bd409800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368197.726791:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf5180 x1874190808628224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368197.726801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368197.726804:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368197.726807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368197.726810:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368197.726836:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368197.726840:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368197.726842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368197.726844:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787368197.726867:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808628096:0@lo:400:kworker.0 00000100:00100000:1.0:1787368197.726931:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368197.726970:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787368197.726976:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808628352:0@lo:400:kworker.0 00000100:00100000:1.0:1787368197.727004:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368197.727033:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808628480:0@lo:400:kworker.0 00000100:00100000:1.0:1787368197.727086:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368197.727119:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808627968:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787368197.727156:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368197.727175:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808628224:0@lo:38:kworker.0 00000100:00100000:3.0:1787368197.727213:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808628352 00000100:00100000:3.0:1787368197.727219:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808628352 00000100:00100000:3.0:1787368197.727253:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808627968 00000100:00100000:3.0:1787368197.727255:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808627968 00000100:00100000:3.0:1787368197.727266:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787368197.727274:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808628352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368197.728326:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808628352:12345-0@lo:400:kworker.0 Request processed in 1037us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.728350:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787368197.728577:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787368197.728585:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874190808627968:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787368197.728612:0:22880:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:3.0:1787368197.728643:0:22880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x66f5679bff032604 00000004:00100000:3.0:1787368197.728658:0:22880:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787368197.728689:0:22880:0:(import.c:65:import_set_state_nolock()) ffff9c55834d2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787368197.728745:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874190808627968:12345-0@lo:38:llog_process_th.0 Request processed in 160us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.728753:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787368197.728831:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c55acbf4000 x1874190808628352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368197.728847:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808628352:0@lo:400:kworker.0 00000100:00100000:0.0:1787368197.735147:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808628096 00000100:00100000:0.0:1787368197.735160:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808628096 00000100:00100000:0.0:1787368197.735227:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787368197.735239:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5592fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:3653:x1874190808628096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368197.735329:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5592fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:3653:x1874190808628096:12345-0@lo:400:kworker.0 Request processed in 92us (8397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.735345:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787368197.735411:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808628480 00000100:00100000:0.0:1787368197.735416:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808628480 00000100:00100000:0.0:1787368197.735440:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787368197.735446:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874190808628480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368197.735488:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874190808628480:12345-0@lo:400:kworker.0 Request processed in 42us (8401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.735495:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368197.735841:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808628480:0@lo:400:kworker.0 00000100:00100000:0.0:1787368197.736825:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787368197.736892:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c55acbf6d80 x1874190808627968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368197.736904:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368197.736912:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787368197.736921:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787368197.736926:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787368197.736929:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5483744000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787368197.736935:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874190808627968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368197.736968:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808628096:0@lo:400:kworker.0 00000100:00100000:1.0:1787368197.737021:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808628224 00000100:00100000:1.0:1787368197.737026:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808628224 00000100:00100000:1.0:1787368197.737070:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368197.737077:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874190808628224:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787368197.737141:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874190808628224:12345-0@lo:38:kworker.0 Request processed in 63us (318us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787368197.737148:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787368197.737204:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368197.737209:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787368197.737212:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808628224:0@lo:38:kworker.0 00000040:00080000:0.0:1787368197.739436:0:23629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1787368197.739550:0:23610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787368197.739583:0:23610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787368197.739599:0:23610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e75c00/0x66f5679bff0325e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0325ef expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368197.739610:0:23610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e75c00/0x66f5679bff0325e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0325ef expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787368197.739675:0:23610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787368197.739678:0:23610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787368197.739679:0:23610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787368197.739681:0:23610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787368197.739682:0:23610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787368197.739683:0:23610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787368197.739685:0:23610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787368197.739687:0:23610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787368197.739688:0:23610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787368197.739692:0:23610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787368197.739694:0:23610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787368197.739695:0:23610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787368197.739697:0:23610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787368197.739698:0:23610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787368197.739699:0:23610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787368197.739700:0:23610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787368197.739701:0:23610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787368197.739702:0:23610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787368197.739703:0:23610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787368197.739728:0:23610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787368197.739746:0:23610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808628608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787368197.739816:0:23610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368197.739848:0:23610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548239ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.740718:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808628608 00000100:00100000:0.0:1787368197.740727:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808628608 00000100:00100000:0.0:1787368197.740783:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787368197.740792:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:23610:x1874190808628608:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787368197.740819:0:22872:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787368197.740831:0:22872:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787368197.749117:0:22858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787368197.749184:0:22872:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787368197.749198:0:22872:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787368197.749283:0:22894:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787368197.749287:0:22894:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787368197.749307:0:22894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.749333:0:22894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032508 expref: 18 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.749341:0:22894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0325cc expref: 18 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.749349:0:22894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368197.751491:0:22894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0325cc expref: 18 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368197.751512:0:22894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0325cc expref: 18 pid: 22872 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368197.751527:0:22894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808628736:0@lo:104: 00000100:00100000:3.0:1787368197.751588:0:22894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787368197.751639:0:22894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff032508 expref: 18 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368197.751703:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808628736 00010000:00010000:3.0:1787368197.751710:0:22894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff032508 expref: 18 pid: 22871 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368197.751710:0:22862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808628736 00000100:00100000:3.0:1787368197.751730:0:22894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808628864:0@lo:104: 00000100:00100000:3.0:1787368197.751754:0:22894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368197.751755:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368197.751763:0:22862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808628736:12345-0@lo:104: 00000100:00100000:3.0:1787368197.751768:0:22894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551900 going to sleep for 11 seconds 00010000:00010000:2.0:1787368197.751776:0:22862:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.751841:0:22862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787368197.751847:0:22862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808628736:12345-0@lo:104: Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368197.751853:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368197.751868:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808628864 00000100:00100000:2.0:1787368197.751871:0:22862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808628864 00000100:00100000:2.0:1787368197.751885:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787368197.751890:0:22862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808628864:12345-0@lo:104: 00010000:00010000:2.0:1787368197.751897:0:22862:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368197.751923:0:22862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787368197.751928:0:22862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808628864:12345-0@lo:104: Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368197.751933:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787368197.751983:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787368197.751990:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.751997:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368197.752000:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752008:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368197.752015:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368197.752021:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787368197.752086:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752093:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368197.752112:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752119:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff0325cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0325d3 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752131:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368197.752134:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752139:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368197.752142:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752148:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368197.752154:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368197.752158:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787368197.752170:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752176:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368197.752200:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752216:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241ce00/0x66f5679bff032508 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03250f expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752229:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368197.752230:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368197.752232:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368197.752238:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368197.752250:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808628992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368197.752279:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368197.752306:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787368197.752326:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808629120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368197.752349:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368197.752592:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808628992 00000100:00100000:1.0:1787368197.752597:0:22863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808628992 00010000:00010000:1.0:1787368197.752614:0:22863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0325cc expref: 19 pid: 22872 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368197.752632:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808629120 00000100:00100000:1.0:1787368197.752634:0:22863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808629120 00010000:00010000:1.0:1787368197.752641:0:22863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032508 expref: 20 pid: 22871 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368197.752651:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787368197.752657:0:22863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:3652:x1874190808628992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368197.752667:0:22863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368197.752671:0:22863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0325cc expref: 20 pid: 22872 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752690:0:22863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0325cc expref: 20 pid: 22872 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752706:0:22863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368197.752735:0:22863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:3652:x1874190808628992:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368197.752742:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787368197.752755:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787368197.752761:0:22863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:3654:x1874190808629120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368197.752768:0:22863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368197.752772:0:22863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032508 expref: 19 pid: 22871 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752780:0:22863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff032508 expref: 19 pid: 22871 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752791:0:22863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752798:0:22863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787368197.752811:0:22863:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003524776s 00010000:00010000:1.0:1787368197.752816:0:22863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752822:0:22863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752838:0:22863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752844:0:22863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752849:0:22863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368197.752853:0:22863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752860:0:22863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752868:0:22863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368197.752869:0:22894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68be00/0x66f5679bff0325d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0325cc expref: 19 pid: 22872 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368197.752877:0:22863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368197.752880:0:22894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808628736:0@lo:104: 00010000:00010000:3.0:1787368197.752889:0:22894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241dc00/0x66f5679bff03250f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff032508 expref: 18 pid: 22871 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368197.752897:0:22894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808628864:0@lo:104: 00000100:00100000:1.0:1787368197.752901:0:22863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:3654:x1874190808629120:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368197.752906:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787368197.752916:0:22894:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368197.752925:0:22894:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368197.752929:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808628992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368197.752931:0:22894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368197.752937:0:22894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75800/0x66f5679bff03260b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368197.752944:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808629120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368197.754289:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+16:23610:x1874190808628608:12345-0@lo:253:mount.lustre.0 Request processed in 13491us (14465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.754301:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787368197.754711:0:23610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:23610:1874190808628608:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787368197.754724:0:23610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787368197.754727:0:23610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787368197.754728:0:23610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787368197.754729:0:23610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368197.754736:0:23610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368197.754738:0:23610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368197.754739:0:23610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368197.754740:0:23610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787368197.754742:0:23610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368197.754743:0:23610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787368197.754757:0:23610:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1787368197.765232:0:23610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787368197.765688:0:23634:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787368197.765693:0:23634:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787368197.765933:0:23635:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787368197.766333:0:23610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1787368197.766933:0:23635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787368197.770055:0:23636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23636:1874190808629248:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787368197.770208:0:23636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368197.770252:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808629248 00000100:00100000:0.0:1787368197.770259:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808629248 00000100:00100000:0.0:1787368197.770328:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787368197.770338:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23636:x1874190808629248:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787368197.770443:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23636:x1874190808629248:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 107us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.770452:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787368197.770477:0:23636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.770500:0:23636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23636:1874190808629248:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787368197.770530:0:23636:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787368197.770557:0:23636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23636:1874190808629376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787368197.770588:0:23636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368197.770608:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808629376 00000100:00100000:0.0:1787368197.770611:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808629376 00000100:00100000:0.0:1787368197.770632:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787368197.770638:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23636:x1874190808629376:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787368197.770723:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23636:x1874190808629376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 85us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.770730:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787368197.770747:0:23636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.770758:0:23636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23636:1874190808629376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787368197.770807:0:23636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23636:1874190808629504:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787368197.770831:0:23636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368197.770857:0:23636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368197.771429:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808629504 00000100:00100000:3.0:1787368197.771435:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808629504 00000100:00100000:3.0:1787368197.771476:0:22889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787368197.771483:0:22889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23636:x1874190808629504:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787368197.771528:0:22889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23636:x1874190808629504:12345-0@lo:900:lod0001_rec0000.0 Request processed in 45us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368197.771535:0:22889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787368197.771562:0:23636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c55be959500 x1874190808629504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787368213 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368197.771572:0:23636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23636:1874190808629504:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787368197.771612:0:23636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822cbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23636:1874190808629632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787368197.771638:0:23636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368197.771667:0:23636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787368197.774089:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808629632 00000100:00100000:0.0:1787368197.774104:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808629632 00000100:00100000:0.0:1787368197.774158:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787368197.774168:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23636:x1874190808629632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787368197.774286:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23636:x1874190808629632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368197.774294:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:01000000:1.0:1787368197.774392:0:23610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787368197.774431:0:23610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787368197.774869:0:23635:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787368197.774927:0:23635:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1787368197.775626:0:23636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822cbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23636:1874190808629632:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787368197.775737:0:23636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787368197.776479:0:23610:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787368197.776489:0:23610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787368197.776558:0:23610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787368197.779872:0:23636:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787368197.779941:0:23636:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787368197.779945:0:23636:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:1.0:1787368197.780614:0:23610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787368197.781169:0:23610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787368197.781202:0:23610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787368197.781392:0:23610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787368197.781865:0:23610:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1787368197.785104:0:23610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787368197.792810:0:23610:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787368197.792845:0:23610:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffafad01cf7988 00100000:10000000:2.0:1787368197.792853:0:23610:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787368197.793539:0:23610:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787368197.793565:0:23610:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787368197.793582:0:23610:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787368197.793598:0:23610:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787368197.796107:0:23610:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787368197.797783:0:23610:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787368198.043072:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368198.554498:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000040:00080000:1.0:1787368198.809039:0:23637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787368199.065168:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787368199.194165:0:22875:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787368199.194228:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c5483678000 from 12 10000000:01000000:0.0:1787368199.194235:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787368199.194283:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368199.194295:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368199.194305:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368199.194329:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808629760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787368199.194837:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368199.195477:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787368199.199928:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808629760 00000100:00100000:1.0:1787368199.199945:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808629760 00000100:00100000:1.0:1787368199.200002:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787368199.200013:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+16:22875:x1874190808629760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368199.200042:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368199.200064:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032612 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368199.200100:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032612 expref: 17 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368199.200112:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032612 expref: 17 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368199.200123:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a0600, rc 0) 00000100:00100000:1.0:1787368199.200276:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808629760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 264us (5440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368199.200284:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787368199.200346:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808629760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368199.200394:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368199.200405:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368199.200488:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808629888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787368199.200527:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368199.200564:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787368199.200637:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808629888 00000100:00100000:1.0:1787368199.200642:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808629888 00000100:00100000:1.0:1787368199.200822:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787368199.200829:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808629888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787368199.200845:0:22872:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787368199.200862:0:22872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787368199.200865:0:22872:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787368199.201062:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808629888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 233us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368199.201071:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787368199.201261:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808629888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787368199.201543:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787368199.201553:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368199.201569:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368199.201580:0:22875:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787368199.201582:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55acbc7800 from 12 10000000:01000000:2.0:1787368199.201585:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787368199.201611:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368199.201619:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368199.201628:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368199.201749:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808630016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787368199.201784:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368199.201805:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5484513600 going to sleep for 11 seconds 00000100:00100000:1.0:1787368199.202109:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808630016 00000100:00100000:1.0:1787368199.202115:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808630016 00000100:00100000:1.0:1787368199.202162:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787368199.202177:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808630016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368199.202190:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368199.202207:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032620 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368199.202240:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032620 expref: 18 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368199.202250:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032620 expref: 18 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368199.202259:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a1600, rc 0) 00000100:00100000:1.0:1787368199.202306:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:22875:x1874190808630016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368199.202313:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787368199.206103:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808630016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368199.206133:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368199.206146:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368199.206231:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808630144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787368199.206309:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368199.206349:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb60acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368199.206455:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808630144 00000100:00100000:1.0:1787368199.206462:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808630144 00000100:00100000:1.0:1787368199.206517:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787368199.206529:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:22875:x1874190808630144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787368199.206550:0:22873:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787368199.206571:0:22873:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787368199.206574:0:22873:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787368199.206689:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:22875:x1874190808630144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368199.206708:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787368199.207119:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808630144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787368199.207164:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787368199.207242:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368199.207253:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368199.577490:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000040:00080000:1.0:1787368199.833173:0:23637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787368200.088706:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368200.612232:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00010000:00010000:3.0:1787368201.112790:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368201.624455:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000001:02000400:2.0:1787368202.008283:0:23880:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787368202.136451:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368202.656824:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 0 seconds 00000020:00000004:2.0:1787368202.983082:0:23932:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787368202.983315:0:23932:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787368203.160588:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368203.160759:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808630272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368203.160869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787368203.161008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787368203.161013:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787368203.161017:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368203.161026:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c55bd409800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368203.161048:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd8f0e00 x1874190808630528/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787368203.161063:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368203.161067:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368203.161070:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368203.161073:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368203.161082:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368203.161084:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368203.161086:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368203.161089:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787368203.161277:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808630656:0@lo:400:kworker.0 00000100:00100000:2.0:1787368203.161326:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368203.161350:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368203.161385:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808630400:0@lo:400:kworker.0 00000100:00100000:2.0:1787368203.161414:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368203.161465:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808630528:0@lo:38:kworker.0 00000100:00100000:2.0:1787368203.161494:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368203.161529:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808630656 00000100:00100000:2.0:1787368203.161536:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808630656 00000100:00100000:2.0:1787368203.161577:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787368203.161585:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808630656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368203.161629:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808630656:12345-0@lo:400:kworker.0 Request processed in 45us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368203.161637:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787368203.161658:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808630400 00000100:00100000:2.0:1787368203.161661:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808630400 00000100:00100000:2.0:1787368203.161683:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787368203.161689:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:3652:x1874190808630400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368203.161717:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:3652:x1874190808630400:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368203.161723:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787368203.161749:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808630272 00000100:00100000:2.0:1787368203.161753:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808630272 00000100:00100000:2.0:1787368203.161775:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808630528 00000100:00100000:2.0:1787368203.161778:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808630528 00000100:00100000:2.0:1787368203.161788:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368203.161794:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808630272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368203.161816:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787368203.161864:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808630272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368203.161870:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368203.161881:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368203.161885:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874190808630528:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787368203.161926:0:22883:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:2.0:1787368203.161960:0:22883:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff03262e 00000004:00100000:2.0:1787368203.161974:0:22883:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787368203.161979:0:22883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1787368203.162070:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808630784:0@lo:400:kworker.0 00000100:00100000:2.0:1787368203.162102:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368203.162133:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808630784 00000100:00100000:2.0:1787368203.162137:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808630784 00000100:00100000:2.0:1787368203.162157:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787368203.162163:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808630784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368203.162192:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808630784:12345-0@lo:400:kworker.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368203.162199:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787368203.162225:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55bd8f1c00 x1874190808630784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368203.162238:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808630784:0@lo:400:kworker.0 00000100:00100000:2.0:1787368203.162263:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808630400:0@lo:400:kworker.0 00010000:00080000:2.0:1787368203.162274:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55bd8f1500 x1874190808630656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368203.162283:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808630656:0@lo:400:kworker.0 00000100:00100000:2.0:1787368203.162309:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808630272:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787368203.177320:0:22883:0:(import.c:65:import_set_state_nolock()) ffff9c5483ce3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787368203.177442:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874190808630528:12345-0@lo:38:kworker.0 Request processed in 15553us (15946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368203.177455:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787368203.177522:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787368203.177532:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787368203.177537:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787368203.177540:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bd409800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787368203.177565:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000b02d177): req@ffff9c55bd8f3800 x1874190808622976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368203.177583:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808630528:0@lo:38:kworker.0 00000100:00100000:0.0:1787368203.177809:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808630912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368203.177848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368203.177893:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808630912 00000100:00100000:0.0:1787368203.177899:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808630912 00000100:00100000:0.0:1787368203.177983:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787368203.177992:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808630912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787368203.178034:0:22884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787368203.178071:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808630912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368203.178077:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787368203.178106:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808630912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787368203.179486:0:22920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368203.179514:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89780 going to sleep for 11 seconds 00000100:00100000:3.0:1787368203.179535:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808622976 00000100:00100000:3.0:1787368203.179542:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808622976 00000100:00100000:3.0:1787368203.179612:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368203.179621:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22920:x1874190808622976:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787368203.179696:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22920:x1874190808622976:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368203.179703:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368203.179751:0:22920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22920:1874190808622976:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787368203.179782:0:22920:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787368203.179816:0:22920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22920:1874190808631040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787368203.179841:0:22920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368203.179853:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55884dfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368203.179862:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808631040 00000100:00100000:3.0:1787368203.179865:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808631040 00000100:00100000:3.0:1787368203.179884:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787368203.179890:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22920:x1874190808631040:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787368203.180022:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22920:x1874190808631040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 131us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368203.180034:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787368203.180059:0:22920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22920:1874190808631040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787368203.180117:0:22920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22920:1874190808631168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787368203.180139:0:22920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368203.180153:0:22920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55884dfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368203.180163:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808631168 00000100:00100000:3.0:1787368203.180166:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808631168 00000100:00100000:3.0:1787368203.180187:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787368203.180193:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22920:x1874190808631168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787368203.181367:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22920:x1874190808631168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1159us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368203.181375:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787368203.181415:0:22920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22920:1874190808631168:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787368203.181458:0:22920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787368203.189392:0:22920:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787368203.189468:0:22920:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1787368203.189473:0:22920:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1787368203.876653:0:23982:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787368203.876863:0:23982:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787368204.184548:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787368205.035504:0:24030:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe234119c0 20000000:00000080:0.0:1787368205.035522:0:24030:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c55a8e41c00 uarg=0000000000000000 20000000:01000000:0.0:1787368205.035569:0:24030:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787368205.035577:0:24030:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787368205.035581:0:24030:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787368205.036529:0:24031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787368205.036689:0:24030:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787368205.043240:0:24030:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787368205.043921:0:24030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368205.043958:0:24030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0324d7 expref: 17 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368205.043967:0:24030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0325da expref: 17 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368205.043974:0:24030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368205.044025:0:24030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0325da expref: 17 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368205.044041:0:24030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0325da expref: 17 pid: 22871 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368205.044056:0:24030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24030:1874190808631296:0@lo:104: 00000100:00100000:2.0:1787368205.044124:0:24030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787368205.044232:0:24030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0324d7 expref: 17 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368205.044241:0:24030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0324d7 expref: 17 pid: 22873 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368205.044250:0:24030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24030:1874190808631424:0@lo:104: 00000100:00100000:2.0:1787368205.044274:0:24030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368205.047260:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808631296 00000100:00100000:1.0:1787368205.047281:0:22861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808631296 00000100:00100000:1.0:1787368205.047338:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808631424 00000100:00100000:1.0:1787368205.047341:0:22861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808631424 00000100:00100000:1.0:1787368205.047397:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787368205.047407:0:22861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+4:24030:x1874190808631296:12345-0@lo:104: 00010000:00010000:1.0:1787368205.047430:0:22861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368205.047538:0:22861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787368205.047545:0:22861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+4:24030:x1874190808631296:12345-0@lo:104: Request processed in 140us (3421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368205.047552:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787368205.047570:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787368205.047576:0:22861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:24030:x1874190808631424:12345-0@lo:104: 00010000:00010000:1.0:1787368205.047585:0:22861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368205.047619:0:22861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787368205.047624:0:22861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:24030:x1874190808631424:12345-0@lo:104: Request processed in 49us (3351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368205.047630:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787368205.047648:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787368205.047654:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368205.047661:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74c00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368205.047665:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368205.047673:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368205.047693:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368205.047698:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787368205.047804:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368205.047812:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787368205.047831:0:24030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585538a80 going to sleep for 11 seconds 00010000:00010000:1.0:1787368205.047835:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368205.047844:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff0325da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0325e1 expref: -99 pid: 23610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368205.047856:0:24030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24030:1874190808631296:0@lo:104: 00010000:00010000:1.0:1787368205.047861:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368205.047866:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368205.047870:0:24030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24030:1874190808631424:0@lo:104: 00010000:00010000:1.0:1787368205.047876:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a600 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:1.0:1787368205.047881:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368205.047888:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368205.047897:0:24030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787368205.047897:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368205.047903:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787368205.048007:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368205.048015:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787368205.048024:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368205.048030:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a600/0x66f5679bff0324d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0324de expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368205.048068:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808631552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368205.048107:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787368205.048167:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368205.048170:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368205.048172:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368205.048180:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368205.048186:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808631680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368205.048886:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368205.052543:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808631552 00000100:00100000:3.0:1787368205.052558:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808631552 00010000:00010000:3.0:1787368205.052599:0:22865:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0325da expref: 18 pid: 22871 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368205.052633:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808631680 00000100:00100000:3.0:1787368205.052650:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808631680 00010000:00010000:3.0:1787368205.052665:0:22865:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0324d7 expref: 19 pid: 22873 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368205.052682:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368205.052691:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:3651:x1874190808631552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368205.052707:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368205.052712:0:22865:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0325da expref: 19 pid: 22871 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.052723:0:22865:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0325da expref: 19 pid: 22871 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.052741:0:22865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0325e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0325da expref: 19 pid: 22871 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.052755:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368205.052960:0:22863:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787368205.052978:0:22863:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787368205.053005:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:3651:x1874190808631552:12345-0@lo:103:ldlm_bl.0 Request processed in 313us (4895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368205.053014:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368205.053031:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368205.053038:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:3652:x1874190808631680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368205.053046:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368205.053050:0:22865:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0324d7 expref: 17 pid: 22873 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053059:0:22865:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0324d7 expref: 17 pid: 22873 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053068:0:22865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75e00/0x66f5679bff0324de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0324d7 expref: 17 pid: 22873 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053086:0:22865:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053095:0:22865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053109:0:22865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053115:0:22865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053122:0:22865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053129:0:22865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053146:0:22865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368205.053150:0:22865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053157:0:22865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053169:0:22865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368205.053179:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368205.053212:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+16:3652:x1874190808631680:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (4328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368205.053224:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368205.053264:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808631680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368205.053502:0:24030:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368205.053514:0:24030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368205.053523:0:24030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75600/0x66f5679bff032635 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368205.054407:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808631552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368205.208459:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368206.232749:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787368206.746079:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787368206.808915:0:22875:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787368206.808922:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5483678000 from 13 10000000:01000000:1.0:1787368206.808928:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787368206.808984:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368206.808996:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368206.809007:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368206.809031:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808631808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787368206.809101:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368206.809149:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb240 going to sleep for 11 seconds 00000100:00100000:1.0:1787368206.809169:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808631808 00000100:00100000:1.0:1787368206.809176:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808631808 00000100:00100000:1.0:1787368206.809221:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787368206.809230:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+16:22875:x1874190808631808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368206.809241:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368206.809254:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03263c expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368206.809274:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03263c expref: 17 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368206.809284:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03263c expref: 17 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368206.809293:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55814a1800, rc 0) 00000100:00100000:1.0:1787368206.809330:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808631808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368206.809336:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787368206.809402:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808631808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368206.809416:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368206.809425:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368206.809483:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808631936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787368206.809508:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368206.809535:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1787368206.809736:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808631936 00000100:00100000:2.0:1787368206.809741:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808631936 00000100:00100000:2.0:1787368206.809770:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787368206.809777:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808631936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368206.809904:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808631936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368206.809911:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787368206.810061:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808631936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787368206.810089:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808632064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787368206.810128:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368206.810149:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1787368206.810240:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808632064 00000100:00100000:2.0:1787368206.810245:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808632064 00000100:00100000:2.0:1787368206.810276:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787368206.810283:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808632064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787368206.810382:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808632064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368206.810389:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787368206.810535:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808632064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787368206.815604:0:24108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787368206.815770:0:22875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787368206.815791:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787368206.815811:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368206.815823:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368206.815833:0:22875:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787368206.815836:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55acbc7800 from 13 10000000:01000000:2.0:1787368206.815839:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787368206.815872:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368206.815880:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368206.815890:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368206.815923:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808632192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787368206.815999:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368206.816042:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590597f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787368206.816183:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808632192 00000100:00100000:3.0:1787368206.816190:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808632192 00000100:00100000:3.0:1787368206.816235:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787368206.816244:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+17:22875:x1874190808632192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368206.816257:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368206.816270:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03264a expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368206.816292:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03264a expref: 18 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368206.816302:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03264a expref: 18 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368206.816309:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241dc00, rc 0) 00000100:00100000:3.0:1787368206.816345:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:22875:x1874190808632192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368206.816352:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787368206.816460:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808632192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368206.816473:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368206.816482:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368206.816545:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808632320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368206.816567:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368206.816624:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590597f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787368206.818936:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808632320 00000100:00100000:3.0:1787368206.818948:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808632320 00000100:00100000:3.0:1787368206.819007:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787368206.819017:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:22875:x1874190808632320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368206.819172:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:22875:x1874190808632320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (2601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368206.819190:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787368206.819395:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808632320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368206.819441:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808632448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787368206.819490:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368206.819521:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd5ccd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368206.819611:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808632448 00000100:00100000:3.0:1787368206.819615:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808632448 00000100:00100000:3.0:1787368206.819647:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787368206.819654:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:22875:x1874190808632448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368206.819771:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:22875:x1874190808632448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368206.819778:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787368206.821618:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808632448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787368206.829512:0:24111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787368206.829642:0:22875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787368206.829665:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787368206.829676:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368206.829689:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368207.256528:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368207.257456:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368197/real 1787368197] req@ffff9c55bd8f2680 x1874190808626176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368207.257490:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55bd8f2680 x1874190808626176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368207.257500:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368197/real 1787368197] req@ffff9c55be959180 x1874190808625920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368207.257511:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55be959180 x1874190808625920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368207.257532:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368207.257560:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368207.257565:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808626176:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787368207.257572:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc6bf800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368207.257576:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368207.257579:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808625920:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787368207.257819:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368207.257824:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368207.257828:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368207.257831:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368207.257861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368207.257865:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787368207.257868:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55bc6bf800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368207.257874:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1787368207.257879:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787368207.257895:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c55bc6bf800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368207.257918:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf7480 x1874190808632960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368207.257933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368207.257937:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787368207.257938:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368207.257941:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1787368207.257944:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787368207.257947:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c55bc50b800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368207.257958:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf6a00 x1874190808633088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368207.258002:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808632832:0@lo:400:kworker.0 00000100:00100000:2.0:1787368207.258142:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808632576:0@lo:400:kworker.0 00000100:00100000:2.0:1787368207.258211:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368207.258255:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368207.258261:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808632704:0@lo:400:kworker.0 00000100:00100000:2.0:1787368207.258291:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368207.258325:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808632576 00000100:00100000:2.0:1787368207.258334:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808632576 00000100:00100000:2.0:1787368207.258433:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787368207.258444:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808632576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368207.258501:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874190808632576:12345-0@lo:400:kworker.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368207.258508:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787368207.258533:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808632704 00000100:00100000:2.0:1787368207.258537:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808632704 00000100:00100000:2.0:1787368207.258563:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787368207.258570:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808632704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368207.258601:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808632704:12345-0@lo:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368207.258608:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787368207.258660:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55acbf7800 x1874190808632704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368207.258689:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808632704:0@lo:400:kworker.0 00000100:00100000:2.0:1787368207.258700:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808632576:0@lo:400:kworker.0 00000100:00100000:1.0:1787368207.259295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368207.259320:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787368207.259329:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808633216:0@lo:400:kworker.0 00000100:00100000:1.0:1787368207.259379:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368207.259418:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808633216 00000100:00100000:1.0:1787368207.259423:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808633216 00000100:00100000:1.0:1787368207.259459:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368207.259467:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808633216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368207.259505:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808633216:12345-0@lo:400:kworker.0 Request processed in 39us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368207.259511:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787368207.259544:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55acbf4e00 x1874190808633216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368207.259570:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808633216:0@lo:400:kworker.0 00000100:00100000:1.0:1787368207.259593:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808632960:0@lo:8:kworker.0 00000400:00000100:1.0:1787368207.259632:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808632960 offset 0 length 520: 4 00000100:00100000:1.0:1787368207.259654:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808633088:0@lo:8:kworker.0 00000400:00000100:1.0:1787368207.259684:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808633088 offset 0 length 520: 4 00000100:00100000:3.0:1787368207.259781:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808632832 00000100:00100000:3.0:1787368207.259791:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808632832 00000100:00100000:3.0:1787368207.259832:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787368207.259839:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808632832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368207.259879:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808632832:12345-0@lo:400:kworker.0 Request processed in 42us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368207.259886:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787368207.260391:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808632832:0@lo:400:kworker.0 00000100:00100000:3.0:1787368208.280633:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787368208.280658:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808633344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787368208.280727:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368208.281174:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808633344 00000100:00100000:0.0:1787368208.281188:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808633344 00000100:00100000:0.0:1787368208.281249:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787368208.281259:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808633344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787368208.281291:0:22884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787368208.281338:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808633344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368208.281346:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787368208.281587:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808633344:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787368208.282764:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368208.283039:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808633472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368208.283098:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368208.283896:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808633472 00000100:00100000:0.0:1787368208.283905:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808633472 00000100:00100000:0.0:1787368208.283950:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787368208.283959:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808633472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787368208.284010:0:23621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787368208.285065:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808633472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1103us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368208.285076:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787368208.285342:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808633472:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1787368208.796774:0:23611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1787368209.050241:0:23637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787368209.304510:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368209.305782:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368194/real 1787368194] req@ffff9c55bd8f1880 x1874190808624128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368209.305810:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55bd8f1880 x1874190808624128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368209.305821:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368194/real 1787368194] req@ffff9c55bd8f0a80 x1874190808624256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368209.305832:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55bd8f0a80 x1874190808624256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368209.305852:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368209.305873:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368209.305877:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808624128:0@lo:8:kworker.0 00000100:00080000:3.0:1787368209.305882:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368209.305887:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368209.305890:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808624256:0@lo:8:kworker.0 00000100:00080000:2.0:1787368209.306089:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368209.306093:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787368209.306096:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368209.306110:0:15931:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:2.0:1787368209.306116:0:15931:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787368209.306122:0:15931:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c5481b9f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368209.306141:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd8f0e00 x1874190808633856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787368209.306155:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368209.306158:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787368209.306160:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787368209.306162:0:15931:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:2.0:1787368209.306165:0:15931:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787368209.306168:0:15931:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c54845c9000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368209.306178:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55bd8f1f80 x1874190808633984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787368209.306215:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368209.306219:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787368209.306221:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787368209.306224:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787368209.306249:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808633600:0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.306314:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368209.306376:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808634368:0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.306407:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368209.306431:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787368209.306438:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808633728:0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.306464:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368209.306497:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808634112:0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.306521:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368209.306541:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368209.306547:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808634240:0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.306571:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368209.306606:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808633600 00000100:00100000:2.0:1787368209.306614:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808633600 00000100:00100000:2.0:1787368209.306660:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787368209.306669:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:3651:x1874190808633600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.306720:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:3651:x1874190808633600:12345-0@lo:400:kworker.0 Request processed in 52us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368209.306729:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787368209.306774:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808634368 00000100:00100000:2.0:1787368209.306779:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808634368 00000100:00100000:2.0:1787368209.306804:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808634112 00000100:00100000:2.0:1787368209.306806:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808634112 00000100:00100000:2.0:1787368209.306818:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787368209.306824:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808634368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.306852:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808634368:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368209.306859:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787368209.306872:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787368209.306879:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808634112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.306913:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808634112:12345-0@lo:400:kworker.0 Request processed in 35us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368209.306922:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787368209.306939:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808633728 00000100:00100000:2.0:1787368209.306942:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808633728 00000100:00100000:2.0:1787368209.306978:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808634240 00000100:00100000:2.0:1787368209.306981:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808634240 00000100:00100000:2.0:1787368209.306994:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787368209.307001:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808633728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.307033:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808633728:12345-0@lo:400:kworker.0 Request processed in 32us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368209.307038:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787368209.307048:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787368209.307054:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808634240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.307079:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808634240:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368209.307095:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787368209.307141:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808634240:0@lo:400:kworker.0 00010000:00080000:2.0:1787368209.307153:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55bd8f0a80 x1874190808634112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368209.307162:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808634112:0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.307183:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808633856:0@lo:8:kworker.0 00000400:00000100:2.0:1787368209.307208:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808633856 offset 0 length 520: 4 00000100:00100000:2.0:1787368209.307228:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808633984:0@lo:8:kworker.0 00000400:00000100:2.0:1787368209.307246:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190808633984 offset 0 length 520: 4 00000100:00100000:2.0:1787368209.307274:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808633728:0@lo:400:kworker.0 00000100:00100000:2.0:1787368209.307283:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808633600:0@lo:400:kworker.0 00010000:00080000:2.0:1787368209.307293:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c5483ea0700 x1874190808634368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368209.307300:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808634368:0@lo:400:kworker.0 00010000:00010000:2.0:1787368210.328622:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368211.355085:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787368211.949683:0:24379:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787368211.949687:0:24379:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787368211.949689:0:24379:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787368211.949801:0:24379:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c55b0fa1800 00000020:01000004:2.0:1787368211.949816:0:24379:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787368211.949828:0:24379:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787368211.949864:0:24379:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c559f838000) 00000020:00000080:2.0:1787368211.949882:0:24379:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787368212.050598:0:24379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787368212.054232:0:24379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787368212.054976:0:24379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787368212.055930:0:24379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787368212.056729:0:24379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787368212.057721:0:24379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787368212.061235:0:24379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1787368212.070185:0:24379:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787368212.070676:0:24379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787368212.070689:0:24379:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787368212.070700:0:24379:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x66f5679bff03265f 00000020:01000004:2.0:1787368212.070706:0:24379:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787368212.070726:0:24379:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787368212.070730:0:24379:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787368212.070735:0:24379:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787368212.070740:0:24379:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787368212.070751:0:24379:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c559f83cd28) 00000020:00000080:2.0:1787368212.070762:0:24379:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787368212.073017:0:24379:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787368212.073221:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787368212.073227:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787368212.082527:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787368212.082542:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787368212.083974:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787368212.083983:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787368212.090946:0:24379:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787368212.095108:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787368212.095120:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787368212.114547:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787368212.114566:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787368212.160947:0:24379:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787368212.161505:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787368212.161512:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787368212.167452:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787368212.167468:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787368212.168390:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787368212.168401:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787368212.178401:0:24379:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787368212.178602:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787368212.178609:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787368212.188988:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787368212.189001:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787368212.316269:0:24379:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787368212.316507:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787368212.316514:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787368212.331720:0:24379:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787368212.331739:0:24379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787368212.339708:0:24379:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787368212.339743:0:24379:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787368212.339750:0:24379:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:2.0:1787368212.380906:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787368212.419696:0:24379:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787368212.419739:0:24379:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787368212.419744:0:24379:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787368212.419746:0:24379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787368212.419747:0:24379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368212.419748:0:24379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368212.419750:0:24379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368212.419751:0:24379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368212.419753:0:24379:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787368212.419754:0:24379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368212.419756:0:24379:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787368212.419759:0:24379:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787368212.419762:0:24379:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787368212.419763:0:24379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787368212.419764:0:24379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368212.419765:0:24379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368212.419766:0:24379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368212.419768:0:24379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368212.419769:0:24379:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787368212.419770:0:24379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368212.419771:0:24379:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787368212.419797:0:24379:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787368212.419816:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808634496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787368212.419898:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368212.419946:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787368212.420027:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808634496 00000100:00100000:0.0:1787368212.420034:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808634496 00000100:00100000:0.0:1787368212.420095:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787368212.420105:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:24379:x1874190808634496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787368212.420135:0:22873:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787368212.420138:0:22873:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787368212.420142:0:22873:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787368212.422255:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:24379:x1874190808634496:12345-0@lo:253:mount.lustre.0 Request processed in 2135us (2340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368212.422279:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787368212.423444:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808634496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787368212.423460:0:24379:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787368212.423463:0:24379:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787368212.423465:0:24379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787368212.423466:0:24379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368212.423467:0:24379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368212.423468:0:24379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368212.423469:0:24379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368212.423471:0:24379:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787368212.423472:0:24379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368212.423484:0:24379:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787368212.423505:0:24379:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c55b0fa1800 from lustre-OST0000 10000000:01000000:3.0:1787368212.423534:0:24379:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787368212.423537:0:24379:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787368212.423546:0:24379:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c55912fb370 local copy 00010000:00010000:3.0:1787368212.423557:0:24379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368212.423672:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808634624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368212.423734:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368212.424470:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787368212.438417:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808634624 00000100:00100000:2.0:1787368212.438433:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808634624 00000100:00100000:2.0:1787368212.438493:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787368212.438503:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:24379:x1874190808634624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368212.438655:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:24379:x1874190808634624:12345-0@lo:501:mount.lustre.0 Request processed in 154us (14920us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787368212.438664:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787368212.438948:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808634624:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787368212.438972:0:24379:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787368212.438995:0:24379:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787368212.439003:0:24379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.439013:0:24379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368212.439043:0:24379:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c55b0fa1800 10000000:01000000:3.0:1787368212.439048:0:24379:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787368212.439053:0:24379:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787368212.439056:0:24379:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787368212.439060:0:24379:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787368212.439063:0:24379:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787368212.439101:0:24379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff03266d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.439109:0:24379:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff03266d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.439125:0:24379:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff03266d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368212.439143:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808634752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787368212.439179:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368212.439221:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787368212.442394:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808634752 00000100:00100000:2.0:1787368212.442408:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808634752 00000100:00100000:2.0:1787368212.442475:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787368212.442485:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+18:24379:x1874190808634752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368212.442501:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368212.442547:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75800/0x66f5679bff032674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03266d expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368212.442574:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75800/0x66f5679bff032674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03266d expref: 19 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368212.442585:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75800/0x66f5679bff032674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03266d expref: 19 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368212.442594:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75800, rc 0) 00000100:00100000:2.0:1787368212.442677:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808634752:12345-0@lo:101:mount.lustre.0 Request processed in 193us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368212.442684:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787368212.442918:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808634752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368212.442945:0:24379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff03266d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032674 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.442954:0:24379:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff03266d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032674 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368212.451061:0:24379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1787368212.454484:0:24379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787368212.491169:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787368212.491234:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787368212.491252:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787368212.491265:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787368212.491278:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787368212.491291:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787368212.491307:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787368212.491322:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787368212.491335:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1787368212.491348:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1787368212.491387:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1787368212.491402:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1787368212.491429:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1787368212.491434:0:24379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1787368212.491542:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808634880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368212.491607:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368212.491656:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787368212.491933:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808634880 00000100:00100000:0.0:1787368212.491950:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808634880 00000100:00100000:0.0:1787368212.492002:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787368212.492010:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808634880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368212.492158:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808634880:12345-0@lo:501:mount.lustre.0 Request processed in 148us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368212.492165:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787368212.499448:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808634880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368212.499524:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368212.499600:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368212.499650:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787368212.499706:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808635008 00000100:00100000:0.0:1787368212.499713:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808635008 00000100:00100000:0.0:1787368212.499764:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787368212.499773:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808635008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368212.500847:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808635008:12345-0@lo:503:mount.lustre.0 Request processed in 1071us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368212.500868:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787368212.501024:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635008:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787368212.501513:0:24379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787368212.501592:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368212.501637:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368212.501667:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5585551cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368212.501829:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808635136 00000100:00100000:0.0:1787368212.501835:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808635136 00000100:00100000:0.0:1787368212.501874:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787368212.501883:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808635136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368212.502454:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808635136:12345-0@lo:502:mount.lustre.0 Request processed in 571us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368212.502462:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787368212.503433:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368212.503709:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787368212.503736:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787368212.503749:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787368212.503761:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787368212.503772:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787368212.503783:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787368212.503794:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787368212.503805:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787368212.503816:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1787368212.503828:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1787368212.503839:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1787368212.504009:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1787368212.504046:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368212.509339:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368212.509437:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495000 going to sleep for 11 seconds 00000100:00100000:2.0:1787368212.509594:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808635264 00000100:00100000:2.0:1787368212.509605:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808635264 00000100:00100000:2.0:1787368212.509659:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787368212.509669:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808635264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368212.509817:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808635264:12345-0@lo:502:mount.lustre.0 Request processed in 149us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368212.509836:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787368212.514247:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368212.514408:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1787368212.514422:0:24379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787368212.518439:0:24396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787368212.518451:0:24396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787368212.518458:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787368212.518460:0:24396:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787368212.518467:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787368212.518484:0:24396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c559124cd28) 00000020:00000080:1.0:1787368212.518509:0:24396:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787368212.518516:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787368212.518601:0:24396:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55b0fa1800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787368212.518611:0:24396:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787368212.518623:0:24396:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x66f5679bff032682 00010000:00010000:1.0:1787368212.528778:0:24396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787368212.542991:0:24396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1787368212.547733:0:24396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787368212.554636:0:24396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787368212.554650:0:24396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368212.554658:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368212.554660:0:24396:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787368212.554671:0:24396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787368212.554673:0:24396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787368212.554675:0:24396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368212.554677:0:24396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787368212.554678:0:24396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787368212.554681:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368212.554682:0:24396:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787368212.554684:0:24396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368212.554687:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368212.554688:0:24396:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787368212.554691:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787368212.554693:0:24396:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787368212.554695:0:24396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368212.554697:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368212.554698:0:24396:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787368212.554701:0:24396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368212.554703:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368212.554704:0:24396:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787368212.554707:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787368212.554733:0:24396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368212.554736:0:24396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368212.554737:0:24396:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787368212.554740:0:24396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1787368212.554976:0:24379:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787368212.555005:0:24379:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787368212.555029:0:24379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff03266d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032674 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368212.555040:0:24379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241d600/0x66f5679bff03266d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032674 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368212.555047:0:24379:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55b0fa1800 from 1 10000000:01000000:2.0:1787368212.555050:0:24379:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787368212.555084:0:24379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368212.555092:0:24379:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368212.555102:0:24379:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368212.555126:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787368212.555188:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368212.555231:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55acb0b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787368212.556985:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808635392 00000100:00100000:3.0:1787368212.556999:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808635392 00000100:00100000:3.0:1787368212.557110:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787368212.557121:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:24379:x1874190808635392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368212.557135:0:22873:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368212.557151:0:22873:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032689 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.557179:0:22873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032689 expref: 20 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.557191:0:22873:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032689 expref: 20 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.557200:0:22873:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241d200, rc 0) 00000100:00100000:3.0:1787368212.557835:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808635392:12345-0@lo:101:mount.lustre.0 Request processed in 715us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.557856:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787368212.558007:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368212.558026:0:24379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.558035:0:24379:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787368212.563727:0:24379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1787368212.564023:0:24379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368212.564792:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787368212.564823:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1787368212.564840:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1787368212.564928:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1787368212.564955:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1787368212.564970:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1787368212.564982:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1787368212.564993:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1787368212.565005:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1787368212.565017:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1787368212.565042:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1787368212.565062:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1787368212.565068:0:24379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1787368212.565820:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368212.566540:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368212.566635:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368212.567957:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808635520 00000100:00100000:3.0:1787368212.567966:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808635520 00000100:00100000:3.0:1787368212.568016:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787368212.568026:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808635520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368212.568761:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808635520:12345-0@lo:501:mount.lustre.0 Request processed in 735us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.568772:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787368212.574663:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368212.574731:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787368212.574810:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368212.578752:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808635648 00000100:00100000:1.0:1787368212.578768:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808635648 00000100:00100000:1.0:1787368212.578851:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787368212.578863:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808635648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368212.579074:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808635648:12345-0@lo:503:mount.lustre.0 Request processed in 213us (4263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368212.579094:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787368212.579563:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368212.579590:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635648:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787368212.580021:0:24379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787368212.580311:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787368212.580435:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368212.580577:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368212.595433:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808635776 00000100:00100000:3.0:1787368212.595447:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808635776 00000100:00100000:1.0:1787368212.595660:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787368212.595671:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808635776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368212.595865:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808635776:12345-0@lo:502:mount.lustre.0 Request processed in 195us (15430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368212.595873:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787368212.595985:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368212.596273:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787368212.596303:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787368212.596326:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787368212.596338:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787368212.596349:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787368212.596383:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787368212.596398:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787368212.596410:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1787368212.596422:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787368212.596435:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1787368212.596447:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1787368212.596480:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368212.596526:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368212.596566:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55acb0b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787368212.596967:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808635904 00000100:00100000:1.0:1787368212.596972:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808635904 00000100:00100000:1.0:1787368212.597015:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787368212.597023:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808635904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368212.597133:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808635904:12345-0@lo:502:mount.lustre.0 Request processed in 110us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368212.597151:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787368212.597483:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808635904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368212.597536:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1787368212.597546:0:24379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787368212.603924:0:24400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368212.603946:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368212.603949:0:24400:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787368212.603957:0:24400:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55b0fa1800 00000020:00000080:2.0:1787368212.603960:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787368212.603968:0:24400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368212.603971:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368212.603972:0:24400:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787368212.603975:0:24400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368212.603978:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368212.603979:0:24400:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787368212.603983:0:24400:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c55b0fa1800 00000020:00000080:2.0:1787368212.603985:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787368212.604056:0:24400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368212.604060:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368212.604062:0:24400:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787368212.604064:0:24400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368212.604091:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368212.604101:0:24400:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787368212.604106:0:24400:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55b0fa1800 00000020:00000080:2.0:1787368212.604108:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787368212.604131:0:24400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368212.604134:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368212.604136:0:24400:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787368212.604139:0:24400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787368212.604141:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368212.604143:0:24400:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787368212.604146:0:24400:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c55b0fa1800 00000020:00000080:2.0:1787368212.604148:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787368212.604172:0:24400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787368212.604176:0:24400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368212.604178:0:24400:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787368212.604181:0:24400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787368212.606383:0:24379:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787368212.606422:0:24379:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787368212.606447:0:24379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.606461:0:24379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368212.606514:0:24379:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787368212.606517:0:24379:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c55b0fa1800 10000000:01000000:1.0:1787368212.606520:0:24379:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c55b0fa1800 10000000:01000000:1.0:1787368212.606524:0:24379:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787368212.606531:0:24379:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c55b0fa1800 from 1 10000000:01000000:1.0:1787368212.606533:0:24379:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787368212.606567:0:24379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff032697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.606576:0:24379:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff032697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.606586:0:24379:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff032697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368212.606611:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368212.606679:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368212.606720:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368212.606746:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808636032 00000100:00100000:1.0:1787368212.606752:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808636032 00000100:00100000:1.0:1787368212.606815:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787368212.606825:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:24379:x1874190808636032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368212.606838:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368212.606860:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613a800/0x66f5679bff03269e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032697 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.606882:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a800/0x66f5679bff03269e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032697 expref: 21 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.606893:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613a800/0x66f5679bff03269e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032697 expref: 21 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.606902:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a800, rc 0) 00000100:00100000:1.0:1787368212.606951:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636032:12345-0@lo:101:mount.lustre.0 Request processed in 127us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368212.606958:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787368212.607004:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787368212.607027:0:24379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff032697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03269e expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.607035:0:24379:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff032697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03269e expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787368212.650350:0:24379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1787368212.650677:0:24379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787368212.651170:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787368212.651195:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1787368212.651322:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1787368212.651343:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1787368212.651469:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1787368212.651488:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1787368212.651504:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1787368212.651518:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1787368212.651533:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787368212.651548:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1787368212.651563:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1787368212.651577:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1787368212.651591:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1787368212.651605:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1787368212.651619:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1787368212.651656:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1787368212.651673:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1787368212.651689:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1787368212.651703:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1787368212.651717:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1787368212.651733:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1787368212.651746:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1787368212.651761:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1787368212.651777:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1787368212.651792:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1787368212.651807:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1787368212.654863:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1787368212.654899:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1787368212.654916:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1787368212.654930:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1787368212.654957:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1787368212.654975:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1787368212.654992:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1787368212.655027:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1787368212.655046:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1787368212.655063:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1787368212.655092:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1787368212.655112:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1787368212.655126:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1787368212.655140:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1787368212.655154:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1787368212.655169:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1787368212.655181:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1787368212.655192:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1787368212.655205:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1787368212.655233:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1787368212.660114:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1787368212.660139:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1787368212.660332:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1787368212.660352:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1787368212.660391:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1787368212.660396:0:24379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1787368212.660498:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368212.660563:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368212.660609:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55acb0b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787368212.661779:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808636160 00000100:00100000:3.0:1787368212.661798:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808636160 00000100:00100000:3.0:1787368212.661949:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787368212.661958:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368212.664347:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636160:12345-0@lo:501:mount.lustre.0 Request processed in 137us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.664372:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787368212.665460:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368212.665514:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368212.665577:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368212.665612:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55acb0b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787368212.669928:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808636288 00000100:00100000:1.0:1787368212.669951:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808636288 00000100:00100000:1.0:1787368212.670015:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787368212.670024:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368212.670192:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636288:12345-0@lo:503:mount.lustre.0 Request processed in 168us (4613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368212.670216:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787368212.670425:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787368212.670801:0:24379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787368212.670881:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368212.670926:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368212.670963:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808636416 00000100:00100000:2.0:1787368212.670967:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808636416 00000100:00100000:2.0:1787368212.670988:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787368212.670994:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368212.671059:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636416:12345-0@lo:502:mount.lustre.0 Request processed in 64us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368212.671066:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787368212.671097:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55acb0b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787368212.671108:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368212.671992:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787368212.672030:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787368212.672046:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787368212.672062:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787368212.672894:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787368212.672923:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787368212.672953:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787368212.672969:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787368212.672983:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787368212.672997:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787368212.673027:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787368212.673043:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787368212.673057:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787368212.673069:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787368212.674179:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787368212.674526:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787368212.674549:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787368212.674566:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787368212.674583:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787368212.674599:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787368212.674615:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787368212.674631:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787368212.674647:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787368212.674664:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787368212.674680:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787368212.674696:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787368212.674729:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787368212.674747:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787368212.674763:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787368212.674779:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787368212.674794:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787368212.677471:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787368212.677517:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787368212.677532:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787368212.677557:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787368212.677571:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787368212.677582:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787368212.677594:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787368212.677606:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787368212.677618:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787368212.677631:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787368212.677643:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787368212.677674:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787368212.677688:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787368212.677700:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787368212.677712:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787368212.677725:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787368212.677737:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787368212.677792:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368212.681132:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368212.681185:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55acb0b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787368212.683202:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808636544 00000100:00100000:3.0:1787368212.683224:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808636544 00000100:00100000:3.0:1787368212.683279:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787368212.683288:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368212.683458:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636544:12345-0@lo:502:mount.lustre.0 Request processed in 170us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.683466:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787368212.687420:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368212.687663:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787368212.687690:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787368212.687726:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368212.687795:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368212.687847:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55acb0b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787368212.688909:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808636672 00000100:00100000:1.0:1787368212.688918:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808636672 00000100:00100000:1.0:1787368212.688980:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787368212.688991:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368212.689153:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808636672:12345-0@lo:502:mount.lustre.0 Request processed in 163us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368212.689160:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787368212.689959:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808636672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368212.690036:0:24379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1787368212.690048:0:24379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787368212.699609:0:24405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787368212.699627:0:24405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c55bc5e3370) 00000020:00000080:0.0:1787368212.699651:0:24405:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787368212.699740:0:24405:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55b0fa1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787368212.699744:0:24405:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55b0fa1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787368212.699746:0:24405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55b0fa1800 3 00010000:00080000:0.0:1787368212.699778:0:24405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c5483e5f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368212.705233:0:24405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787368212.710711:0:24405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787368212.710756:0:24405:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787368212.710769:0:24405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x66f5679bff0326ac 00000100:00080000:0.0:1787368212.710779:0:24405:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368212.710785:0:24405:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c5483e5f800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368212.715535:0:24405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55be959c00 x1874190808636800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368212.715560:0:24405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787368212.715621:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368212.715625:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368212.715628:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368212.715630:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368212.715646:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368212.715649:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368212.715651:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368212.715654:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787368212.715690:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808636928:0@lo:400:kworker.0 00000100:00100000:0.0:1787368212.715754:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368212.715791:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808637440:0@lo:400:kworker.0 00000100:00100000:3.0:1787368212.721717:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808636800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787368212.721797:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368212.724160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368212.724206:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787368212.724234:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808637312:0@lo:400:kworker.0 00000100:00100000:0.0:1787368212.724271:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368212.724334:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808637056:0@lo:400:kworker.0 00000100:00100000:0.0:1787368212.724398:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368212.724420:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787368212.724428:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808637184:0@lo:400:kworker.0 00000100:00100000:0.0:1787368212.724453:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368212.724494:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808636928 00000100:00100000:0.0:1787368212.724502:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808636928 00000100:00100000:0.0:1787368212.724551:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787368212.724562:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3652:x1874190808636928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368212.724616:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3652:x1874190808636928:12345-0@lo:400:kworker.0 Request processed in 56us (8862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368212.724624:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787368212.724990:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808636800 00000100:00100000:3.0:1787368212.724995:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808636800 00000100:00100000:3.0:1787368212.725010:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808637440 00000100:00100000:3.0:1787368212.725012:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808637440 00000100:00100000:3.0:1787368212.725028:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808637184 00000100:00100000:3.0:1787368212.725031:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808637184 00000100:00100000:3.0:1787368212.725044:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368212.725050:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808637440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368212.725113:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874190808637440:12345-0@lo:400:kworker.0 Request processed in 62us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.725120:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368212.725134:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368212.725148:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808637184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368212.725183:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808637184:12345-0@lo:400:kworker.0 Request processed in 36us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.725189:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368212.725201:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368212.725216:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874190808636800:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787368212.725240:0:22880:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:3.0:1787368212.725274:0:22880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x66f5679bff0326b3 00000004:00100000:3.0:1787368212.725289:0:22880:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787368212.725322:0:22880:0:(import.c:65:import_set_state_nolock()) ffff9c548353d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787368212.725386:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874190808636800:12345-0@lo:38:llog_process_th.0 Request processed in 179us (3589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.725392:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787368212.725431:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55be958a80 x1874190808637184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368212.725444:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808637184:0@lo:400:kworker.0 00010000:00080000:3.0:1787368212.725475:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55be959c00 x1874190808636800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368212.725483:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787368212.725489:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787368212.725497:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787368212.725501:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787368212.725503:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5483e5f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787368212.725509:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874190808636800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787368212.726647:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808637312 00000100:00100000:2.0:1787368212.726658:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808637312 00000100:00100000:2.0:1787368212.726692:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808637056 00000100:00100000:2.0:1787368212.726696:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808637056 00000100:00100000:2.0:1787368212.726714:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787368212.726723:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808637312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368212.726795:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808637312:12345-0@lo:400:kworker.0 Request processed in 74us (2523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368212.726802:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787368212.726829:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787368212.726835:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808637056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368212.726867:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808637056:12345-0@lo:400:kworker.0 Request processed in 32us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368212.726872:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787368212.732800:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808637056:0@lo:400:kworker.0 00000020:01000004:2.0:1787368212.733156:0:24405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787368212.733172:0:24405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c559f8399b8) 00000020:00000080:2.0:1787368212.733194:0:24405:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787368212.733302:0:24405:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c55b0fa1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787368212.733307:0:24405:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c55b0fa1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787368212.733309:0:24405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c55b0fa1800 3 00010000:00080000:2.0:1787368212.733348:0:24405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c559fa66800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1787368212.734915:0:24405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787368212.735101:0:24405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787368212.735140:0:24405:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787368212.735152:0:24405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x66f5679bff0326c1 00000100:00080000:2.0:1787368212.735161:0:24405:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787368212.735166:0:24405:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c559fa66800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1787368212.735197:0:24405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483ea2680 x1874190808637568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787368212.735218:0:24405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787368212.735496:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808637568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787368212.735563:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368212.735619:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808637568 00000100:00100000:3.0:1787368212.735626:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808637568 00000100:00100000:3.0:1787368212.735659:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368212.735665:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874190808637568:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787368212.735687:0:22880:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:3.0:1787368212.735724:0:22880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x66f5679bff0326c8 00000004:00100000:3.0:1787368212.735736:0:22880:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787368212.735765:0:22880:0:(import.c:65:import_set_state_nolock()) ffff9c5483538000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787368212.735807:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874190808637568:12345-0@lo:38:llog_process_th.0 Request processed in 141us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.735815:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787368212.735863:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c5483ea2680 x1874190808637568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368212.735874:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787368212.735880:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787368212.735887:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787368212.735890:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787368212.735892:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c559fa66800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787368212.735897:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874190808637568:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368212.742417:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808637312:0@lo:400:kworker.0 00000100:00100000:0.0:1787368212.742436:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3652:1874190808636928:0@lo:400:kworker.0 00010000:00080000:0.0:1787368212.742451:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c55be959880 x1874190808637440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368212.742462:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874190808637440:0@lo:400:kworker.0 00000100:00080000:0.0:1787368212.742568:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368212.742574:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368212.742577:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368212.742580:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368212.742583:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368212.742586:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787368212.742597:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368212.742600:0:15931:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787368212.747048:0:24405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1787368212.748221:0:24379:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787368212.749203:0:24379:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787368212.752947:0:24379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff032697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03269e expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.752967:0:24379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613b200/0x66f5679bff032697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03269e expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787368212.753049:0:24379:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787368212.753051:0:24379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787368212.753053:0:24379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368212.753054:0:24379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368212.753056:0:24379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368212.753057:0:24379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368212.753058:0:24379:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368212.753060:0:24379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368212.753062:0:24379:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787368212.753065:0:24379:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787368212.753068:0:24379:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787368212.753069:0:24379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787368212.753070:0:24379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368212.753071:0:24379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368212.753072:0:24379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368212.753079:0:24379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368212.753080:0:24379:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368212.753081:0:24379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368212.753082:0:24379:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787368212.753107:0:24379:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787368212.753126:0:24379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808637696:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787368212.753193:0:24379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368212.753249:0:24379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368212.753391:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808637696 00000100:00100000:3.0:1787368212.753405:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808637696 00000100:00100000:3.0:1787368212.753455:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787368212.753464:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808637696:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787368212.753490:0:22871:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787368212.753503:0:22871:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787368212.768916:0:22871:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787368212.768942:0:22871:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787368212.769349:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:24379:x1874190808637696:12345-0@lo:253:mount.lustre.0 Request processed in 15881us (16151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368212.769385:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 20000000:01000000:3.0:1787368212.769612:0:22894:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787368212.769616:0:22894:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787368212.769635:0:22894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.769651:0:22894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032612 expref: 20 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.769659:0:22894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032620 expref: 20 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.769666:0:22894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.769702:0:22894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff032620 expref: 20 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.769716:0:22894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff032620 expref: 20 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368212.769729:0:22894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808637824:0@lo:104: 00000100:00100000:3.0:1787368212.769765:0:22894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787368212.769820:0:22894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff032612 expref: 20 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.769829:0:22894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff032612 expref: 20 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368212.769860:0:22894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808637952:0@lo:104: 00000100:00100000:3.0:1787368212.769887:0:22894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368212.769906:0:22894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368212.769928:0:22861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787368212.769950:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808637824 00000100:00100000:3.0:1787368212.769957:0:22861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808637824 00000100:00100000:3.0:1787368212.769983:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808637952 00000100:00100000:3.0:1787368212.769986:0:22861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808637952 00000100:00100000:3.0:1787368212.769998:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787368212.770005:0:22861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+4:22894:x1874190808637824:12345-0@lo:104: 00010000:00010000:3.0:1787368212.770017:0:22861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770059:0:22861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787368212.770064:0:22861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+4:22894:x1874190808637824:12345-0@lo:104: Request processed in 60us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.770071:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787368212.770097:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787368212.770103:0:22861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55addbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808637952:12345-0@lo:104: 00010000:00010000:3.0:1787368212.770110:0:22861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770140:0:22861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787368212.770145:0:22861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55addbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808637952:12345-0@lo:104: Request processed in 43us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.770151:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787368212.770181:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787368212.770192:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770198:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787368212.770201:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770471:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787368212.770479:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368212.770485:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787368212.770513:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770520:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787368212.770539:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770546:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e74000/0x66f5679bff032620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032627 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770559:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368212.770562:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770566:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68b200 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:3.0:1787368212.770569:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770586:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787368212.770592:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368212.770598:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787368212.770611:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770615:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787368212.770622:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770628:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b200/0x66f5679bff032612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032619 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.770641:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368212.770643:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368212.770645:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368212.770651:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368212.770662:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808638080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368212.770692:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368212.770713:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787368212.770719:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808638208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368212.770741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368212.770771:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808638080 00000100:00100000:3.0:1787368212.770775:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808638080 00010000:00010000:3.0:1787368212.770799:0:22865:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032620 expref: 21 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368212.770959:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808638208 00000100:00100000:1.0:1787368212.770963:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808638208 00010000:00010000:1.0:1787368212.770977:0:24032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032612 expref: 22 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368212.771000:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787368212.771006:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483680850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:3653:x1874190808638208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368212.771015:0:24032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368212.771019:0:24032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032612 expref: 22 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.771028:0:24032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff032612 expref: 22 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368212.771040:0:24032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368212.771071:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483680850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:3653:x1874190808638208:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368212.771091:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787368212.771134:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808638208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368212.771376:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787368212.771385:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3653:x1874190808638080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368212.771393:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368212.771397:0:22865:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032620 expref: 21 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771407:0:22865:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff032620 expref: 21 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771418:0:22865:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771425:0:22865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787368212.771438:0:22865:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003524776s 00010000:00010000:3.0:1787368212.771442:0:22865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771449:0:22865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771455:0:22865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771460:0:22865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771465:0:22865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241da00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368212.771475:0:22865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771483:0:22865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771491:0:22865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771501:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368212.771529:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3653:x1874190808638080:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368212.771536:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787368212.771591:0:22894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55814a1600/0x66f5679bff032627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff032620 expref: 20 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368212.771601:0:22894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808637824:0@lo:104: 00010000:00010000:3.0:1787368212.771610:0:22894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55814a0600/0x66f5679bff032619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff032612 expref: 19 pid: 22871 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368212.771619:0:22894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808637952:0@lo:104: 00010000:00010000:3.0:1787368212.771631:0:22894:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771639:0:22894:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771645:0:22894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368212.771651:0:22894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241da00/0x66f5679bff0326cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368212.771726:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808638080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368212.774072:0:24379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:24379:1874190808637696:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787368212.774101:0:24379:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787368212.774120:0:24379:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787368212.774121:0:24379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787368212.774123:0:24379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787368212.774124:0:24379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787368212.774125:0:24379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787368212.774126:0:24379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787368212.774128:0:24379:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787368212.774129:0:24379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787368212.774130:0:24379:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787368212.774142:0:24379:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1787368212.802943:0:24379:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787368212.818959:0:24379:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787368212.818970:0:24379:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787368212.819003:0:24379:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787368212.819051:0:24379:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787368212.819069:0:24379:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787368212.819250:0:24379:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787368212.837155:0:24379:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787368212.837685:0:24379:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787368213.401536:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787368213.401570:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808638336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368213.401764:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368213.402106:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787368213.402116:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808638464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368213.402149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368213.402183:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808638336 00000100:00100000:2.0:1787368213.402190:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808638336 00000100:00100000:2.0:1787368213.402227:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808638464 00000100:00100000:2.0:1787368213.402230:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808638464 00000100:00100000:2.0:1787368213.402246:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787368213.402254:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808638336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787368213.402285:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787368213.402326:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808638336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368213.402333:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787368213.402349:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787368213.402389:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808638464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368213.402406:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787368213.402440:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808638464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368213.402447:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787368213.402507:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368213.402541:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808638464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368213.402577:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808638336:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1787368214.016593:0:24460:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787368214.017593:0:24460:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787368214.424689:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787368214.617458:0:22875:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787368214.617465:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c5483678000 from 13 10000000:01000000:3.0:1787368214.617470:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787368214.617514:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.617526:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.617536:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368214.617559:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808638592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787368214.617617:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368214.617656:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787368214.617725:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808638592 00000100:00100000:0.0:1787368214.617731:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808638592 00000100:00100000:0.0:1787368214.617784:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787368214.617793:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+19:22875:x1874190808638592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368214.617806:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368214.617821:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0326d6 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368214.617853:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0326d6 expref: 20 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368214.617864:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0326d6 expref: 20 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368214.617873:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ae00, rc 0) 00000100:00100000:0.0:1787368214.617909:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:22875:x1874190808638592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368214.617931:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787368214.620148:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808638592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368214.620174:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.620185:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368214.620250:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808638720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787368214.620300:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368214.620332:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368214.620348:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808638720 00000100:00100000:3.0:1787368214.620372:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808638720 00000100:00100000:3.0:1787368214.620411:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787368214.620419:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:22875:x1874190808638720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787368214.620436:0:22871:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787368214.620452:0:22871:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787368214.620454:0:22871:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1787368214.620531:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:22875:x1874190808638720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368214.620539:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787368214.620576:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808638720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787368214.620624:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787368214.620630:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.620638:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368214.620647:0:22875:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787368214.620649:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55acbc7800 from 13 10000000:01000000:3.0:1787368214.620652:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787368214.620672:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.620688:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.620697:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368214.620709:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808638848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787368214.620732:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368214.620746:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368214.620757:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808638848 00000100:00100000:3.0:1787368214.620761:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808638848 00000100:00100000:3.0:1787368214.620782:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787368214.620788:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:22875:x1874190808638848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368214.620795:0:22873:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368214.620805:0:22873:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0326e4 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.620821:0:22873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0326e4 expref: 21 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.620829:0:22873:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0326e4 expref: 21 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.620836:0:22873:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241c800, rc 0) 00000100:00100000:3.0:1787368214.620880:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:22875:x1874190808638848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368214.620887:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787368214.620932:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808638848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368214.620944:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.620951:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368214.620988:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808638976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787368214.621015:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368214.621028:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5587e67a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368214.621039:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808638976 00000100:00100000:3.0:1787368214.621043:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808638976 00000100:00100000:3.0:1787368214.621065:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787368214.621071:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:22875:x1874190808638976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787368214.621081:0:22872:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787368214.621091:0:22872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787368214.621094:0:22872:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1787368214.621171:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:22875:x1874190808638976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368214.621177:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787368214.621220:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808638976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787368214.621255:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787368214.621261:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368214.621268:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368215.450766:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368216.473098:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787368216.985256:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787368217.509182:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787368218.009423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368218.009428:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368218.009431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368218.009434:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368218.009451:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368218.009453:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368218.009456:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368218.009458:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787368218.009490:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808639232:0@lo:400:kworker.0 00000100:00100000:3.0:1787368218.009549:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368218.009585:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808639744:0@lo:400:kworker.0 00000100:00100000:3.0:1787368218.009622:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368218.009643:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787368218.009649:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808639104:0@lo:400:kworker.0 00000100:00100000:3.0:1787368218.009674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368218.009694:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808639616:0@lo:400:kworker.0 00000100:00100000:3.0:1787368218.009714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368218.009739:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808639104 00000100:00100000:3.0:1787368218.009745:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808639104 00000100:00100000:3.0:1787368218.009784:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787368218.009798:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3654:x1874190808639104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368218.009844:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3654:x1874190808639104:12345-0@lo:400:kworker.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368218.009851:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787368218.009880:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808639744 00000100:00100000:3.0:1787368218.009883:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808639744 00000100:00100000:3.0:1787368218.009926:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808639616 00000100:00100000:3.0:1787368218.009929:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808639616 00000100:00100000:3.0:1787368218.009943:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787368218.009948:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808639744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368218.009991:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808639744:12345-0@lo:400:kworker.0 Request processed in 43us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368218.009998:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787368218.010010:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787368218.010016:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808639616:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787368218.010078:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787368218.010414:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808639616:12345-0@lo:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368218.010422:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787368218.010463:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808639104:0@lo:400:kworker.0 00010000:00080000:3.0:1787368218.010475:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b5075180 x1874190808639616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368218.010487:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808639616:0@lo:400:kworker.0 00010000:00080000:3.0:1787368218.010496:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b5074380 x1874190808639744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368218.010504:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808639744:0@lo:400:kworker.0 00000100:00100000:2.0:1787368218.010626:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808639360:0@lo:400:kworker.0 00000100:00100000:2.0:1787368218.010658:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368218.010684:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808639872:0@lo:400:kworker.0 00000100:00100000:2.0:1787368218.010708:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368218.010726:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787368218.010731:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808639488:0@lo:400:kworker.0 00000100:00100000:2.0:1787368218.010751:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368218.010778:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808639232 00000100:00100000:2.0:1787368218.010782:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808639232 00000100:00100000:2.0:1787368218.010807:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808639488 00000100:00100000:2.0:1787368218.010810:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808639488 00000100:00100000:2.0:1787368218.010823:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787368218.010829:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808639232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368218.010867:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808639232:12345-0@lo:400:kworker.0 Request processed in 37us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368218.010873:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787368218.010885:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787368218.010890:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808639488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368218.010932:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808639488:12345-0@lo:400:kworker.0 Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368218.010938:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787368218.010944:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808639360 00000100:00100000:1.0:1787368218.010948:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808639360 00000100:00100000:2.0:1787368218.010966:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808639872 00000100:00100000:1.0:1787368218.010967:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787368218.010973:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808639360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368218.010975:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808639872 00000100:00100000:2.0:1787368218.010998:0:22879:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787368218.011003:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808639360:12345-0@lo:400:kworker.0 Request processed in 31us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368218.011004:0:22879:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787368218.011008:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787368218.011020:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787368218.011025:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808639872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368218.011032:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808639488:0@lo:400:kworker.0 00010000:00080000:2.0:1787368218.011041:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b5075880 x1874190808639360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368218.011050:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808639872:12345-0@lo:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368218.011056:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787368218.011061:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808639360:0@lo:400:kworker.0 00010000:00080000:2.0:1787368218.011072:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b5075f80 x1874190808639872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368218.011080:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808639872:0@lo:400:kworker.0 00000100:00080000:2.0:1787368218.011173:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787368218.011191:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808639232:0@lo:400:kworker.0 00000100:00100000:2.0:1787368218.533527:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787368218.533550:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808640000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787368218.533793:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787368218.533843:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368218.533886:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808640000 00000100:00100000:1.0:1787368218.533903:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808640000 00000100:00100000:1.0:1787368218.533950:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787368218.533964:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808640000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787368218.533997:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787368218.534050:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808640000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368218.534057:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787368218.535206:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808640128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368218.535258:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368218.535345:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808640128 00000100:00100000:2.0:1787368218.535351:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808640128 00000100:00100000:2.0:1787368218.535401:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787368218.535408:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808640128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787368218.535432:0:22884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787368218.547931:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808640128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12512us (12661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368218.547945:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787368218.548030:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808640000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368218.556682:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808640128:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787368219.295908:0:23637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787368219.545509:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368220.568465:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368221.594669:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787368221.649889:0:24751:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787368222.625956:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787368222.744053:0:24803:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787368222.745320:0:24803:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787368223.000430:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368207/real 1787368207] req@ffff9c55acbf7480 x1874190808632960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368223.000461:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55acbf7480 x1874190808632960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368223.000471:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368207/real 1787368207] req@ffff9c55acbf6a00 x1874190808633088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368223.000480:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55acbf6a00 x1874190808633088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368223.000497:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc6bf800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368223.000521:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368223.000525:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808632960:0@lo:8:kworker.0 00000100:00080000:3.0:1787368223.000530:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368223.000535:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368223.000538:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808633088:0@lo:8:kworker.0 00000100:00080000:1.0:1787368223.000699:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368223.000704:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368223.000707:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368223.000710:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787368223.000725:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368223.000727:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787368223.000730:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c55bc6bf800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368223.000735:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 664 00000100:00080000:1.0:1787368223.000740:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787368223.000747:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c55bc6bf800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368223.000765:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf4380 x1874190808640768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368223.000778:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368223.000780:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787368223.000782:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368223.000785:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 664 00000100:00080000:1.0:1787368223.000787:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787368223.000790:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c55bc50b800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368223.000799:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf6680 x1874190808640896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368223.000878:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808640512:0@lo:400:kworker.0 00000100:00100000:1.0:1787368223.000938:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368223.001068:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808640256:0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.001101:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368223.001130:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808640256 00000100:00100000:0.0:1787368223.001136:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808640256 00000100:00100000:0.0:1787368223.001184:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787368223.001192:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3654:x1874190808640256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.001233:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3654:x1874190808640256:12345-0@lo:400:kworker.0 Request processed in 42us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368223.001238:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787368223.001284:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808640768:0@lo:8:kworker.0 00000100:00100000:0.0:1787368223.001311:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368223.001335:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808640512 00000100:00100000:0.0:1787368223.001338:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808640512 00000100:00100000:0.0:1787368223.001394:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787368223.001401:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808640512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.001434:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874190808640512:12345-0@lo:400:kworker.0 Request processed in 34us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368223.001440:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787368223.001576:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55acbf6a00 x1874190808640512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368223.001587:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874190808640512:0@lo:400:kworker.0 00000100:00100000:1.0:1787368223.001593:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808641280:0@lo:400:kworker.0 00000100:00100000:1.0:1787368223.001618:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368223.001642:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808641280 00000100:00100000:1.0:1787368223.001645:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808641280 00000100:00100000:1.0:1787368223.001678:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787368223.001685:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808641280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368223.001720:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808641280:12345-0@lo:400:kworker.0 Request processed in 36us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368223.001725:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787368223.001739:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787368223.001806:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808640256:0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.001812:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808641024:0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.001832:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368223.001875:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787368223.001881:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808640640:0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.001903:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368223.001927:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808640640 00000100:00100000:0.0:1787368223.001930:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808640640 00000100:00100000:0.0:1787368223.001951:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787368223.001956:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808640640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.001995:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808640640:12345-0@lo:400:kworker.0 Request processed in 39us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368223.002009:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787368223.002028:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808641024 00000100:00100000:0.0:1787368223.002031:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808641024 00000100:00100000:0.0:1787368223.002050:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787368223.002055:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808641024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.002083:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808641024:12345-0@lo:400:kworker.0 Request processed in 28us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368223.002089:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787368223.002112:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808640640:0@lo:400:kworker.0 00010000:00080000:0.0:1787368223.002121:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55acbf5880 x1874190808641024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368223.002130:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808641024:0@lo:400:kworker.0 00000100:00100000:1.0:1787368223.002487:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808640896:0@lo:8:kworker.0 00000100:00100000:3.0:1787368223.002514:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808640384:0@lo:400:kworker.0 00000100:00100000:1.0:1787368223.002520:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368223.002562:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368223.002600:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808641152:0@lo:400:kworker.0 00000100:00100000:3.0:1787368223.002630:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368223.002633:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808640768 00000100:00100000:2.0:1787368223.002639:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808640768 00000100:00100000:2.0:1787368223.002657:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808640896 00000100:00100000:2.0:1787368223.002660:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808640896 00000100:00100000:2.0:1787368223.002670:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787368223.002675:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808640768:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787368223.002700:0:24383:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:2.0:1787368223.002728:0:24383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff0326f2 00000100:00100000:1.0:1787368223.003049:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808640384 00000100:00100000:1.0:1787368223.003054:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808640384 00000100:00100000:1.0:1787368223.003081:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787368223.003087:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808640384:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787368223.003989:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55acbf5f80 x1874190808641280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368223.004002:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808641280:0@lo:400:kworker.0 00002000:00100000:2.0:1787368223.005411:0:24383:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c5481b39800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787368223.005420:0:24383:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787368223.005423:0:24383:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787368223.005589:0:24383:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787368223.005618:0:24383:0:(import.c:65:import_set_state_nolock()) ffff9c5481b3b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787368223.005695:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874190808640768:12345-0@lo:8:kworker.0 Request processed in 3016us (4380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368223.005705:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787368223.005730:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368223.005735:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808640896:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787368223.005752:0:24383:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787368223.006755:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55acbf4380 x1874190808640768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787368243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368223.006769:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368223.006777:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787368223.006785:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787368223.006791:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787368223.006793:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc6bf800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787368223.006809:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787368223.006815:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808640768:0@lo:8:kworker.0 00000004:00080000:0.0:1787368223.006855:0:23619:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787368223.006936:0:23619:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 680294579606ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787368223.006942:0:23619:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787368223.007997:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808641152 00000100:00100000:0.0:1787368223.008009:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808641152 00000100:00100000:0.0:1787368223.008083:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787368223.008093:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808641152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.008175:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808641152:12345-0@lo:400:kworker.0 Request processed in 83us (5548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368223.008183:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787368223.008278:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55acbf4a80 x1874190808641152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368223.008291:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808641152:0@lo:400:kworker.0 00000100:00080000:1.0:1787368223.009424:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787368223.009481:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808640384:12345-0@lo:400:kworker.0 Request processed in 6391us (6916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368223.009492:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:1.0:1787368223.010078:0:23620:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787368223.010106:0:23620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23620:1874190808641536:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787368223.010147:0:23620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368223.010168:0:23620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5598213180 going to sleep for 11 seconds 00000100:00100000:1.0:1787368223.010219:0:24384:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787368223.010227:0:24384:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787368223.010290:0:24385:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787368223.010305:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808641536 00000100:00100000:0.0:1787368223.010312:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808641536 00000100:00080000:0.0:1787368223.010351:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787368223.010423:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808640384:0@lo:400:kworker.0 00000100:00100000:0.0:1787368223.010446:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787368223.010455:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808641408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787368223.010486:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368223.010633:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808641408 00000100:00100000:1.0:1787368223.010638:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808641408 00000100:00100000:1.0:1787368223.010672:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787368223.010681:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1874190808641408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787368223.010706:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787368223.010747:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1874190808641408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368223.010754:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787368223.012424:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5483cefb80 x1874190808641408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368223.012449:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808641408:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1787368223.015094:0:23611:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787368223.015137:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368223.015159:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23620:x1874190808641536:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1787368223.020892:0:24818:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787368223.020900:0:24818:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787368223.021000:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23620:x1874190808641536:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5843us (10848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368223.021011:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787368223.021234:0:23620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5483cec000 x1874190808641536/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787368239 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368223.021252:0:23620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23620:1874190808641536:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787368223.021265:0:23620:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787368223.021309:0:23620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23620:1874190808641664:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787368223.021347:0:23620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368223.021394:0:23620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89480 going to sleep for 11 seconds 00000100:00100000:0.0:1787368223.021412:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808641664 00000100:00100000:0.0:1787368223.021417:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808641664 00000100:00100000:0.0:1787368223.021460:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787368223.021469:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23620:x1874190808641664:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787368223.021506:0:24385:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787368223.021538:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23620:x1874190808641664:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368223.021545:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787368223.021575:0:23620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55be95ad80 x1874190808641664/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787368239 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368223.021585:0:23620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23620:1874190808641664:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787368223.021594:0:23620:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787368223.021631:0:23620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be95ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23620:1874190808641792:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787368223.021668:0:23620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368223.021683:0:23620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5582c89480 going to sleep for 11 seconds 00000100:00100000:0.0:1787368223.021694:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808641792 00000100:00100000:0.0:1787368223.021697:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808641792 00000100:00100000:0.0:1787368223.021719:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787368223.021725:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23620:x1874190808641792:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787368223.021753:0:24385:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1787368223.034249:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808640896:12345-0@lo:8:kworker.0 Request processed in 28505us (31724us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787368223.034267:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787368223.035149:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368223.035157:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787368223.035162:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808640896:0@lo:8:kworker.0 00000001:00080000:2.0:1787368223.063636:0:24380:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1787368223.063666:0:24380:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787368223.064008:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23620:x1874190808641792:12345-0@lo:5:osp-pre-0-1.0 Request processed in 42277us (42333us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787368223.064020:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787368223.064160:0:23620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55be95ad80 x1874190808641792/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787368239 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368223.064172:0:23620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787368223.064178:0:23620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be95ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23620:1874190808641792:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787368223.064194:0:23620:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1787368223.064246:0:23620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23620:1874190808641920:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787368223.064284:0:23620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368223.064316:0:23620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5598213f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787368223.065134:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808641920 00000100:00100000:2.0:1787368223.065143:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808641920 00000100:00100000:2.0:1787368223.065183:0:22889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368223.065192:0:22889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23620:x1874190808641920:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787368223.065255:0:22889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23620:x1874190808641920:12345-0@lo:900:osp-pre-0-1.0 Request processed in 64us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368223.065263:0:22889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787368223.065906:0:23620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5483ced500 x1874190808641920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787368239 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368223.065931:0:23620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23620:1874190808641920:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787368223.643424:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808642048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368223.643496:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368223.643552:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808642048 00000100:00100000:1.0:1787368223.643559:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808642048 00000100:00100000:1.0:1787368223.643604:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787368223.643614:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808642048:12345-0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787368223.643742:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000024:1.0:1787368223.643850:0:23621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787368223.644000:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808642048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368223.644041:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808642048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 427us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368223.644049:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787368223.645414:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808642176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368223.645488:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368223.645660:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808642176 00000100:00100000:0.0:1787368223.645683:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808642176 00000100:00100000:0.0:1787368223.645734:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787368223.645744:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808642176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787368223.645774:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787368223.645828:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808642176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368223.645835:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787368223.645896:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808642176:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1787368223.727728:0:24854:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787368223.727991:0:24854:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787368224.664666:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368225.688592:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787368226.201013:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787368226.713813:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368227.738164:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368228.248511:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808642304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787368228.248584:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368228.248653:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808642304 00000100:00100000:1.0:1787368228.248660:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808642304 00000100:00100000:1.0:1787368228.248718:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787368228.248727:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808642304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787368228.248756:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787368228.248795:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808642304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368228.248803:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787368228.248821:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787368228.248862:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5483ced880 x1874190808642304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368228.248879:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808642304:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787368228.250608:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368228.250613:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368228.250616:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368228.250619:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787368228.250636:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368228.250640:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787368228.250643:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368228.250650:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 680 00000100:00080000:3.0:1787368228.250655:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787368228.250661:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c55bc50b800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368228.250683:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b5077800 x1874190808642944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368228.250740:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808642560:0@lo:400:kworker.0 00000100:00100000:3.0:1787368228.250790:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368228.250822:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808643200:0@lo:400:kworker.0 00000100:00100000:3.0:1787368228.250859:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368228.250884:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787368228.250902:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808642432:0@lo:400:kworker.0 00000100:00100000:3.0:1787368228.250929:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368228.250961:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808643072:0@lo:400:kworker.0 00000100:00100000:3.0:1787368228.250989:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368228.251014:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808642944:0@lo:8:kworker.0 00000100:00100000:3.0:1787368228.251048:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368228.251079:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808643200 00000100:00100000:3.0:1787368228.251086:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808643200 00000100:00100000:3.0:1787368228.251131:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808643072 00000100:00100000:3.0:1787368228.251134:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808643072 00000100:00100000:3.0:1787368228.251153:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787368228.251161:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808643200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368228.251207:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808643200:12345-0@lo:400:kworker.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368228.251214:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787368228.251231:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787368228.251237:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808643072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368228.251262:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874190808643072:12345-0@lo:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368228.251267:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787368228.251284:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808642432 00000100:00100000:3.0:1787368228.251287:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808642432 00000100:00100000:3.0:1787368228.251311:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787368228.251317:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3654:x1874190808642432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368228.251344:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3654:x1874190808642432:12345-0@lo:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368228.251350:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787368228.251403:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808642944 00000100:00100000:3.0:1787368228.251406:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808642944 00000100:00100000:3.0:1787368228.251438:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787368228.251442:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874190808642944:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787368228.251459:0:24384:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787368228.251491:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874190808642944:12345-0@lo:8:kworker.0 Request processed in 47us (453us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787368228.251498:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787368228.251527:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808642432:0@lo:400:kworker.0 00010000:00080000:3.0:1787368228.251539:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b5076300 x1874190808643072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368228.251549:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874190808643072:0@lo:400:kworker.0 00010000:00080000:3.0:1787368228.251558:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b5075f80 x1874190808643200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368228.251566:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808643200:0@lo:400:kworker.0 00000100:00080000:3.0:1787368228.251598:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368228.251602:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787368228.251605:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808642944:0@lo:8:kworker.0 00000100:00100000:1.0:1787368228.252099:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808642560 00000100:00100000:1.0:1787368228.252105:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808642560 00000100:00100000:1.0:1787368228.252143:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787368228.252150:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808642560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368228.252200:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808642560:12345-0@lo:400:kworker.0 Request processed in 51us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368228.252207:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787368228.252233:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808642688:0@lo:400:kworker.0 00000100:00100000:1.0:1787368228.252259:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368228.252277:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808643328:0@lo:400:kworker.0 00000100:00100000:1.0:1787368228.252295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368228.252311:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787368228.252317:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808642816:0@lo:400:kworker.0 00000100:00100000:1.0:1787368228.252336:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368228.252381:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808642688 00000100:00100000:1.0:1787368228.252385:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808642688 00000100:00100000:1.0:1787368228.252407:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808643328 00000100:00100000:1.0:1787368228.252410:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808643328 00000100:00100000:1.0:1787368228.252430:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787368228.252436:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808642688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368228.252465:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808642688:12345-0@lo:400:kworker.0 Request processed in 30us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368228.252471:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787368228.252481:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787368228.252487:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808643328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368228.252509:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808643328:12345-0@lo:400:kworker.0 Request processed in 23us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368228.252522:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787368228.252539:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808642816 00000100:00100000:1.0:1787368228.252542:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808642816 00000100:00100000:1.0:1787368228.252560:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787368228.252565:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808642816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368228.252596:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808642816:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368228.252602:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787368228.252621:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787368228.252624:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787368228.252646:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808642816:0@lo:400:kworker.0 00010000:00080000:1.0:1787368228.252658:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b5077100 x1874190808642688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368228.252667:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808642688:0@lo:400:kworker.0 00010000:00080000:1.0:1787368228.252675:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b5075880 x1874190808643328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368228.252683:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808643328:0@lo:400:kworker.0 00000100:00100000:3.0:1787368228.252958:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808642560:0@lo:400:kworker.0 00000100:00100000:0.0:1787368228.760774:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55be958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808643456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787368228.760918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368228.760975:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808643456 00000100:00100000:0.0:1787368228.760982:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808643456 00000100:00100000:0.0:1787368228.761023:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787368228.761032:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808643456:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368228.761729:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808643584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368228.761771:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1787368228.761921:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787368228.761977:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808643456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 941us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368228.761987:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787368228.776109:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808643584 00000100:00100000:0.0:1787368228.776125:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808643584 00000100:00100000:0.0:1787368228.776172:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787368228.776182:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808643584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787368228.776221:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787368228.776311:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808643584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (14539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368228.776318:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1787368228.776347:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368228.776406:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808643584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368228.776445:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55be958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808643456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368229.272470:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368209/real 1787368209] req@ffff9c55bd8f0e00 x1874190808633856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368229.272503:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55bd8f0e00 x1874190808633856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368229.272514:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787368209/real 1787368209] req@ffff9c55bd8f1f80 x1874190808633984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368229.272560:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c55bd8f1f80 x1874190808633984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787368229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368229.272580:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368229.272598:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368229.272602:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808633856:0@lo:8:kworker.0 00000100:00080000:3.0:1787368229.272608:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787368229.272613:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787368229.272616:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808633984:0@lo:8:kworker.0 00000100:00080000:1.0:1787368229.272877:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368229.272882:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787368229.272884:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368229.272889:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1787368229.272895:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787368229.272909:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c5481b9f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368229.272931:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483cec380 x1874190808643840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368229.272948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368229.272951:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787368229.272953:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368229.272956:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1787368229.272959:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787368229.272962:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c54845c9000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368229.272985:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483ced180 x1874190808643968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787368229.273017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787368229.273020:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787368229.273022:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787368229.273026:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 685 00000100:00080000:1.0:1787368229.273028:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787368229.273031:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c55bc50b800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1787368229.273043:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5483ced500 x1874190808644352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787368229.273081:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808644096:0@lo:400:kworker.0 00000100:00100000:1.0:1787368229.273142:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368229.273173:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808644736:0@lo:400:kworker.0 00000100:00100000:1.0:1787368229.273194:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368229.273212:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787368229.273224:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808644224:0@lo:400:kworker.0 00000100:00100000:1.0:1787368229.273249:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368229.273283:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808644096 00000100:00100000:1.0:1787368229.273290:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808644096 00000100:00100000:1.0:1787368229.273326:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808644736 00000100:00100000:1.0:1787368229.273328:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808644736 00000100:00100000:1.0:1787368229.273349:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787368229.273373:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808644096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368229.273418:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808644096:12345-0@lo:400:kworker.0 Request processed in 62us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368229.273425:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787368229.273440:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787368229.273446:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808644736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368229.273621:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808644736:12345-0@lo:400:kworker.0 Request processed in 174us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368229.273628:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787368229.273651:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808644224 00000100:00100000:1.0:1787368229.273655:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808644224 00000100:00100000:1.0:1787368229.273683:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787368229.273689:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808644224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368229.273718:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808644224:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368229.273724:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787368229.273766:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5483cedc00 x1874190808644224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787368245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368229.273777:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808644224:0@lo:400:kworker.0 00010000:00080000:1.0:1787368229.273787:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5483ceca80 x1874190808644096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368229.273805:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808644096:0@lo:400:kworker.0 00010000:00080000:1.0:1787368229.273815:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c54836b8380 x1874190808644736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368229.273836:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808644736:0@lo:400:kworker.0 00000100:00100000:1.0:1787368229.273860:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808643840:0@lo:8:kworker.0 00000100:00100000:1.0:1787368229.273889:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368229.273916:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808643968:0@lo:8:kworker.0 00000100:00100000:1.0:1787368229.273939:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368229.273956:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808644352:0@lo:8:kworker.0 00000100:00100000:1.0:1787368229.273975:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368229.274001:0:24818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808643840 00000100:00100000:1.0:1787368229.274004:0:24818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808643840 00000100:00100000:1.0:1787368229.274020:0:24818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808643968 00000100:00100000:1.0:1787368229.274022:0:24818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808643968 00000100:00100000:1.0:1787368229.274029:0:24818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808644352 00000100:00100000:1.0:1787368229.274031:0:24818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808644352 00000100:00100000:1.0:1787368229.274040:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368229.274044:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3650:x1874190808643840:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787368229.274069:0:24818:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:1.0:1787368229.274094:0:24818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff0326f9 00002000:00100000:1.0:1787368229.274107:0:24818:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c548352a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787368229.274111:0:24818:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787368229.274113:0:24818:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787368229.274183:0:24818:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787368229.274216:0:24818:0:(import.c:65:import_set_state_nolock()) ffff9c548352d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368229.274252:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1874190808643840:12345-0@lo:8:kworker.0 Request processed in 207us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368229.274259:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368229.274271:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368229.274274:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3650:x1874190808643968:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787368229.274286:0:24818:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787368229.274309:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3650:x1874190808643968:12345-0@lo:8:kworker.0 Request processed in 33us (369us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368229.274314:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368229.274324:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787368229.274328:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3650:x1874190808644352:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787368229.274338:0:24818:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787368229.274383:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3650:x1874190808644352:12345-0@lo:8:kworker.0 Request processed in 53us (407us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787368229.274390:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787368229.274422:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5483cec380 x1874190808643840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787368254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368229.274429:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787368229.274434:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787368229.274441:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787368229.274444:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787368229.274447:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c5481b9f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787368229.275317:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808644480:0@lo:400:kworker.0 00000100:00100000:0.0:1787368229.275383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368229.275414:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787368229.275420:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808643712:0@lo:400:kworker.0 00000100:00100000:0.0:1787368229.275460:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368229.275486:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808644608:0@lo:400:kworker.0 00000100:00100000:0.0:1787368229.275509:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368229.275579:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808643712 00000100:00100000:0.0:1787368229.275584:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808643712 00000100:00100000:0.0:1787368229.275619:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787368229.275637:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3653:x1874190808643712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368229.275677:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3653:x1874190808643712:12345-0@lo:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368229.275684:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787368229.275719:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808643712:0@lo:400:kworker.0 00000004:00080000:1.0:1787368229.280055:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:3.0:1787368229.280069:0:22902:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787368229.280076:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808643840:0@lo:8:kworker.0 00000100:00080000:1.0:1787368229.280121:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368229.280142:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787368229.280146:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808643968:0@lo:8:kworker.0 00000100:00080000:1.0:1787368229.280163:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787368229.280166:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787368229.280170:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808644352:0@lo:8:kworker.0 00000004:00080000:3.0:1787368229.280177:0:22902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686567820343ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787368229.280184:0:22902:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787368229.280228:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808644480 00000100:00100000:1.0:1787368229.280236:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808644480 00000100:00100000:1.0:1787368229.280279:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808644608 00000100:00100000:1.0:1787368229.280282:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808644608 00000100:00100000:1.0:1787368229.280308:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787368229.280320:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808644480:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1787368229.280437:0:22903:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1787368229.280442:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808644480:12345-0@lo:400:kworker.0 Request processed in 121us (5055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368229.280463:0:22903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22903:1874190808644992:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787368229.280467:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787368229.280488:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787368229.280497:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808644608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368229.280510:0:22903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368229.280536:0:22903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787368229.280551:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808644864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787368229.280576:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368229.280610:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808644864 00000100:00100000:3.0:1787368229.280613:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808644864 00000100:00100000:3.0:1787368229.280652:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787368229.280660:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808644864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787368229.280676:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787368229.280714:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874190808644864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368229.280731:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787368229.280750:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787368229.280774:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55b5074a80 x1874190808644864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368229.280790:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808644864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787368229.280831:0:24818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808644992 00000100:00100000:3.0:1787368229.280835:0:24818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808644992 00000100:00100000:3.0:1787368229.280869:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368229.280875:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22903:x1874190808644992:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787368229.280892:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808644608:12345-0@lo:400:kworker.0 Request processed in 44us (5029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368229.280902:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787368229.280949:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5483cefb80 x1874190808644608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368229.280961:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808644608:0@lo:400:kworker.0 00010000:00080000:1.0:1787368229.280975:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5483cec000 x1874190808644480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368229.280984:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808644480:0@lo:400:kworker.0 00000004:00080000:1.0:1787368229.287558:0:22858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1787368229.287812:0:24818:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787368229.287835:0:24818:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1787368229.287841:0:24818:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:3.0:1787368229.310145:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368229.310160:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310178:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787368229.310183:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368229.310189:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310209:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310220:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310244:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310265:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.310278:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.310284:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310292:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241cc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.310297:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310306:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310324:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310332:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff032700 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.310352:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.312388:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.312396:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787368229.315144:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787368229.315157:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.315174:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1787368229.315179:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368229.315186:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.315201:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.315212:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.315220:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.315240:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368229.316141:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368229.316161:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.316174:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368229.316179:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.316189:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.316211:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.316219:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000588d6a6c/0x66f5679bff032707 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.316258:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.316260:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.316262:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787368229.317482:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368229.317505:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.317520:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787368229.317524:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368229.317530:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.317682:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.317693:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.317701:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.317725:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787368229.318349:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368229.318384:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.318402:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241cc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368229.318407:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.318418:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.318438:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.318445:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3f901a5/0x66f5679bff03270e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.318478:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368229.318480:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368229.318482:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.318919:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.318928:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.318939:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.318944:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.318949:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.318961:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.319101:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.319111:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.319132:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368229.319141:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368229.319146:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.319218:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613bc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368229.319222:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.319244:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.319257:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.319264:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff032715 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.319280:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368229.319282:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368229.319283:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.320147:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.320167:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.320178:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.320182:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.320187:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.320197:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.320207:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.320220:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.320243:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368229.321287:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.321297:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.321310:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.321315:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.321320:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.321331:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.321339:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.321345:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.321379:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787368229.321601:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368229.321611:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321621:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368229.321627:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321636:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321652:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321660:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff03271c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321678:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368229.321681:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321688:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368229.321698:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321706:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321716:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321723:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff032723 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.321735:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.321737:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.321738:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.321804:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.321811:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.321873:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368229.322263:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.322267:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.322272:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.322284:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.322292:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.322300:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.322323:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368229.323387:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.323641:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.323654:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.323658:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.323663:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.323675:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.323696:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.323703:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.323720:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787368229.324226:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787368229.324236:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324245:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368229.324249:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324260:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324277:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324285:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff03272a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324306:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368229.324316:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324322:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368229.324325:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324332:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324344:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324352:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032731 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.324393:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368229.324395:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368229.324397:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.324583:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.326527:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.326543:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.326567:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.326572:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.326578:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.326608:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.326619:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.326627:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.326653:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787368229.327649:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368229.327660:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.327673:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ba00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368229.327678:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.327704:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.327724:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.327732:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff032738 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.327754:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368229.327756:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368229.327758:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.330333:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.330347:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.330392:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.330397:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.330405:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.330420:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.330429:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.330452:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.330477:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.330501:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.330510:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.330522:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ac00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.330526:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.330559:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.330584:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.330592:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff03273f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.330610:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.330612:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.330613:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.331227:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.331234:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.331246:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.331250:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.331255:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.331265:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.331274:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.331282:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.331311:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368229.331675:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.331682:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.331697:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.331700:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.331704:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.331713:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.331721:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332100:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332124:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787368229.332135:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787368229.332140:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332148:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613be00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368229.332152:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332162:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332188:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332197:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff032746 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332219:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368229.332222:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332228:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613aa00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368229.332232:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332239:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332250:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332257:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff03274d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.332271:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368229.332273:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368229.332281:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.332524:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.333306:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.333317:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.333331:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.333336:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.333341:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.333353:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.333393:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.333401:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.333416:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.333425:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.333434:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.333443:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.333448:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.333469:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.333486:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.333501:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff032754 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.333519:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.333522:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.333523:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.334017:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.334023:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.334032:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.334035:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.334040:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.334061:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.334070:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.334077:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.334101:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.334446:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.334462:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.334470:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613bc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.334474:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.334483:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.334496:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.334504:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff03275b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.334522:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.334523:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.334525:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.335569:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.335580:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.335595:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.335598:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.335604:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.335616:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.335625:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.335645:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.335667:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.335724:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.335732:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.335741:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.335745:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.335755:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.335772:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.335780:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff032762 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.335797:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.335799:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.335800:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.336273:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.336281:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.336291:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.336295:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.336300:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.336310:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.336319:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.336328:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.336350:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.336444:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.336456:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.336465:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.336470:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.336491:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.336505:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.336513:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff032769 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.336528:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.336529:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.336531:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.338456:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.338470:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.338498:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.338503:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.338509:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.338524:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.338535:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.338543:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.338572:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.340242:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.340254:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.340269:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ae00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.340275:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.340286:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.340306:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.340330:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff032770 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.340351:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.340385:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.340388:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.340679:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.340688:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.340700:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.340705:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.340710:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.340721:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.340942:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.340950:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.341184:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.341283:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.341291:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.341300:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613aa00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.341305:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.341315:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.341328:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.341337:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000802747bc/0x66f5679bff032777 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.341380:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.341382:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.341384:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.344102:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.344117:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.344135:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.344139:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.344146:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.344161:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.344172:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.344180:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.344225:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.344443:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.344461:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.344472:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613be00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.344477:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.344486:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.344502:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.344509:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1b33c5/0x66f5679bff03277e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.344549:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.344551:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.344552:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.345314:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.345323:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.345335:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.345339:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.345344:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.345392:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.345402:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.345410:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.345429:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.345558:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.345565:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.345574:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.345578:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.345601:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.345616:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.345624:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c55e5e68/0x66f5679bff032785 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.345648:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.345650:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.345652:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.347809:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.347833:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.347849:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.347860:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.347867:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.347881:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.347909:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.347917:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.347937:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.347989:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.347998:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.348009:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.348014:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.348025:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.348042:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.348062:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002da6dc6c/0x66f5679bff03278c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.348091:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.348093:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.348095:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.351335:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.351349:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.355163:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.355169:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.355177:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.355195:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.355206:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.355232:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.355270:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.355464:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.355473:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.355484:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.355489:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.355500:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.355519:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.355527:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb0f3b1/0x66f5679bff032793 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.355585:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.355587:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.355589:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.356066:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.356073:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.356083:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.356087:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.356091:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.356114:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.356123:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.356133:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.356462:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368229.356914:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.356920:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.356938:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.356941:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.356946:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.356956:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.357026:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.357036:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.357065:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787368229.357415:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368229.357424:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357434:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368229.357438:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357457:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357476:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357495:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9a74e4f/0x66f5679bff03279a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357524:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368229.357528:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357535:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ac00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368229.357552:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357561:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357572:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357580:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad814f84/0x66f5679bff0327a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.357601:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.357603:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.357605:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.357688:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.360118:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.360132:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.361393:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.361404:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.361412:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.361431:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.361454:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.361463:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.361482:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787368229.362160:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368229.362169:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.362179:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ba00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368229.362183:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.362195:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.362215:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.362237:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea8fe9d/0x66f5679bff0327a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368229.362266:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368229.362268:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368229.362270:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.362657:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.362665:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.362676:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.362679:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.362684:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.362695:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.362703:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.362710:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.365116:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.366666:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.366679:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.366694:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.366698:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.366709:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.366731:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.366738:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcef6ba2/0x66f5679bff0327af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.366758:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.366760:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.366762:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.367485:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.367493:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.367506:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.367511:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.367518:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.367531:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.367540:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.367548:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.367568:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368229.368125:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.368132:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.368142:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.368228:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.368233:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.368244:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.368252:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.368261:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.368278:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787368229.369397:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.369410:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.369423:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.369426:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.369431:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.369443:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.369452:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.369473:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.369484:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787368229.369566:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787368229.369578:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369596:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368229.369602:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369614:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369633:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369642:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a159c682/0x66f5679bff0327b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369666:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368229.369670:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369676:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ae00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368229.369680:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369688:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369697:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369710:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001afa1a60/0x66f5679bff0327bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369726:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.369728:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.369730:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369737:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368229.369740:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369751:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369761:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369769:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004179255d/0x66f5679bff0327c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.369781:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.369782:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.369784:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.370268:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.370275:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.370286:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.370289:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.370293:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.370303:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.370310:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.370317:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.370337:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368229.370562:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368229.370569:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.370576:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368229.370580:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.370596:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.370609:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.370616:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca997f2/0x66f5679bff0327cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368229.370634:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.370636:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368229.370637:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368229.371122:0:24818:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368229.371129:0:24818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.371146:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787368229.371162:0:24818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368229.371168:0:24818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.371179:0:24818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.371187:0:24818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.371193:0:24818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368229.371223:0:24818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787368229.371265:0:24818:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:2.0:1787368229.371306:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368229.371314:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.371328:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613bc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368229.371332:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.371341:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.371376:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.371385:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000055b6b7a/0x66f5679bff0327d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368229.371403:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.371405:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368229.371407:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368229.371434:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22903:x1874190808644992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90554us (90920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368229.371444:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368229.373261:0:22903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22903:1874190808644992:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787368229.373281:0:22903:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1787368229.373333:0:22903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22903:1874190808645120:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787368229.373406:0:22903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368229.373492:0:22903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c559803bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787368229.373533:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808645120 00000100:00100000:1.0:1787368229.373539:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808645120 00000100:00100000:1.0:1787368229.373595:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787368229.373606:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22903:x1874190808645120:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787368229.373645:0:24385:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1787368229.399246:0:24380:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1787368229.399347:0:24380:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787368229.399764:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22903:x1874190808645120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26154us (26353us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787368229.399776:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368229.400056:0:22903:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787368229.400065:0:22903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22903:1874190808645120:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787368229.400080:0:22903:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000040:00080000:3.0:1787368229.597346:0:23637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787368229.790549:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368230.816008:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787368230.872046:0:25199:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787368230.872050:0:25199:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787368230.872052:0:25199:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787368230.872199:0:25199:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c5481b38000 00000020:01000004:2.0:1787368230.872214:0:25199:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787368230.872229:0:25199:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787368230.872241:0:25199:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c559f83b370) 00000020:00000080:2.0:1787368230.872258:0:25199:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787368230.946238:0:25199:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787368230.952803:0:25199:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787368230.954764:0:25199:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787368230.955182:0:25199:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787368230.955822:0:25199:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787368230.957223:0:25199:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787368230.957782:0:25199:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1787368230.976517:0:25199:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787368230.976936:0:25199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787368230.976978:0:25199:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787368230.976992:0:25199:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x66f5679bff0327e0 00000020:01000004:1.0:1787368230.976998:0:25199:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787368230.977145:0:25199:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787368230.977207:0:25199:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787368230.977214:0:25199:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787368230.977246:0:25199:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787368230.977250:0:25199:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787368231.011104:0:25199:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787368231.011861:0:25199:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787368231.011867:0:25199:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787368231.011869:0:25199:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787368231.011870:0:25199:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368231.011872:0:25199:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368231.011873:0:25199:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368231.011875:0:25199:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368231.011876:0:25199:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368231.011879:0:25199:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368231.011880:0:25199:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787368231.011884:0:25199:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787368231.011886:0:25199:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787368231.011888:0:25199:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787368231.011889:0:25199:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368231.011890:0:25199:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368231.011891:0:25199:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368231.011892:0:25199:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368231.011893:0:25199:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368231.011894:0:25199:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368231.011895:0:25199:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787368231.011925:0:25199:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787368231.011945:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645248:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787368231.012551:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.012596:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.013172:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808645248 00000100:00100000:3.0:1787368231.013181:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808645248 00000100:00100000:3.0:1787368231.013237:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787368231.013246:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:25199:x1874190808645248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787368231.013509:0:22873:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787368231.013514:0:22873:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787368231.013517:0:22873:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787368231.014721:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:25199:x1874190808645248:12345-0@lo:253:mount.lustre.0 Request processed in 1471us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.014733:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787368231.014937:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645248:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787368231.014951:0:25199:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787368231.014984:0:25199:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787368231.014985:0:25199:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787368231.014987:0:25199:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787368231.014988:0:25199:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787368231.014989:0:25199:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787368231.014990:0:25199:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787368231.014992:0:25199:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787368231.014994:0:25199:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787368231.014995:0:25199:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787368231.015023:0:25199:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c5481b38000 from lustre-OST0001 10000000:01000000:1.0:1787368231.015051:0:25199:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787368231.015054:0:25199:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787368231.015063:0:25199:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c55912fb370 local copy 00010000:00010000:1.0:1787368231.015074:0:25199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368231.015183:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368231.015218:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.015253:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.015523:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808645376 00000100:00100000:3.0:1787368231.015529:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808645376 00000100:00100000:3.0:1787368231.015573:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787368231.015582:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:25199:x1874190808645376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368231.015652:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:25199:x1874190808645376:12345-0@lo:501:mount.lustre.0 Request processed in 72us (434us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787368231.015659:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787368231.015753:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645376:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787368231.015765:0:25199:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787368231.015784:0:25199:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787368231.015791:0:25199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368231.015800:0:25199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c558241c200/0x66f5679bff03241a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032421 expref: -99 pid: 22857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368231.015839:0:25199:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c5481b38000 10000000:01000000:1.0:1787368231.015844:0:25199:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787368231.015849:0:25199:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787368231.015859:0:25199:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787368231.015863:0:25199:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787368231.015866:0:25199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787368231.015887:0:25199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613ae00/0x66f5679bff0327e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368231.015896:0:25199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613ae00/0x66f5679bff0327e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368231.015905:0:25199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613ae00/0x66f5679bff0327e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368231.015917:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368231.015944:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.015962:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.016130:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808645504 00000100:00100000:3.0:1787368231.016136:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808645504 00000100:00100000:3.0:1787368231.016176:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787368231.016184:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:25199:x1874190808645504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368231.016192:0:22873:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368231.016204:0:22873:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241d400/0x66f5679bff0327ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff0327e7 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368231.016225:0:22873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241d400/0x66f5679bff0327ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff0327e7 expref: 22 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368231.016249:0:22873:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241d400/0x66f5679bff0327ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0327e7 expref: 22 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368231.016257:0:22873:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241d400, rc 0) 00000100:00100000:3.0:1787368231.016303:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808645504:12345-0@lo:101:mount.lustre.0 Request processed in 121us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.016310:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787368231.016342:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368231.016376:0:25199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613ae00/0x66f5679bff0327e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0327ee expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368231.016384:0:25199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613ae00/0x66f5679bff0327e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff0327ee expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787368231.019953:0:25199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1787368231.021755:0:25199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368231.030139:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787368231.030440:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1787368231.030456:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1787368231.030470:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1787368231.030481:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1787368231.030492:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1787368231.030502:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1787368231.030515:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1787368231.030528:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1787368231.030552:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1787368231.030558:0:25199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1787368231.030660:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368231.030725:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.030846:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b543e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.035613:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808645632 00000100:00100000:3.0:1787368231.035628:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808645632 00000100:00100000:3.0:1787368231.035688:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787368231.035698:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808645632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368231.035905:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808645632:12345-0@lo:501:mount.lustre.0 Request processed in 207us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.035912:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787368231.036041:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368231.036091:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368231.036144:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.036189:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.037307:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808645760 00000100:00100000:3.0:1787368231.037315:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808645760 00000100:00100000:3.0:1787368231.037395:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787368231.037404:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808645760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368231.041241:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808645760:12345-0@lo:503:mount.lustre.0 Request processed in 3828us (5086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.041269:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787368231.041425:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645760:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787368231.042116:0:25199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787368231.042214:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368231.042271:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.042316:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.042558:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808645888 00000100:00100000:3.0:1787368231.042565:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808645888 00000100:00100000:3.0:1787368231.042620:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787368231.042632:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808645888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368231.046499:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808645888:12345-0@lo:502:mount.lustre.0 Request processed in 3862us (4219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368231.046514:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787368231.046775:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808645888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368231.047114:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787368231.047146:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787368231.047173:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787368231.047189:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787368231.047202:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787368231.047215:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787368231.047230:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787368231.047243:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787368231.047259:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1787368231.047293:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368231.047350:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.047420:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.047556:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808646016 00000100:00100000:3.0:1787368231.047562:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808646016 00000100:00100000:3.0:1787368231.047612:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787368231.047621:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808646016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368231.048140:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808646016:12345-0@lo:502:mount.lustre.0 Request processed in 517us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.048148:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787368231.048248:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368231.048302:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1787368231.048313:0:25199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1787368231.049582:0:25203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787368231.049592:0:25203:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787368231.049597:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787368231.049600:0:25203:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787368231.049604:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787368231.049632:0:25203:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c54832519b8) 00000020:00000080:2.0:1787368231.049786:0:25203:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787368231.049794:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787368231.049886:0:25203:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5481b38000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787368231.049896:0:25203:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787368231.049904:0:25203:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x66f5679bff0327fc 00010000:00010000:2.0:1787368231.066170:0:25203:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787368231.068141:0:25203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934601 00080000:10000000:2.0:1787368231.071615:0:25203:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787368231.073632:0:25203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787368231.073783:0:25203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368231.073790:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.073792:0:25203:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787368231.073796:0:25203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368231.073820:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.073821:0:25203:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787368231.073825:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787368231.073827:0:25203:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787368231.073829:0:25203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368231.073831:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.073833:0:25203:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787368231.073835:0:25203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368231.073837:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.073838:0:25203:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787368231.073841:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787368231.073874:0:25203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368231.073877:0:25203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.073878:0:25203:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787368231.073881:0:25203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1787368231.076224:0:25199:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787368231.076269:0:25199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787368231.076297:0:25199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613ae00/0x66f5679bff0327e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0327ee expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368231.076313:0:25199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613ae00/0x66f5679bff0327e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff0327ee expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368231.076322:0:25199:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5481b38000 from 1 10000000:01000000:1.0:1787368231.076324:0:25199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787368231.076380:0:25199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368231.076388:0:25199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368231.076397:0:25199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368231.076427:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787368231.076492:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.076527:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55812ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1787368231.077595:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808646144 00000100:00100000:2.0:1787368231.077603:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808646144 00000100:00100000:2.0:1787368231.077663:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787368231.077672:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808646144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787368231.077686:0:22873:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368231.077815:0:22873:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032803 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.077841:0:22873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032803 expref: 23 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.077853:0:22873:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032803 expref: 23 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.077862:0:22873:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75600, rc 0) 00000100:00100000:2.0:1787368231.077922:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646144:12345-0@lo:101:mount.lustre.0 Request processed in 251us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368231.077929:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787368231.078572:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787368231.078592:0:25199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.078615:0:25199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787368231.080846:0:25199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1787368231.082252:0:25199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368231.082465:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787368231.082490:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1787368231.082504:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1787368231.082516:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1787368231.082527:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1787368231.082537:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1787368231.082547:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1787368231.082558:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1787368231.082571:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1787368231.082604:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1787368231.082617:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1787368231.082632:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1787368231.083853:0:25199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1787368231.084185:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787368231.084256:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.084341:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b543e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.087411:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808646272 00000100:00100000:3.0:1787368231.087425:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808646272 00000100:00100000:3.0:1787368231.087484:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787368231.087495:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787368231.087671:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646272:12345-0@lo:501:mount.lustre.0 Request processed in 178us (3415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.087679:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787368231.087862:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787368231.087912:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368231.087969:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368231.087994:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808646400 00000100:00100000:2.0:1787368231.087998:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808646400 00000100:00100000:2.0:1787368231.088625:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787368231.088698:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787368231.088872:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646400:12345-0@lo:503:mount.lustre.0 Request processed in 238us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368231.088880:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787368231.089111:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368231.089173:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787368231.089947:0:25199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787368231.090084:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368231.090182:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368231.090256:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb594a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787368231.090292:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808646528 00000100:00100000:1.0:1787368231.090298:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808646528 00000100:00100000:1.0:1787368231.090487:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787368231.090497:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368231.090634:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646528:12345-0@lo:502:mount.lustre.0 Request processed in 136us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368231.090649:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787368231.090848:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787368231.091070:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787368231.091097:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787368231.091111:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787368231.091188:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787368231.091204:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787368231.091218:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787368231.091232:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787368231.091246:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1787368231.091260:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787368231.091290:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1787368231.091306:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1787368231.091331:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368231.091627:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368231.091824:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bb594a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787368231.091865:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808646656 00000100:00100000:2.0:1787368231.091871:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808646656 00000100:00100000:2.0:1787368231.091945:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787368231.092023:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787368231.092136:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646656:12345-0@lo:502:mount.lustre.0 Request processed in 183us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368231.092143:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787368231.092215:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787368231.092271:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1787368231.092281:0:25199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787368231.093018:0:25207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368231.093028:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.093031:0:25207:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787368231.093038:0:25207:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c5481b38000 00000020:00000080:0.0:1787368231.093041:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787368231.093048:0:25207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368231.093050:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.093052:0:25207:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787368231.093054:0:25207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368231.093056:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.093058:0:25207:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787368231.093061:0:25207:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c5481b38000 00000020:00000080:0.0:1787368231.093063:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787368231.093126:0:25207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368231.093130:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.093131:0:25207:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787368231.093134:0:25207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368231.093136:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.093137:0:25207:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787368231.093141:0:25207:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c5481b38000 00000020:00000080:0.0:1787368231.093143:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787368231.093172:0:25207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368231.093175:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.093176:0:25207:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787368231.093178:0:25207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787368231.093181:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.093182:0:25207:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787368231.093185:0:25207:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c5481b38000 00000020:00000080:0.0:1787368231.093187:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787368231.093207:0:25207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787368231.093210:0:25207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787368231.093211:0:25207:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787368231.093214:0:25207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787368231.093301:0:25199:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787368231.093326:0:25199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787368231.093342:0:25199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.093381:0:25199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368231.093440:0:25199:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787368231.093443:0:25199:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c5481b38000 10000000:01000000:0.0:1787368231.093446:0:25199:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c5481b38000 10000000:01000000:0.0:1787368231.093449:0:25199:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787368231.093454:0:25199:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c5481b38000 from 1 10000000:01000000:0.0:1787368231.093456:0:25199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787368231.093486:0:25199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff032811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.093493:0:25199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff032811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.093513:0:25199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff032811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368231.093531:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787368231.093580:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.105405:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5588a64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.115735:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808646784 00000100:00100000:3.0:1787368231.115749:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808646784 00000100:00100000:3.0:1787368231.115823:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787368231.115834:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:25199:x1874190808646784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368231.115851:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368231.115876:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c558241ca00/0x66f5679bff032818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032811 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368231.115907:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c558241ca00/0x66f5679bff032818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032811 expref: 24 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368231.115920:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c558241ca00/0x66f5679bff032818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032811 expref: 24 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368231.115930:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241ca00, rc 0) 00000100:00100000:3.0:1787368231.116014:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808646784:12345-0@lo:101:mount.lustre.0 Request processed in 182us (22433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.116253:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787368231.117222:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787368231.117756:0:25199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff032811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032818 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368231.117773:0:25199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff032811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032818 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787368231.122026:0:25199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787368231.129536:0:25199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787368231.129900:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787368231.129926:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787368231.131845:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787368231.131895:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787368231.131907:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787368231.131918:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787368231.131929:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787368231.131940:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787368231.131951:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787368231.132071:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787368231.132083:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787368231.132094:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787368231.132104:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787368231.132115:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787368231.132128:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787368231.132140:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787368231.132152:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787368231.132176:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787368231.132199:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787368231.132212:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787368231.132222:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787368231.132235:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787368231.132250:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787368231.133312:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787368231.133344:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787368231.133380:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787368231.133397:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787368231.133410:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787368231.133424:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787368231.133438:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787368231.133451:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787368231.133467:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787368231.133481:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787368231.133497:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787368231.133526:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787368231.133541:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787368231.133553:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787368231.133567:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787368231.133581:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787368231.133594:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787368231.133608:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787368231.133620:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787368231.133632:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787368231.133644:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787368231.133657:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787368231.133670:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787368231.133684:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787368231.133696:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787368231.133874:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787368231.133894:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787368231.133922:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787368231.133928:0:25199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787368231.134159:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368231.134225:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.134268:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808646912 00000100:00100000:1.0:1787368231.134274:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808646912 00000100:00100000:1.0:1787368231.134320:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787368231.134330:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808646912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368231.134462:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808646912:12345-0@lo:501:mount.lustre.0 Request processed in 133us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368231.134470:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787368231.134508:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff300 going to sleep for 11 seconds 00000100:00100000:1.0:1787368231.134529:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808646912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787368231.134558:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808647040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787368231.134595:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.134611:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.134675:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808647040 00000100:00100000:3.0:1787368231.134681:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808647040 00000100:00100000:3.0:1787368231.134721:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787368231.134902:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808647040:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787368231.135204:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808647040:12345-0@lo:503:mount.lustre.0 Request processed in 475us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.135212:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787368231.136410:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808647040:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787368231.136866:0:25199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787368231.136963:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808647168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368231.137037:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.137084:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.137089:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808647168 00000100:00100000:3.0:1787368231.137101:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808647168 00000100:00100000:3.0:1787368231.137149:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787368231.137158:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808647168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368231.137256:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808647168:12345-0@lo:502:mount.lustre.0 Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.137263:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787368231.137552:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808647168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787368231.137833:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787368231.137858:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787368231.137872:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787368231.137895:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787368231.137909:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787368231.137923:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787368231.137936:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787368231.137950:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787368231.138373:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787368231.138391:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787368231.138405:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787368231.138418:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787368231.138430:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787368231.138443:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787368231.138455:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787368231.138467:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787368231.138479:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787368231.138492:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787368231.138503:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787368231.138515:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787368231.138528:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787368231.138542:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787368231.138554:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787368231.138567:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787368231.138590:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787368231.138605:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787368231.138618:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787368231.138632:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787368231.140228:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787368231.140249:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787368231.141351:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787368231.141412:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787368231.141428:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787368231.141439:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787368231.141451:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787368231.141465:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787368231.141493:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787368231.141508:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787368231.141521:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787368231.141533:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787368231.141561:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787368231.141578:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787368231.141610:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787368231.141626:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787368231.142835:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787368231.142870:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787368231.142887:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787368231.142903:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787368231.143820:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808647296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368231.144804:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.144866:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ff300 going to sleep for 11 seconds 00000100:00100000:3.0:1787368231.145051:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808647296 00000100:00100000:3.0:1787368231.145060:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808647296 00000100:00100000:3.0:1787368231.145114:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787368231.145124:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808647296:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368231.145278:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808647296:12345-0@lo:502:mount.lustre.0 Request processed in 155us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368231.145286:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787368231.145380:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808647296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787368231.145999:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787368231.146028:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787368231.146064:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808647424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787368231.146112:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368231.146149:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55835d6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787368231.146933:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808647424 00000100:00100000:1.0:1787368231.146943:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808647424 00000100:00100000:1.0:1787368231.147069:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787368231.147081:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808647424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787368231.147210:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808647424:12345-0@lo:502:mount.lustre.0 Request processed in 132us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368231.147218:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787368231.148154:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808647424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787368231.148235:0:25199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787368231.148247:0:25199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787368231.152591:0:25212:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787368231.152609:0:25212:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c55bc5e0000) 00000020:00000080:0.0:1787368231.152635:0:25212:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787368231.152731:0:25212:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5481b38000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787368231.152736:0:25212:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c5481b38000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787368231.152740:0:25212:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5481b38000 3 00010000:00080000:0.0:1787368231.152772:0:25212:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c55acbc3000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1787368231.154441:0:25212:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787368231.154649:0:25212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787368231.154691:0:25212:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787368231.154716:0:25212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x66f5679bff032826 00000100:00080000:0.0:1787368231.154726:0:25212:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368231.154732:0:25212:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c55acbc3000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368231.154763:0:25212:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf5f80 x1874190808647552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368231.154789:0:25212:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787368231.154854:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368231.154858:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787368231.154860:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368231.154865:0:15931:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 686 00000100:00080000:0.0:1787368231.154875:0:15931:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787368231.154879:0:15931:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c54845c9000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368231.154892:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf7480 x1874190808647936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787368231.154928:0:15931:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787368231.154932:0:15931:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787368231.154934:0:15931:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787368231.154938:0:15931:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:0.0:1787368231.154941:0:15931:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787368231.154945:0:15931:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c55bc50b800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368231.154955:0:15931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55acbf4000 x1874190808648448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368231.155001:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808647680:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.155101:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808648320:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155124:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.155147:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787368231.155152:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808647808:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.155195:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808648576:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368231.155245:0:24818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808648320 00000100:00100000:1.0:1787368231.155253:0:24818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808648320 00000100:00100000:0.0:1787368231.155254:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808648064:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155278:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.155296:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808648704:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155327:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.155345:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787368231.155351:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808648192:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155400:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.155413:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808648832:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.155457:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808647680 00000100:00100000:0.0:1787368231.155460:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808647680 00000100:00100000:0.0:1787368231.155492:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808648192 00000100:00100000:0.0:1787368231.155495:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808648192 00000100:00100000:0.0:1787368231.155511:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787368231.155519:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808647680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155568:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808647680:12345-0@lo:400:kworker.0 Request processed in 50us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368231.155575:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787368231.155592:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787368231.155599:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808648192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.155632:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808648192:12345-0@lo:400:kworker.0 Request processed in 34us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368231.155639:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787368231.155661:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808647808 00000100:00100000:0.0:1787368231.155665:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808647808 00000100:00100000:2.0:1787368231.155736:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808647552:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787368231.155771:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368231.155799:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808647936:0@lo:8:kworker.0 00000100:00100000:2.0:1787368231.155834:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368231.155857:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808648448:0@lo:8:kworker.0 00000100:00100000:2.0:1787368231.155880:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368231.155909:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808647936 00000100:00100000:2.0:1787368231.155912:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808647936 00000100:00100000:2.0:1787368231.155926:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808648448 00000100:00100000:2.0:1787368231.155928:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808648448 00000100:00100000:2.0:1787368231.155938:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368231.155944:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808647936:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787368231.155987:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808647936:12345-0@lo:8:kworker.0 Request processed in 42us (153us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787368231.155995:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368231.156009:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787368231.156083:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787368231.156095:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787368231.156312:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808648448:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787368231.156345:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874190808648448:12345-0@lo:8:kworker.0 Request processed in 35us (464us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787368231.156350:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368231.156394:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787368231.156400:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787368231.156404:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787368231.156408:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808647936:0@lo:8:kworker.0 00000100:00100000:2.0:1787368231.156415:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787368231.156417:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787368231.156420:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787368231.156422:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808648448:0@lo:8:kworker.0 00000100:00100000:0.0:1787368231.165511:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368231.165527:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808647808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.165614:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808647808:12345-0@lo:400:kworker.0 Request processed in 91us (10435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368231.165622:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787368231.165675:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808648576 00000100:00100000:0.0:1787368231.165683:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808648576 00000100:00100000:0.0:1787368231.165718:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808648064 00000100:00100000:0.0:1787368231.165722:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808648064 00000100:00100000:0.0:1787368231.165734:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808648704 00000100:00100000:0.0:1787368231.165738:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808648704 00000100:00100000:0.0:1787368231.165752:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808648832 00000100:00100000:0.0:1787368231.165755:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808648832 00000100:00100000:0.0:1787368231.165766:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808647552 00000100:00100000:0.0:1787368231.165768:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808647552 00000100:00100000:0.0:1787368231.165779:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787368231.165785:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808648576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.165829:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808648576:12345-0@lo:400:kworker.0 Request processed in 44us (10610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368231.165835:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787368231.165847:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787368231.165854:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808648064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.165880:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808648064:12345-0@lo:400:kworker.0 Request processed in 28us (10601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368231.165886:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787368231.165900:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787368231.165905:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808648704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.165932:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808648704:12345-0@lo:400:kworker.0 Request processed in 27us (10605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368231.165937:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787368231.165949:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787368231.166730:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808648832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.166775:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808648832:12345-0@lo:400:kworker.0 Request processed in 821us (11343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368231.166787:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787368231.166805:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787368231.166820:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808647552:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787368231.166843:0:22878:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:0.0:1787368231.166902:0:22878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x66f5679bff03282d 00000004:00100000:0.0:1787368231.166916:0:22878:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787368231.166948:0:22878:0:(import.c:65:import_set_state_nolock()) ffff9c54822e0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368231.167103:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874190808647552:12345-0@lo:38:llog_process_th.0 Request processed in 282us (11331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368231.167110:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787368231.167253:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787368231.167257:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787368231.167289:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55acbf5f80 x1874190808647552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368231.167300:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368231.167306:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787368231.167314:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787368231.167318:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787368231.167320:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55acbc3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787368231.167325:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874190808647552:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368231.167377:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808648192:0@lo:400:kworker.0 00010000:00080000:0.0:1787368231.167389:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482622300 x1874190808648832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368231.167397:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808648832:0@lo:400:kworker.0 00010000:00080000:0.0:1787368231.167406:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c55acbf6d80 x1874190808648064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368231.167420:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808648064:0@lo:400:kworker.0 00010000:00080000:0.0:1787368231.167431:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482622680 x1874190808648704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368231.167437:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808648704:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.167468:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808647808:0@lo:400:kworker.0 00010000:00080000:0.0:1787368231.167480:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482620700 x1874190808648576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368231.167488:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808648576:0@lo:400:kworker.0 00000100:00100000:0.0:1787368231.167499:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808647680:0@lo:400:kworker.0 00000020:01000004:0.0:1787368231.168160:0:25212:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787368231.168174:0:25212:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c55bc5e19b8) 00000020:00000080:0.0:1787368231.168196:0:25212:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787368231.168473:0:25212:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c5481b38000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787368231.168478:0:25212:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c5481b38000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787368231.168481:0:25212:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c5481b38000 3 00010000:00080000:0.0:1787368231.168675:0:25212:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c54822e1800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.104@tcp at head 00000100:00100000:1.0:1787368231.172301:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808648320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368231.172431:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808648320:12345-0@lo:400:kworker.0 Request processed in 16328us (17305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368231.172442:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787368231.172832:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808648320:0@lo:400:kworker.0 00010000:00010000:0.0:1787368231.174850:0:25212:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787368231.175841:0:25212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787368231.175908:0:25212:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787368231.175921:0:25212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x66f5679bff03283b 00000100:00080000:0.0:1787368231.175933:0:25212:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787368231.175939:0:25212:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c54822e1800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1787368231.175994:0:25212:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c5482620700 x1874190808648960/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787368231.176032:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808648960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787368231.176102:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.176167:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808648960 00000100:00100000:0.0:1787368231.176174:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808648960 00000100:00100000:0.0:1787368231.176208:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787368231.176215:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874190808648960:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787368231.176239:0:22878:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:0.0:1787368231.176286:0:22878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x66f5679bff032842 00000004:00100000:0.0:1787368231.176300:0:22878:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787368231.176333:0:22878:0:(import.c:65:import_set_state_nolock()) ffff9c54822e6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368231.176399:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874190808648960:12345-0@lo:38:llog_process_th.0 Request processed in 183us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368231.176406:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787368231.176445:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c5482620700 x1874190808648960/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787368241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787368231.176451:0:25212:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787368231.176457:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787368231.176465:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787368231.176472:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787368231.176478:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787368231.176480:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54822e1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787368231.176486:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874190808648960:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787368231.176652:0:25212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1787368231.178145:0:25199:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787368231.178197:0:25199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787368231.178214:0:25199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff032811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032818 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368231.178227:0:25199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68a800/0x66f5679bff032811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032818 expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787368231.178279:0:25199:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787368231.178281:0:25199:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787368231.178283:0:25199:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368231.178284:0:25199:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368231.178285:0:25199:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368231.178287:0:25199:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368231.178288:0:25199:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787368231.178290:0:25199:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368231.178292:0:25199:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787368231.178296:0:25199:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787368231.178298:0:25199:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787368231.178300:0:25199:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787368231.178301:0:25199:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787368231.178302:0:25199:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787368231.178303:0:25199:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787368231.178304:0:25199:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787368231.178315:0:25199:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787368231.178317:0:25199:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787368231.178318:0:25199:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787368231.178343:0:25199:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787368231.178397:0:25199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808649088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787368231.178463:0:25199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368231.178507:0:25199:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55835d6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787368231.179944:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808649088 00000100:00100000:1.0:1787368231.179955:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808649088 00000100:00100000:1.0:1787368231.180007:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787368231.180017:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:25199:x1874190808649088:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787368231.180048:0:22871:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787368231.180062:0:22871:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787368231.190963:0:22871:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787368231.190986:0:22871:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787368231.191158:0:22894:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787368231.191173:0:22894:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787368231.191194:0:22894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.191214:0:22894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0326d6 expref: 24 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.191223:0:22894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff0326e4 expref: 24 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.191232:0:22894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.191286:0:22894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0326e4 expref: 24 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.191302:0:22894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0326e4 expref: 24 pid: 22873 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368231.191316:0:22894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808649216:0@lo:104: 00000100:00100000:0.0:1787368231.191504:0:22894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787368231.191600:0:22894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff0326d6 expref: 24 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.191610:0:22894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff0326d6 expref: 24 pid: 22872 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368231.191619:0:22894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808649344:0@lo:104: 00000100:00100000:0.0:1787368231.191653:0:22894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368231.197282:0:22894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd652000 going to sleep for 11 seconds 00000100:00100000:2.0:1787368231.198129:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808649216 00000100:00100000:2.0:1787368231.198140:0:22862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808649216 00000100:00100000:2.0:1787368231.198180:0:22862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808649344 00000100:00100000:2.0:1787368231.198194:0:22862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808649344 00000100:00100000:2.0:1787368231.198216:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787368231.198225:0:22862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+4:22894:x1874190808649216:12345-0@lo:104: 00010000:00010000:2.0:1787368231.198241:0:22862:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.198472:0:22862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787368231.198479:0:22862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+4:22894:x1874190808649216:12345-0@lo:104: Request processed in 255us (6976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368231.198487:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787368231.198508:0:22862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787368231.198510:0:22894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482620700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808649216:0@lo:104: 00000100:00100000:2.0:1787368231.198517:0:22862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808649344:12345-0@lo:104: 00010000:00010000:2.0:1787368231.198527:0:22862:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.198573:0:22862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787368231.198579:0:22862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:22894:x1874190808649344:12345-0@lo:104: Request processed in 65us (6926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368231.198585:0:22862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787368231.198628:0:22894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482621f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22894:1874190808649344:0@lo:104: 00010000:00010000:1.0:1787368231.198651:0:22894:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.198787:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787368231.198800:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.198819:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241da00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368231.198823:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.198832:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368231.198839:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368231.198844:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787368231.198874:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.198975:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787368231.199027:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808649472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368231.199066:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368231.199139:0:22864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808649472 00000100:00100000:2.0:1787368231.199143:0:22864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808649472 00010000:00010000:2.0:1787368231.199161:0:22864:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0326e4 expref: 25 pid: 22873 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368231.199182:0:22864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787368231.199189:0:22864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+25:3653:x1874190808649472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368231.199199:0:22864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368231.199205:0:22864:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0326e4 expref: 25 pid: 22873 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.199222:0:22864:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0326e4 expref: 25 pid: 22873 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.199236:0:22864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241c800/0x66f5679bff0326eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0326e4 expref: 25 pid: 22873 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.199249:0:22864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787368231.199369:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.199378:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241da00/0x66f5679bff0326e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0326eb expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.199388:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368231.199392:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.199397:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:0.0:1787368231.199400:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.199418:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787368231.199425:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368231.199430:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787368231.199450:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.199456:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787368231.199563:0:22864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3653:x1874190808649472:12345-0@lo:103:ldlm_bl.0 Request processed in 373us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368231.199570:0:22864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368231.199631:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808649472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368231.199778:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787368231.199786:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808649600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368231.199822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368231.199954:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808649600 00000100:00100000:2.0:1787368231.199959:0:22863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808649600 00010000:00010000:2.0:1787368231.199974:0:22863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0326d6 expref: 24 pid: 22872 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368231.200003:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787368231.200010:0:22863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3653:x1874190808649600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368231.200019:0:22863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368231.200023:0:22863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff0326d6 expref: 24 pid: 22872 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200033:0:22863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff0326d6 expref: 24 pid: 22872 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200044:0:22863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68ae00/0x66f5679bff0326dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff0326d6 expref: 24 pid: 22872 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200056:0:22863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200074:0:22863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787368231.200088:0:22863:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008915623s 00010000:00010000:2.0:1787368231.200092:0:22863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200098:0:22863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200104:0:22863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200111:0:22863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200117:0:22863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368231.200121:0:22863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200128:0:22863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200142:0:22863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200151:0:22863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368231.200177:0:22863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:3653:x1874190808649600:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368231.200184:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787368231.200214:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808649600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368231.200232:0:22894:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200239:0:22894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368231.200245:0:22894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bc68a400/0x66f5679bff032849 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.200400:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.200407:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c558241d000/0x66f5679bff0326d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff0326dd expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368231.200420:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368231.200422:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368231.200423:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368231.200546:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368231.200786:0:25199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:25199:1874190808649088:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787368231.200797:0:25199:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787368231.200800:0:25199:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787368231.200801:0:25199:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787368231.200803:0:25199:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787368231.200804:0:25199:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787368231.200805:0:25199:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787368231.200817:0:25199:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787368231.200818:0:25199:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787368231.200820:0:25199:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787368231.200821:0:25199:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787368231.200841:0:25199:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787368231.200964:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:25199:x1874190808649088:12345-0@lo:253:mount.lustre.0 Request processed in 20948us (22500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368231.200972:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000001:00000004:1.0:1787368231.204251:0:25199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1787368231.214298:0:25199:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787368231.214308:0:25199:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787368231.214350:0:25199:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787368231.214424:0:25199:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787368231.214442:0:25199:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787368231.214464:0:25199:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787368231.220195:0:25199:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787368231.220532:0:25199:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787368231.832569:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787368232.058156:0:25266:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787368232.058967:0:25266:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787368232.728970:0:22875:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787368232.728977:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c5483678000 from 14 10000000:01000000:2.0:1787368232.728983:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787368232.729028:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff032850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368232.729039:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff032850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368232.729048:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff032850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368232.729081:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808649728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787368232.729150:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368232.729195:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5588a649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368232.729304:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808649728 00000100:00100000:1.0:1787368232.729312:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808649728 00000100:00100000:1.0:1787368232.729378:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787368232.729388:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:22875:x1874190808649728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368232.729400:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368232.729414:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613a400/0x66f5679bff032857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032850 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.729437:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613a400/0x66f5679bff032857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032850 expref: 23 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.729447:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613a400/0x66f5679bff032857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032850 expref: 23 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.729455:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613a400, rc 0) 00000100:00100000:1.0:1787368232.729498:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808649728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368232.729505:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787368232.729651:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808649728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368232.729672:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff032850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032857 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368232.729680:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff032850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032857 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368232.729730:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808649856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787368232.729761:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368232.729787:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5588a649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368232.729834:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808649856 00000100:00100000:1.0:1787368232.729839:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808649856 00000100:00100000:1.0:1787368232.729870:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787368232.729877:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5592fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808649856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787368232.729888:0:22871:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787368232.729905:0:22871:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787368232.729908:0:22871:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787368232.729995:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5592fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808649856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368232.730001:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787368232.730036:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808649856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787368232.730100:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787368232.730106:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff032850 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032857 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.730114:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5483e74c00/0x66f5679bff032850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032857 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368232.730121:0:22875:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787368232.730123:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c55acbc7800 from 14 10000000:01000000:1.0:1787368232.730125:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787368232.730141:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff03285e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.730148:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff03285e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.730155:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff03285e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368232.730168:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808649984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787368232.730193:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368232.730207:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586792540 going to sleep for 11 seconds 00000100:00100000:1.0:1787368232.730218:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808649984 00000100:00100000:1.0:1787368232.730222:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808649984 00000100:00100000:1.0:1787368232.730240:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787368232.730246:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5592fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808649984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368232.730253:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368232.730261:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55b613aa00/0x66f5679bff032865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff03285e expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.730282:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55b613aa00/0x66f5679bff032865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff03285e expref: 24 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.730292:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55b613aa00/0x66f5679bff032865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03285e expref: 24 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.730299:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b613aa00, rc 0) 00000100:00100000:1.0:1787368232.730328:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5592fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:22875:x1874190808649984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368232.730334:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787368232.730387:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808649984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368232.730398:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff03285e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032865 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.730406:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff03285e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032865 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368232.730443:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808650112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787368232.730469:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368232.730481:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5586792540 going to sleep for 11 seconds 00000100:00100000:1.0:1787368232.730492:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808650112 00000100:00100000:1.0:1787368232.730495:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808650112 00000100:00100000:1.0:1787368232.730512:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787368232.730517:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5592fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:22875:x1874190808650112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787368232.730526:0:22871:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787368232.730536:0:22871:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787368232.730542:0:22871:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787368232.730596:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5592fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:22875:x1874190808650112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 77us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368232.730602:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787368232.730629:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808650112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787368232.730663:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787368232.730668:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff03285e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032865 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368232.730677:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b613be00/0x66f5679bff03285e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032865 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368232.857852:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368233.368504:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808650240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787368233.368572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368233.370240:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808650240 00000100:00100000:1.0:1787368233.370263:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808650240 00000100:00100000:1.0:1787368233.370341:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787368233.370378:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808650240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787368233.370410:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1787368233.370466:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787368233.370483:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808650240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368233.370491:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787368233.370539:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808650240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787368233.884280:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808650368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368233.884382:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368233.889028:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808650368 00000100:00100000:1.0:1787368233.889043:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808650368 00000100:00100000:1.0:1787368233.889117:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787368233.889127:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808650368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787368233.889167:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787368233.889844:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808650368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 715us (5459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368233.890004:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787368233.890096:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808650496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368233.890141:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787368233.899121:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368233.899196:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808650368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368233.900424:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808650496 00000100:00100000:1.0:1787368233.900437:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808650496 00000100:00100000:1.0:1787368233.900495:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787368233.900506:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808650496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787368233.900541:0:23621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787368233.908567:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808650496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8054us (18416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368233.908583:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787368233.922758:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808650496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368234.392674:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808650624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787368234.392753:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368234.392930:0:24388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808650624 00000100:00100000:3.0:1787368234.392939:0:24388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808650624 00000100:00100000:3.0:1787368234.393002:0:24388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368234.393012:0:24388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808650624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787368234.393046:0:24388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787368234.393098:0:24388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808650624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368234.393105:0:24388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368234.393150:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808650624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787368234.393217:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787368234.906952:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368235.932251:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787368236.442300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368236.442306:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787368236.442309:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368236.442321:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c54845c9000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368236.442340:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c55b5074700 x1874190808651136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787368236.442386:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787368236.442390:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787368236.442392:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787368236.442397:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c55bc50b800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1787368236.442405:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c54822ca680 x1874190808651648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787368236.442460:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808650752:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442567:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808651392:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442588:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442601:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808652032:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442618:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442635:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787368236.442640:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808650880:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442656:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442667:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808651520:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442689:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442704:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808652160:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442735:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442759:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808651008:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442802:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808651776:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442818:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442830:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808652288:0@lo:400:kworker.0 00000040:00080000:1.0:1787368236.442839:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787368236.442847:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442860:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787368236.442864:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808651264:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442882:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442891:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808651904:0@lo:400:kworker.0 00000100:00100000:1.0:1787368236.442898:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808650752 00000100:00100000:1.0:1787368236.442904:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808650752 00000100:00100000:3.0:1787368236.442907:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442926:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808651136:0@lo:8:kworker.0 00000100:00100000:1.0:1787368236.442941:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787368236.442949:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3651:x1874190808650752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.442953:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.442978:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808651648:0@lo:8:kworker.0 00000100:00100000:1.0:1787368236.442996:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3651:x1874190808650752:12345-0@lo:400:kworker.0 Request processed in 47us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.442997:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368236.443003:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787368236.443021:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808652032 00000100:00100000:3.0:1787368236.443024:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808652032 00000100:00100000:1.0:1787368236.443029:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808651392 00000100:00100000:1.0:1787368236.443031:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808651392 00000100:00100000:1.0:1787368236.443048:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808650880 00000100:00100000:1.0:1787368236.443050:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808650880 00000100:00100000:3.0:1787368236.443055:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808652160 00000100:00100000:3.0:1787368236.443057:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808652160 00000100:00100000:1.0:1787368236.443060:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787368236.443065:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808651392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443068:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808651776 00000100:00100000:3.0:1787368236.443070:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808651776 00000100:00100000:3.0:1787368236.443078:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808652288 00000100:00100000:3.0:1787368236.443080:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808652288 00000100:00100000:3.0:1787368236.443090:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808651264 00000100:00100000:3.0:1787368236.443093:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808651264 00000100:00100000:1.0:1787368236.443094:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808651392:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368236.443100:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787368236.443101:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808651904 00000100:00100000:3.0:1787368236.443103:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808651904 00000100:00100000:3.0:1787368236.443115:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787368236.443116:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787368236.443120:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808652032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368236.443121:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808650880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443145:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874190808652032:12345-0@lo:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368236.443145:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808650880:12345-0@lo:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.443152:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787368236.443152:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787368236.443163:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787368236.443169:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808652160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443208:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874190808652160:12345-0@lo:400:kworker.0 Request processed in 38us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.443213:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787368236.443224:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787368236.443230:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808651776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443263:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808651776:12345-0@lo:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.443274:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787368236.443286:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787368236.443291:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808652288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443317:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874190808652288:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.443323:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787368236.443333:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787368236.443338:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808651264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443385:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808651264:12345-0@lo:400:kworker.0 Request processed in 47us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.443391:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787368236.443402:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787368236.443408:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808651904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443431:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874190808651904:12345-0@lo:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.443437:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787368236.443448:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54822c9c00 x1874190808651264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368236.443456:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808651520 00000100:00100000:3.0:1787368236.443459:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808651520 00000100:00100000:1.0:1787368236.443461:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808651264:0@lo:400:kworker.0 00010000:00080000:1.0:1787368236.443470:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e9180 x1874190808651904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368236.443475:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808651008 00000100:00100000:3.0:1787368236.443477:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808651008 00000100:00100000:1.0:1787368236.443478:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874190808651904:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443486:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808651136 00000100:00100000:3.0:1787368236.443488:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808651136 00010000:00080000:1.0:1787368236.443488:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836eb800 x1874190808651776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368236.443494:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808651648 00000100:00100000:3.0:1787368236.443496:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808651648 00000100:00100000:1.0:1787368236.443496:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808651776:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443504:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787368236.443505:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836eb480 x1874190808652288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368236.443509:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808651520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368236.443514:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874190808652288:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443545:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808651520:12345-0@lo:400:kworker.0 Request processed in 36us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.443551:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787368236.443563:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368236.443568:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808651008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.443601:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808651008:12345-0@lo:400:kworker.0 Request processed in 33us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.443607:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787368236.443617:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787368236.443621:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874190808651136:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787368236.443644:0:24385:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 693 last 0 00000100:00100000:1.0:1787368236.443644:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808651008:0@lo:400:kworker.0 00000020:00000080:3.0:1787368236.443666:0:24385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x66f5679bff03286c 00002000:00100000:3.0:1787368236.443679:0:24385:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c548353f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787368236.443683:0:24385:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787368236.443685:0:24385:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787368236.443857:0:24385:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787368236.443878:0:24385:0:(import.c:65:import_set_state_nolock()) ffff9c548353b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787368236.443914:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1874190808651136:12345-0@lo:8:kworker.0 Request processed in 292us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.443920:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787368236.443932:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368236.443936:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874190808651648:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787368236.443949:0:24385:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1787368236.443961:0:24385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x66f5679bff032873 00002000:00100000:3.0:1787368236.443967:0:24385:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c548353b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787368236.443976:0:24385:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787368236.443978:0:24385:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787368236.443998:0:24385:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787368236.444009:0:24385:0:(import.c:65:import_set_state_nolock()) ffff9c548353c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787368236.444033:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1874190808651648:12345-0@lo:8:kworker.0 Request processed in 96us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.444039:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787368236.444072:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787368236.444076:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787368236.444078:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787368236.444093:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b5074700 x1874190808651136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787368261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368236.444104:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787368236.444110:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787368236.444114:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787368236.444116:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c54845c9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787368236.444126:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787368236.444130:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874190808651136:0@lo:8:kworker.0 00010000:00080000:3.0:1787368236.444138:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54822ca680 x1874190808651648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787368261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787368236.444146:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787368236.444150:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787368236.444152:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787368236.444154:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c55bc50b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787368236.444162:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787368236.444166:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874190808651648:0@lo:8:kworker.0 00000004:00080000:3.0:1787368236.444205:0:22905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1787368236.444225:0:22905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22905:1874190808652544:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787368236.444246:0:22905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.444259:0:22905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226be40 going to sleep for 11 seconds 00000004:00080000:3.0:1787368236.444270:0:22904:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787368236.444320:0:22904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693731963858ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787368236.444325:0:22904:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787368236.444369:0:23623:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787368236.444384:0:23623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23623:1874190808652800:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787368236.444404:0:23623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.444417:0:23623:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c548226b6c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787368236.444428:0:23622:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787368236.444463:0:23622:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 693732107070ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787368236.444467:0:23622:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787368236.444611:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808652544 00000100:00100000:3.0:1787368236.444615:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808652544 00000100:00100000:3.0:1787368236.444641:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808652800 00000100:00100000:3.0:1787368236.444643:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808652800 00000100:00100000:3.0:1787368236.444656:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787368236.444661:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22905:x1874190808652544:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787368236.444809:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787368236.444816:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23623:x1874190808652800:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787368236.444843:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787368236.444850:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808652672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787368236.444873:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368236.444895:0:24388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808652672 00000100:00100000:3.0:1787368236.444898:0:24388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808652672 00000100:00100000:3.0:1787368236.444919:0:24388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787368236.444924:0:24388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3652:x1874190808652672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787368236.444944:0:24388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368236.444975:0:24388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3652:x1874190808652672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.444982:0:24388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787368236.445001:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808652416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787368236.445020:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787368236.445037:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787368236.445051:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e9180 x1874190808652672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368236.445064:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808652672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787368236.445076:0:24388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808652416 00000100:00100000:3.0:1787368236.445078:0:24388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808652416 00000100:00100000:3.0:1787368236.445093:0:24388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787368236.445098:0:24388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874190808652416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787368236.445105:0:24388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368236.445127:0:24388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874190808652416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368236.445132:0:24388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787368236.445150:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836ea680 x1874190808652416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787368252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368236.445160:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808652416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787368236.445179:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808650880:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.445189:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808651520:0@lo:400:kworker.0 00010000:00080000:3.0:1787368236.445199:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e9880 x1874190808652160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368236.445212:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874190808652160:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.445222:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808650752:0@lo:400:kworker.0 00000100:00100000:3.0:1787368236.445230:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808651392:0@lo:400:kworker.0 00010000:00080000:3.0:1787368236.445239:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836e8700 x1874190808652032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368236.445246:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874190808652032:0@lo:400:kworker.0 00000004:00080000:3.0:1787368236.447870:0:23611:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1787368236.447898:0:24384:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787368236.447906:0:24384:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1787368236.447913:0:24384:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:1.0:1787368236.453247:0:22858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1787368236.458134:0:24818:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787368236.458145:0:24818:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787368236.458241:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23623:x1874190808652800:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13421us (13831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368236.458258:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787368236.459145:0:23623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55b6041500 x1874190808652800/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787368252 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368236.459161:0:23623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23623:1874190808652800:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787368236.459185:0:23623:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787368236.459233:0:23623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23623:1874190808652928:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787368236.459280:0:23623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368236.459314:0:23623:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368236.461840:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808652928 00000100:00100000:2.0:1787368236.461852:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808652928 00000100:00100000:2.0:1787368236.461908:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787368236.461929:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23623:x1874190808652928:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787368236.461961:0:24383:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787368236.462036:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23623:x1874190808652928:12345-0@lo:5:osp-pre-1-1.0 Request processed in 119us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368236.462043:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787368236.462177:0:23623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54836b9f80 x1874190808652928/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787368252 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368236.462192:0:23623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23623:1874190808652928:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787368236.462206:0:23623:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787368236.462243:0:23623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23623:1874190808653056:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787368236.462277:0:23623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368236.462301:0:23623:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55867003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368236.462997:0:24818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808653056 00000100:00100000:2.0:1787368236.463004:0:24818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808653056 00000100:00100000:2.0:1787368236.463048:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787368236.463056:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23623:x1874190808653056:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787368236.463091:0:24818:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:2.0:1787368236.468280:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368236.468292:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.468308:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=693s v=(0 0) 00010000:00010000:2.0:1787368236.468313:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368236.468320:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.468338:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.468475:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.468485:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.468509:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.468896:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.468904:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.468915:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.468924:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.468934:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.468952:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.468972:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d285bf/0x66f5679bff03287a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.468993:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.468995:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.468997:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787368236.470424:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787368236.470434:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.470447:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=693s v=(0 0) 00010000:00010000:2.0:1787368236.470451:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787368236.470456:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.470475:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.470484:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.470491:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.470568:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368236.470852:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368236.470859:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.470866:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368236.470871:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.470880:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.470896:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.470904:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002efd15c5/0x66f5679bff032881 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.470938:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368236.470940:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368236.470941:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787368236.478970:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.478984:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.479002:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.479007:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.479013:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.479025:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.479036:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.479043:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.479064:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368236.479393:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368236.479400:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.479409:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368236.479414:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.479423:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.479441:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.479449:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032888 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.479478:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368236.479480:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368236.479482:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787368236.480105:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.480128:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480139:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.480142:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.480147:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480157:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480165:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480172:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480192:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787368236.480642:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.480649:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480658:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.480662:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.480666:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480676:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480691:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480698:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480712:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787368236.480721:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787368236.480725:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480733:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.480736:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480745:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480758:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480766:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03288f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480794:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.480803:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480810:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241da00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.480813:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480822:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480833:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480840:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032896 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.480851:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.480853:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.480854:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787368236.481326:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.481332:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481341:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.481344:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.481348:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481385:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481394:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481400:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481413:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.481420:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.481424:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481430:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.481434:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481442:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481452:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481459:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff03289d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.481478:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.481480:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.481481:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787368236.484665:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.484676:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484692:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.484696:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.484702:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484715:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484725:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484733:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484748:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.484758:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.484763:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484795:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241cc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.484799:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484808:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484823:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484831:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff0328a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.484846:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.484848:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.484849:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368236.485005:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787368236.485714:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.485721:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.485733:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.485736:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.485741:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.485751:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.485765:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.485783:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.485805:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787368236.486377:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787368236.486384:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.486392:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368236.486397:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.486406:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.486419:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.486426:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff0328ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.486442:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368236.486444:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368236.486446:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787368236.489200:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.489212:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.489240:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.489245:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.489259:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.489273:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.489283:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.489291:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.490345:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787368236.491673:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.491684:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.491699:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.491703:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.491709:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.491722:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.491732:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.491739:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.494800:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787368236.494813:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.494930:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368236.494935:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.494947:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.494971:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.494988:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d012356/0x66f5679bff0328b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.495024:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368236.495028:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.495037:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a1600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368236.495041:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.495049:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.495153:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.495165:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368236.495167:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368236.495170:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.495953:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787368236.495962:0:24384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9cce837/0x66f5679bff0328b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787368236.496541:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.496549:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496569:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.496574:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.496580:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496594:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496604:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496611:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496628:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.496637:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.496642:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496650:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673c00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.496655:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496664:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496689:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496697:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004330c9c2/0x66f5679bff0328c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.496712:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.496714:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.496715:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368236.497054:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787368236.497163:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.497170:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.497182:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.497185:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368236.497190:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.497199:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.497207:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.497215:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787368236.499568:0:25200:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1787368236.499595:0:25200:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787368236.499602:0:25200:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787368236.499682:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787368236.499889:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368236.499898:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.499909:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368236.499914:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.499925:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.499946:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.499954:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000704429ad/0x66f5679bff0328c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368236.499991:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368236.499994:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368236.499998:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787368236.500372:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23623:x1874190808653056:12345-0@lo:5:osp-pre-1-1.0 Request processed in 37298us (38075us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787368236.500382:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00002000:00010000:0.0:1787368236.501631:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787368236.501641:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.501657:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1787368236.501670:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368236.501678:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.501690:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.501700:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.501706:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.501722:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787368236.502246:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368236.502253:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502261:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368236.502265:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502274:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502289:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502306:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000588d6a6c/0x66f5679bff0328ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502326:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368236.502328:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368236.502329:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787368236.502554:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787368236.502561:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502569:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1787368236.502573:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368236.502577:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502585:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502592:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502599:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.502615:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787368236.503307:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787368236.503321:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.503332:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1787368236.503336:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368236.503815:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504047:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504118:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504127:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504146:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787368236.504158:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787368236.504163:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504170:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368236.504174:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504183:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504206:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504215:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d429fbd9/0x66f5679bff0328d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504234:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787368236.504238:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504243:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68b600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368236.504246:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504254:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504262:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504269:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c01cf2f/0x66f5679bff0328dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368236.504281:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368236.504282:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368236.504291:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368236.504475:0:23623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1787368236.504486:0:23623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23623:1874190808653056:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787368236.504501:0:23623:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1787368236.504548:0:23623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23623:1874190808653184:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787368236.504605:0:23623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368236.504633:0:23623:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c54825ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787368236.504655:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808653184 00000100:00100000:2.0:1787368236.504660:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808653184 00000100:00100000:2.0:1787368236.504721:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787368236.504730:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23623:x1874190808653184:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787368236.506203:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23623:x1874190808653184:12345-0@lo:900:osp-pre-1-1.0 Request processed in 1469us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368236.506215:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787368236.506309:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1787368236.506338:0:23623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483ea1180 x1874190808653184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787368252 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368236.506964:0:23623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ea1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23623:1874190808653184:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787368236.509092:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.509110:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.509126:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.509131:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.509138:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.509151:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.509161:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.509169:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.511963:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368236.512964:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.512976:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.512992:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.512997:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.513003:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.513016:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.513033:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.513041:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513149:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787368236.513157:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513165:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.513169:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513177:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513194:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513202:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002da6dc6c/0x66f5679bff0328e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513427:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.513432:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513440:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.513444:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513463:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513474:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.513482:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.513484:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.513486:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368236.515183:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787368236.515194:0:24384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb0f3b1/0x66f5679bff0328ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787368236.516648:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.516658:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.516672:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.516677:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.516683:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.516697:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.516708:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.516728:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.518072:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.518083:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.518097:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.518102:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.518113:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.518131:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.518141:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.518143:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.518145:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.522465:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368236.522486:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787368236.522496:0:24384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9a74e4f/0x66f5679bff0328f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787368236.523044:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.523053:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523067:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.523072:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.523079:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523091:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523101:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523110:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523145:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.523167:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.523176:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523187:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ac00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.523192:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523203:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523222:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523230:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad814f84/0x66f5679bff0328f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523247:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.523248:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.523250:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.523547:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.523554:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523563:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.523566:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.523571:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523580:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523587:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523594:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.523613:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.523798:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.523804:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523812:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613ba00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.523815:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523835:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523847:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523854:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aea8fe9d/0x66f5679bff0328ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.523868:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.523869:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.523871:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.524128:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.524134:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.524143:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.524152:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.524156:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.524165:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.524173:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.524180:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.524200:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.524436:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.524442:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.524451:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a200 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.524455:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.524463:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.524475:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.524496:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004179255d/0x66f5679bff032906 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.524511:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.524513:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.524514:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.525021:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.525028:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525038:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.525041:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.525046:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525056:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525066:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525080:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525102:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.525135:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.525141:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525151:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613bc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.525155:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525164:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525177:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525186:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000055b6b7a/0x66f5679bff03290d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525200:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.525201:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.525203:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.525484:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.525490:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525498:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.525501:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.525505:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525514:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525523:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525529:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.525549:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.525799:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.525805:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525812:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.525815:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525823:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525835:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525843:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcef6ba2/0x66f5679bff032914 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.525858:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.525860:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.525861:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.526015:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.526021:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.526035:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.526039:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.526043:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.526053:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.526061:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.526068:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.526089:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.526135:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.526141:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.526148:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613b800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.526151:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.526171:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.526182:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.526189:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ca997f2/0x66f5679bff03291b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.526203:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.526204:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.526206:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.527351:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.527372:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.527384:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.527387:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.527391:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.527401:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.527422:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.527429:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.527450:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.527481:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.527488:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.527497:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241d000 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.527501:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.527512:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.527529:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.527548:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ca33abd/0x66f5679bff032922 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.527564:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.527566:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.527567:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.528142:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.528148:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528157:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.528159:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.528163:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528172:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528178:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528185:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528217:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.528402:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.528408:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528416:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241cc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.528420:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528428:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528441:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528449:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3f901a5/0x66f5679bff032929 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528464:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.528465:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.528467:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.528597:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.528603:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528612:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.528615:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.528619:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528628:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528635:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528643:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528661:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.528798:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.528804:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528811:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c800 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.528815:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528823:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528834:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528841:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8ffbdb3/0x66f5679bff032930 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.528856:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.528858:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.528861:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.528884:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.528890:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528898:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.528907:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.528913:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528971:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528979:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.528986:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529003:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787368236.529052:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.529058:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529077:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241da00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.529080:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529100:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529112:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529119:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000836b4adf/0x66f5679bff032937 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529133:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.529134:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.529136:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.529202:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.529209:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529217:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.529220:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.529491:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529505:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529514:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529528:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529547:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787368236.529798:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787368236.529799:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.529807:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529808:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529829:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:1.0:1787368236.529831:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=693s v=(0 0) 00010000:00010000:3.0:1787368236.529834:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529836:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.529846:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529850:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529865:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529871:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529875:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529888:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529911:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdddcf24/0x66f5679bff03293e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529925:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.529928:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.529929:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787368236.529939:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368236.529943:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529950:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529962:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529968:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4678ae/0x66f5679bff032945 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.529995:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.529997:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.529999:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787368236.530036:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787368236.530204:0:24384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787368236.530210:0:24384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.530224:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1787368236.530240:0:24384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368236.530245:0:24384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.530266:0:24384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.530274:0:24384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.530281:0:24384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368236.530300:0:24384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787368236.530331:0:24384:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1787368236.530458:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22905:x1874190808652544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 85791us (86206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368236.530469:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787368236.530488:0:22905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22905:1874190808652544:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787368236.530511:0:22905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1787368236.530551:0:22905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5482623100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22905:1874190808653312:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787368236.530588:0:22905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368236.530623:0:22905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5592d806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787368236.530694:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808653312 00000100:00100000:1.0:1787368236.530701:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808653312 00010000:00010000:3.0:1787368236.530725:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787368236.530732:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.530747:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030000 already unused, calling callback (ffffffffc0b31420) 00000100:00100000:1.0:1787368236.530749:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1787368236.530752:0:22867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368236.530762:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22905:x1874190808653312:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1787368236.530763:0:22867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.530792:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368236.530800:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000064f4c7b/0x66f5679bff03294c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787368236.530809:0:24385:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:3.0:1787368236.530815:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.530818:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787368236.530819:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368236.533470:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22905:x1874190808653312:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2706us (2875us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787368236.533491:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787368236.533515:0:22905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5482623100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22905:1874190808653312:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787368236.533531:0:22905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1787368236.959713:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787368237.388895:0:25556:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787368237.977717:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787368238.250805:0:25608:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787368238.251315:0:25608:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787368238.488516:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787368238.488539:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808653440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787368238.488609:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368238.488656:0:24388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808653440 00000100:00100000:1.0:1787368238.488664:0:24388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808653440 00000100:00100000:1.0:1787368238.488726:0:24388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368238.488737:0:24388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808653440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787368238.488777:0:24388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00080000:0.0:1787368238.488788:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787368238.488831:0:24388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808653440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368238.488839:0:24388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787368238.488949:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808653440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787368239.000555:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787368239.000578:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808653568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368239.000646:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368239.000740:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808653568 00000100:00100000:1.0:1787368239.000748:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808653568 00000100:00100000:1.0:1787368239.000810:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787368239.000827:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5482620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808653568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787368239.000861:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787368239.000917:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5482620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808653568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368239.000925:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787368239.001412:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808653568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787368239.001698:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787368239.001708:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808653696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787368239.001743:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368239.001794:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808653696 00000100:00100000:1.0:1787368239.001799:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808653696 00000100:00100000:1.0:1787368239.001839:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787368239.001847:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808653696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787368239.001868:0:22884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787368239.001927:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808653696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368239.001935:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787368239.001968:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808653696:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787368239.002665:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787368239.066896:0:25658:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787368239.067175:0:25658:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787368239.336539:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368239.341161:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788628224 00000100:00100000:0.0:1787368239.341173:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788628224 00000100:00100000:0.0:1787368239.341224:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:0.0:1787368239.341235:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1874190788628224:12345-192.168.203.4@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787368239.341335:0:22873:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e7db1a22-e032-464d-a4cf-1677c572dedf@192.168.203.4@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:2.0:1787368239.341387:0:22873:0:(genops.c:1385:class_connect()) connect: client e7db1a22-e032-464d-a4cf-1677c572dedf, cookie 0x66f5679bff032953 00000100:00080000:2.0:1787368239.341540:0:22873:0:(import.c:65:import_set_state_nolock()) ffff9c5482002800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787368239.341618:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+5:2401:x1874190788628224:12345-192.168.203.4@tcp:250:mount.lustre.0 Request processed in 385us (5089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.341627:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:0.0:1787368239.347290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368239.347618:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788628352 00000100:00100000:1.0:1787368239.347627:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788628352 00000100:00100000:1.0:1787368239.347711:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:1.0:1787368239.347721:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+5:18286:x1874190788628352:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787368239.347737:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368239.347768:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5580031a00/0x66f5679bff03295a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed48 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368239.347796:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5580031a00/0x66f5679bff03295a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed48 expref: 6 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368239.347807:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5580031a00/0x66f5679bff03295a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed48 expref: 6 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368239.347817:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031a00, rc 0) 00000100:00100000:1.0:1787368239.347875:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+6:18286:x1874190788628352:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 156us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368239.347882:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:3.0:1787368239.354146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368239.354382:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788628480 00000100:00100000:0.0:1787368239.354404:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788628480 00000100:00100000:0.0:1787368239.354458:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:0.0:1787368239.354467:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+6:18286:x1874190788628480:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787368239.354577:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+6:18286:x1874190788628480:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 110us (439us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787368239.354584:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:3.0:1787368239.359209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368239.359493:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788628608 00000100:00100000:2.0:1787368239.359502:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788628608 00000100:00100000:2.0:1787368239.359558:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:2.0:1787368239.359569:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+6:18286:x1874190788628608:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787368239.359586:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368239.359603:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e75200/0x66f5679bff032961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed4f expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368239.359629:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e75200/0x66f5679bff032961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed4f expref: 7 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368239.359640:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e75200/0x66f5679bff032961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed4f expref: 7 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368239.359648:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e75200, rc 0) 00000100:00100000:2.0:1787368239.359715:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+7:18286:x1874190788628608:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 148us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.359722:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:0.0:1787368239.361191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368239.361262:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788628736 00000100:00100000:3.0:1787368239.361270:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788628736 00000100:00100000:3.0:1787368239.361317:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:3.0:1787368239.361326:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+7:18286:x1874190788628736:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787368239.361597:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18286:x1874190788628736:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 272us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368239.361617:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:3.0:1787368239.363708:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368239.364235:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788628864 00000100:00100000:0.0:1787368239.364245:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788628864 00000100:00100000:0.0:1787368239.364333:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:0.0:1787368239.364343:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18286:x1874190788628864:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787368239.364917:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18286:x1874190788628864:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 573us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368239.364928:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:1.0:1787368239.370052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368239.370241:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788628992 00000100:00100000:3.0:1787368239.370251:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788628992 00000100:00100000:3.0:1787368239.370304:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:3.0:1787368239.370314:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18305:x1874190788628992:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787368239.370501:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18305:x1874190788628992:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 186us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368239.370510:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:0.0:1787368239.406186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368239.406739:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788629120 00000100:00100000:1.0:1787368239.406760:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788629120 00000100:00100000:1.0:1787368239.406818:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:1.0:1787368239.406828:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18305:x1874190788629120:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787368239.406979:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18305:x1874190788629120:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 152us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368239.406986:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:1.0:1787368239.414879:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368239.415697:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788629248 00000100:00100000:3.0:1787368239.415710:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788629248 00000100:00100000:2.0:1787368239.416498:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:2.0:1787368239.416515:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18305:x1874190788629248:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787368239.416824:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18305:x1874190788629248:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 315us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.416834:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:3.0:1787368239.424193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368239.424343:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788629376 00000100:00100000:2.0:1787368239.424403:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788629376 00000100:00100000:2.0:1787368239.424497:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:2.0:1787368239.424508:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+8:18286:x1874190788629376:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787368239.424541:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368239.424558:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5483e74000/0x66f5679bff032968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed80 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368239.424587:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5483e74000/0x66f5679bff032968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed80 expref: 9 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368239.424599:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5483e74000/0x66f5679bff032968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed80 expref: 9 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368239.424608:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5483e74000, rc 0) 00000100:00100000:2.0:1787368239.424666:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+9:18286:x1874190788629376:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 160us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.424673:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:0.0:1787368239.432525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368239.435322:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788629504 00000100:00100000:1.0:1787368239.435337:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788629504 00000100:00100000:1.0:1787368239.435479:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:1.0:1787368239.435490:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+9:18286:x1874190788629504:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787368239.435517:0:22873:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787368239.435541:0:22873:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787368239.435546:0:22873:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787368239.435549:0:22873:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787368239.435552:0:22873:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787368239.435554:0:22873:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1787368239.438764:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+9:18286:x1874190788629504:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 3257us (6227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.438781:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:3.0:1787368239.443471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368239.443805:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788629632 00000100:00100000:2.0:1787368239.443815:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788629632 00000100:00100000:2.0:1787368239.443876:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:2.0:1787368239.443887:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+9:18286:x1874190788629632:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787368239.443904:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368239.443922:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ed87 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368239.443959:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed87 expref: 10 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368239.443988:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed87 expref: 10 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368239.443998:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e800, rc 0) 00000100:00100000:2.0:1787368239.444060:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18286:x1874190788629632:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 176us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.444068:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:0.0:1787368239.445854:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368239.445952:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788629760 00000100:00100000:2.0:1787368239.445961:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788629760 00000100:00100000:2.0:1787368239.446057:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:2.0:1787368239.446068:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18286:x1874190788629760:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787368239.446199:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18286:x1874190788629760:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 133us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.446207:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:3.0:1787368239.447844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368239.448345:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788629888 00000100:00100000:1.0:1787368239.448373:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788629888 00000100:00100000:1.0:1787368239.448429:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:1.0:1787368239.448438:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18286:x1874190788629888:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787368239.448556:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18286:x1874190788629888:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 118us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368239.448565:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:3.0:1787368239.451554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368239.451715:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788630016 00000100:00100000:1.0:1787368239.451737:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788630016 00000100:00100000:1.0:1787368239.451799:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:1.0:1787368239.451809:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18311:x1874190788630016:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787368239.451937:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18311:x1874190788630016:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 130us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368239.451946:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:0.0:1787368239.456778:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368239.457088:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788630144 00000100:00100000:3.0:1787368239.457098:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788630144 00000100:00100000:3.0:1787368239.457161:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:3.0:1787368239.457171:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18311:x1874190788630144:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787368239.457544:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18311:x1874190788630144:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 372us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368239.457552:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 131 00000100:00100000:1.0:1787368239.462195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368239.462320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368239.462511:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788630272 00000100:00100000:3.0:1787368239.462521:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788630272 00000100:00100000:0.0:1787368239.462570:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788630528 00000100:00100000:0.0:1787368239.462575:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788630528 00000100:00100000:0.0:1787368239.462611:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1787368239.462619:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874190788630272:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787368239.462649:0:22880:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0376d49e-ddfe-46c2-91e5-49eaeca90b82@192.168.203.4@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:0.0:1787368239.462696:0:22880:0:(genops.c:1385:class_connect()) connect: client 0376d49e-ddfe-46c2-91e5-49eaeca90b82, cookie 0x66f5679bff032976 00000004:00100000:0.0:1787368239.462718:0:22880:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787368239.462928:0:22880:0:(import.c:65:import_set_state_nolock()) ffff9c54822e6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368239.462998:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:2401:x1874190788630272:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 378us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368239.463007:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1787368239.463036:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1787368239.463040:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874190788630528:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787368239.463054:0:22880:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0376d49e-ddfe-46c2-91e5-49eaeca90b82@192.168.203.4@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:0.0:1787368239.463093:0:22880:0:(genops.c:1385:class_connect()) connect: client 0376d49e-ddfe-46c2-91e5-49eaeca90b82, cookie 0x66f5679bff03297d 00000004:00100000:0.0:1787368239.463105:0:22880:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787368239.463223:0:22880:0:(import.c:65:import_set_state_nolock()) ffff9c54822e4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368239.463246:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:2401:x1874190788630528:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 204us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368239.463802:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1787368239.472639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368239.472676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368239.473137:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788630784 00000100:00100000:0.0:1787368239.473146:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788630784 00000100:00100000:0.0:1787368239.473227:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788630656 00000100:00100000:0.0:1787368239.473231:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788630656 00000100:00100000:0.0:1787368239.473258:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1787368239.473268:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18286:x1874190788630784:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787368239.473299:0:24580:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787368239.473405:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18286:x1874190788630784:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 137us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368239.473414:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1787368239.473433:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1787368239.473440:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:0:x1874190788630656:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787368239.473452:0:24580:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787368239.473486:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:0:x1874190788630656:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 47us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368239.473492:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00080000:1.0:1787368239.474504:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787368239.474512:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787368239.476206:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368239.476540:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788630400 00000100:00100000:0.0:1787368239.476549:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788630400 00000100:00100000:0.0:1787368239.476836:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1787368239.476847:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:0:x1874190788630400:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787368239.476875:0:24580:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787368239.476961:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:0:x1874190788630400:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 116us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368239.476969:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1787368239.478255:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368239.478316:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788630912 00000100:00100000:2.0:1787368239.478323:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788630912 00000100:00100000:2.0:1787368239.478931:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:2.0:1787368239.478945:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18286:x1874190788630912:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787368239.479040:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18286:x1874190788630912:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 99us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.479049:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1787368239.480992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368239.481093:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368239.481734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368239.481970:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788631296 00000100:00100000:2.0:1787368239.481980:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788631296 00000100:00100000:2.0:1787368239.482039:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1787368239.482059:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18286:x1874190788631296:12345-192.168.203.4@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787368239.482136:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18286:x1874190788631296:12345-192.168.203.4@tcp:900:mount.lustre.0 Request processed in 80us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.482144:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1787368239.482324:0:24818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788631040 00000100:00100000:0.0:1787368239.482330:0:24818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788631040 00000100:00100000:0.0:1787368239.482536:0:24818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788631168 00000100:00100000:0.0:1787368239.482541:0:24818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788631168 00000100:00100000:2.0:1787368239.482770:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1787368239.482777:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874190788631040:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787368239.482874:0:24383:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0376d49e-ddfe-46c2-91e5-49eaeca90b82@192.168.203.4@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:2.0:1787368239.482902:0:24383:0:(genops.c:1385:class_connect()) connect: client 0376d49e-ddfe-46c2-91e5-49eaeca90b82, cookie 0x66f5679bff032984 00002000:00100000:2.0:1787368239.482913:0:24383:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0376d49e-ddfe-46c2-91e5-49eaeca90b82/ffff9c5482005000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787368239.482922:0:24383:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787368239.483448:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1787368239.483456:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874190788631168:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787368239.483479:0:24384:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0376d49e-ddfe-46c2-91e5-49eaeca90b82@192.168.203.4@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:1.0:1787368239.483497:0:24384:0:(genops.c:1385:class_connect()) connect: client 0376d49e-ddfe-46c2-91e5-49eaeca90b82, cookie 0x66f5679bff03298b 00002000:00100000:1.0:1787368239.483504:0:24384:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0376d49e-ddfe-46c2-91e5-49eaeca90b82/ffff9c5483f84000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787368239.483516:0:24384:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787368239.483649:0:24384:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787368239.483676:0:24384:0:(import.c:65:import_set_state_nolock()) ffff9c5483f87000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368239.483756:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:2401:x1874190788631168:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 283us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368239.483765:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00002000:00080000:2.0:1787368239.484228:0:24383:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787368239.484308:0:24383:0:(import.c:65:import_set_state_nolock()) ffff9c5482003800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787368239.484435:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:2401:x1874190788631040:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 1656us (3450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.484443:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1787368239.485909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368239.486031:0:22881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788631424 00000100:00100000:1.0:1787368239.486039:0:22881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788631424 00000100:00100000:1.0:1787368239.486084:0:22881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1787368239.486107:0:22881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18286:x1874190788631424:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787368239.488467:0:22881:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2281us 00000004:00200000:2.0:1787368239.502316:0:22881:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787368239.502490:0:22881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18286:x1874190788631424:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 16379us (16579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368239.502506:0:22881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1787368239.516225:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787368239.517949:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808653824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787368239.518025:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368239.518177:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808653824 00000100:00100000:3.0:1787368239.518185:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808653824 00000100:00100000:3.0:1787368239.518247:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787368239.518256:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808653824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787368239.518281:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787368239.518330:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808653824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368239.518336:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787368239.518549:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787368239.518596:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808653824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787368239.645106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368239.645211:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788631552 00000100:00100000:1.0:1787368239.645221:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788631552 00000100:00100000:1.0:1787368239.645287:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1787368239.645297:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18334:x1874190788631552:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:1.0:1787368239.645318:0:22878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368239.645343:0:22878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff032992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2edb8 expref: -99 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368239.646462:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030000/0x66f5679bff032999 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368239.646480:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030000/0x66f5679bff032999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368239.646494:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030000/0x66f5679bff032999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368239.646551:0:22878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787368239.646555:0:22878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787368239.646609:0:22878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030000/0x66f5679bff032999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368239.646636:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031400/0x66f5679bff032992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edb8 expref: 8 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368239.646889:0:22878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030000/0x66f5679bff032999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edb8 expref: 7 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368239.646967:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55bc700000) 00010000:00010000:1.0:1787368239.646971:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787368239.646974:0:22878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580030000, rc 0) 00000100:00100000:1.0:1787368239.647125:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:18334:x1874190788631552:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 1828us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368239.647134:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000040:00080000:3.0:1787368239.833927:0:23637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787368240.024726:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368241.048588:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368241.492182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.492270:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788631680 00000100:00100000:3.0:1787368241.492280:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788631680 00000100:00100000:3.0:1787368241.492437:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:3.0:1787368241.492449:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:18386:x1874190788631680:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1787368241.492482:0:22879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787368241.492837:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:18386:x1874190788631680:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 390us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.492845:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1787368241.496567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:1.0:1787368241.498717:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787368241.503479:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788631808 00000100:00100000:0.0:1787368241.503493:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788631808 00000100:00100000:0.0:1787368241.503597:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1787368241.503620:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18386:x1874190788631808:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:0.0:1787368241.503665:0:24580:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787368241.503794:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18386:x1874190788631808:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 187us (7234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368241.503802:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00080000:1.0:1787368241.505412:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787368241.512750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.512846:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788631936 00000100:00100000:3.0:1787368241.512856:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788631936 00000100:00080000:1.0:1787368241.512932:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787368241.512956:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1787368241.512967:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18386:x1874190788631936:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:3.0:1787368241.512997:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787368241.513078:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18386:x1874190788631936:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 113us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.513085:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1787368241.517081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368241.517162:0:24388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788632064 00000100:00100000:2.0:1787368241.517172:0:24388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788632064 00000100:00100000:2.0:1787368241.517255:0:24388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1787368241.517266:0:24388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18386:x1874190788632064:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1787368241.517295:0:24388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1787368241.517479:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787368241.517523:0:24388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18386:x1874190788632064:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 251us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368241.517532:0:24388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1787368241.560559:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787368241.560582:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808653952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787368241.560623:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808654080:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.560639:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808654208:0@lo:400:kworker.0 00000100:00100000:3.0:1787368241.560654:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368241.560729:0:24388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808653952 00000100:00100000:2.0:1787368241.560749:0:24388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808653952 00000100:00100000:2.0:1787368241.560799:0:24388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368241.560807:0:24388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808653952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787368241.560828:0:24388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787368241.565165:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368241.565234:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808654720:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.565269:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368241.565287:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808655232:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.565314:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368241.565344:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808655744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787368241.565397:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808654208 00000100:00100000:1.0:1787368241.565405:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808654208 00000100:00100000:1.0:1787368241.565446:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808654720 00000100:00100000:1.0:1787368241.565461:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808654720 00000100:00100000:1.0:1787368241.565478:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787368241.565486:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808654208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.565537:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808654208:12345-0@lo:400:kworker.0 Request processed in 51us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.565594:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787368241.565625:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787368241.565642:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808654720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.565677:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808654720:12345-0@lo:400:kworker.0 Request processed in 35us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.565684:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787368241.565716:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787368241.565729:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808655232 00000100:00100000:1.0:1787368241.565733:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808655232 00000100:00100000:1.0:1787368241.565774:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787368241.565781:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808655232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.565821:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874190808655232:12345-0@lo:400:kworker.0 Request processed in 41us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.565828:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787368241.565843:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787368241.565874:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808654464:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.565901:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368241.565944:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808654976:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.565965:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368241.565982:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808655488:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566012:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368241.566042:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787368241.566049:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808654336:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368241.566097:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808654848:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566119:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368241.566136:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808655360:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566155:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368241.566179:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808654464 00000100:00100000:1.0:1787368241.566182:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808654464 00000100:00100000:1.0:1787368241.566202:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808654976 00000100:00100000:1.0:1787368241.566205:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808654976 00000100:00100000:1.0:1787368241.566222:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808654336 00000100:00100000:1.0:1787368241.566224:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808654336 00000100:00100000:1.0:1787368241.566237:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808654848 00000100:00100000:1.0:1787368241.566240:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808654848 00000100:00100000:1.0:1787368241.566253:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787368241.566259:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808654464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566292:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1874190808654464:12345-0@lo:400:kworker.0 Request processed in 34us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.566299:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787368241.566312:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368241.566318:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808654976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566344:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808654976:12345-0@lo:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.566350:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787368241.566382:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368241.566388:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808654336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566421:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808654336:12345-0@lo:400:kworker.0 Request processed in 34us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.566427:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787368241.566437:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787368241.566442:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808654848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566464:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808654848:12345-0@lo:400:kworker.0 Request processed in 22us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.566469:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787368241.566484:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787368241.566487:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787368241.566515:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808654336:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566525:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808654848:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566538:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808654464:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566715:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808654976:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566762:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808655488 00000100:00100000:1.0:1787368241.566767:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808655488 00000100:00100000:1.0:1787368241.566793:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808655360 00000100:00100000:1.0:1787368241.566797:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808655360 00000100:00100000:1.0:1787368241.566814:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787368241.566820:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808655488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.566854:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874190808655488:12345-0@lo:400:kworker.0 Request processed in 34us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.566860:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787368241.566870:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787368241.566877:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808655360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.567209:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874190808655360:12345-0@lo:400:kworker.0 Request processed in 332us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.567217:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787368241.567233:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787368241.567236:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787368241.567263:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483cefb80 x1874190808655360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368241.567274:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874190808655360:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.567286:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874190808655488:0@lo:400:kworker.0 00000100:00100000:0.0:1787368241.567844:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368241.567948:0:24388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874190808653952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7138us (7293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368241.567959:0:24388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368241.567997:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368241.568023:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808655744 00000100:00100000:2.0:1787368241.568028:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808655744 00000100:00100000:2.0:1787368241.568055:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368241.568062:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808655744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787368241.568079:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787368241.568107:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b5077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808654592:0@lo:400:kworker.0 00000100:00100000:2.0:1787368241.568117:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808655744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368241.568124:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787368241.568144:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368241.568177:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808655744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787368241.568185:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808654592 00000100:00100000:0.0:1787368241.568190:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808654592 00000100:00100000:2.0:1787368241.568194:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808654208:0@lo:400:kworker.0 00000100:00100000:2.0:1787368241.568209:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808654720:0@lo:400:kworker.0 00000100:00100000:0.0:1787368241.568221:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787368241.568230:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808654592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368241.568243:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874190808655232:0@lo:400:kworker.0 00000100:00100000:0.0:1787368241.568266:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874190808654592:12345-0@lo:400:kworker.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368241.568273:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787368241.568276:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787368241.568287:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808655616:0@lo:400:kworker.0 00000100:00100000:0.0:1787368241.568303:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b5077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874190808654592:0@lo:400:kworker.0 00000100:00100000:0.0:1787368241.568311:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808655104:0@lo:400:kworker.0 00000100:00100000:2.0:1787368241.568322:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368241.568343:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368241.568386:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808655616 00000100:00100000:0.0:1787368241.568390:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808655616 00000100:00100000:2.0:1787368241.568391:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808655104 00000100:00100000:2.0:1787368241.568397:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808655104 00000100:00100000:0.0:1787368241.568431:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787368241.568438:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808655616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368241.568451:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787368241.568461:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808655104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368241.568476:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874190808655616:12345-0@lo:400:kworker.0 Request processed in 37us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368241.568483:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787368241.568503:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787368241.568505:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874190808655104:12345-0@lo:400:kworker.0 Request processed in 44us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368241.568514:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787368241.568526:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54822c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874190808655104:0@lo:400:kworker.0 00010000:00080000:2.0:1787368241.568549:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483ced180 x1874190808655616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787368241.568561:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874190808655616:0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.568912:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808654080 00000100:00100000:1.0:1787368241.568918:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808654080 00000100:00100000:1.0:1787368241.568952:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787368241.568960:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3653:x1874190808654080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368241.569006:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3653:x1874190808654080:12345-0@lo:400:kworker.0 Request processed in 47us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.569012:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787368241.569114:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808654080:0@lo:400:kworker.0 00000100:00100000:3.0:1787368241.569689:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808653952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787368241.683875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.683954:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788632192 00000100:00100000:3.0:1787368241.683965:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788632192 00000100:00100000:3.0:1787368241.684027:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:3.0:1787368241.684049:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+10:18419:x1874190788632192:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787368241.684064:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368241.684083:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673c00/0x66f5679bff0329a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2edbf expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368241.684112:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673c00/0x66f5679bff0329a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edbf expref: 11 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368241.684123:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673c00/0x66f5679bff0329a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edbf expref: 11 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368241.684131:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673c00, rc 0) 00000100:00100000:3.0:1787368241.684198:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18419:x1874190788632192:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 162us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.684206:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 133 00000100:00100000:0.0:1787368241.690076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368241.690185:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788632320 00000100:00100000:2.0:1787368241.690194:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788632320 00000100:00100000:2.0:1787368241.690253:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:2.0:1787368241.690263:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18419:x1874190788632320:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787368241.690478:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18419:x1874190788632320:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 216us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368241.690486:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 134 00000100:00100000:0.0:1787368241.702463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368241.702870:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788632448 00000100:00100000:1.0:1787368241.702880:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788632448 00000100:00100000:1.0:1787368241.702939:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:1.0:1787368241.702949:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b67e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18419:x1874190788632448:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787368241.703092:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b67e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18419:x1874190788632448:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 143us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.703099:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 135 00000100:00100000:1.0:1787368241.708651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.709018:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788632576 00000100:00100000:3.0:1787368241.709027:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788632576 00000100:00100000:3.0:1787368241.709124:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:3.0:1787368241.709135:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18425:x1874190788632576:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787368241.709288:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18425:x1874190788632576:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 155us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.709296:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 136 00000100:00100000:0.0:1787368241.739589:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368241.739764:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788632704 00000100:00100000:2.0:1787368241.739774:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788632704 00000100:00100000:2.0:1787368241.739829:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:2.0:1787368241.739851:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18425:x1874190788632704:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787368241.740172:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18425:x1874190788632704:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 322us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368241.740181:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 137 00000100:00100000:0.0:1787368241.747726:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.751025:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788632832 00000100:00100000:3.0:1787368241.751043:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788632832 00000100:00100000:3.0:1787368241.751117:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:3.0:1787368241.751128:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18425:x1874190788632832:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787368241.751290:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18425:x1874190788632832:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 163us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.751299:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 138 00000100:00100000:3.0:1787368241.754233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368241.754349:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788632960 00000100:00100000:1.0:1787368241.754393:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788632960 00000100:00100000:1.0:1787368241.754443:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:1.0:1787368241.754452:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18419:x1874190788632960:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787368241.754481:0:22873:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368241.754499:0:22873:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5580031400/0x66f5679bff0329a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2edf0 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368241.754526:0:22873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5580031400/0x66f5679bff0329a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf0 expref: 12 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368241.754537:0:22873:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5580031400/0x66f5679bff0329a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf0 expref: 12 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368241.754545:0:22873:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580031400, rc 0) 00000100:00100000:1.0:1787368241.754645:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18419:x1874190788632960:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 194us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.754652:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 139 00000100:00100000:0.0:1787368241.762663:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368241.762888:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788633088 00000100:00100000:2.0:1787368241.762898:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788633088 00000100:00100000:2.0:1787368241.762958:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:2.0:1787368241.762967:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18419:x1874190788633088:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787368241.762993:0:22872:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787368241.763016:0:22872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787368241.763020:0:22872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787368241.763023:0:22872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787368241.763026:0:22872:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787368241.763028:0:22872:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1787368241.765014:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18419:x1874190788633088:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 2039us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.765027:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 140 00000100:00100000:3.0:1787368241.773501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368241.774045:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788633216 00000100:00100000:1.0:1787368241.774056:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788633216 00000100:00100000:1.0:1787368241.774111:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:1.0:1787368241.774121:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18419:x1874190788633216:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787368241.774137:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368241.774153:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2edf7 expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368241.774182:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf7 expref: 13 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368241.774193:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf7 expref: 13 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368241.774217:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580030600, rc 0) 00000100:00100000:1.0:1787368241.774279:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18419:x1874190788633216:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 159us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.774286:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 141 00000100:00100000:0.0:1787368241.780445:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368241.780544:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788633344 00000100:00100000:1.0:1787368241.780554:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788633344 00000100:00100000:1.0:1787368241.780774:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:1.0:1787368241.780785:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18419:x1874190788633344:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787368241.780982:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18419:x1874190788633344:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 198us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.780990:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 142 00000100:00100000:2.0:1787368241.783875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368241.784070:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788633472 00000100:00100000:1.0:1787368241.784079:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788633472 00000100:00100000:1.0:1787368241.784132:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 143 00000100:00100000:1.0:1787368241.784142:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18419:x1874190788633472:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787368241.784291:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18419:x1874190788633472:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 150us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.784299:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 143 00000100:00100000:0.0:1787368241.787548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368241.787663:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788633600 00000100:00100000:1.0:1787368241.787673:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788633600 00000100:00100000:1.0:1787368241.787779:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:1.0:1787368241.787790:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18431:x1874190788633600:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787368241.787941:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18431:x1874190788633600:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 152us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.787958:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 144 00000100:00100000:0.0:1787368241.789837:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.789912:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788633728 00000100:00100000:3.0:1787368241.789920:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788633728 00000100:00100000:3.0:1787368241.789972:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:3.0:1787368241.789982:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18431:x1874190788633728:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787368241.790106:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18431:x1874190788633728:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 125us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.790113:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:3.0:1787368241.792961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.793004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368241.793107:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788633856 00000100:00100000:0.0:1787368241.793116:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788633856 00000100:00100000:0.0:1787368241.793156:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788634112 00000100:00100000:0.0:1787368241.793159:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788634112 00000100:00100000:0.0:1787368241.793184:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1787368241.793192:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874190788633856:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787368241.793220:0:22878:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9ab70352-efce-480e-a808-993671ad30dd@192.168.203.4@tcp t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:0.0:1787368241.793255:0:22878:0:(genops.c:1385:class_connect()) connect: client 9ab70352-efce-480e-a808-993671ad30dd, cookie 0x66f5679bff0329b5 00000004:00100000:0.0:1787368241.793278:0:22878:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787368241.793390:0:22878:0:(import.c:65:import_set_state_nolock()) ffff9c5483e5a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368241.793456:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab70352-efce-480e-a808-993671ad30dd+6:2401:x1874190788633856:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 263us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368241.793464:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:0.0:1787368241.793482:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1787368241.793486:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874190788634112:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787368241.793501:0:22878:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9ab70352-efce-480e-a808-993671ad30dd@192.168.203.4@tcp t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:0.0:1787368241.793524:0:22878:0:(genops.c:1385:class_connect()) connect: client 9ab70352-efce-480e-a808-993671ad30dd, cookie 0x66f5679bff0329bc 00000004:00100000:0.0:1787368241.793537:0:22878:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787368241.793580:0:22878:0:(import.c:65:import_set_state_nolock()) ffff9c5483528800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787368241.793605:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab70352-efce-480e-a808-993671ad30dd+6:2401:x1874190788634112:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 116us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368241.793612:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1787368241.804323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368241.804398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368241.804477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.814714:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788634368 00000100:00100000:3.0:1787368241.814756:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788634368 00000100:00100000:3.0:1787368241.817256:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788634240 00000100:00100000:3.0:1787368241.817268:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788634240 00000100:00100000:3.0:1787368241.817293:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788633984 00000100:00100000:3.0:1787368241.817296:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788633984 00000100:00100000:3.0:1787368241.817315:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1787368241.817324:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+7:18419:x1874190788634368:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787368241.817376:0:22879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787368241.817450:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+7:18419:x1874190788634368:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 126us (13136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.817458:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1787368241.817476:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1787368241.817482:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+6:0:x1874190788634240:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787368241.817497:0:22879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787368241.817525:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+6:0:x1874190788634240:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 43us (13127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.817531:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1787368241.817542:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:3.0:1787368241.817549:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+6:0:x1874190788633984:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787368241.817558:0:22879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787368241.817589:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+6:0:x1874190788633984:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 40us (13111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.817596:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00080000:0.0:1787368241.818501:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787368241.818506:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787368241.822751:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.822898:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788634496 00000100:00100000:3.0:1787368241.822907:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788634496 00000100:00100000:3.0:1787368241.822968:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:3.0:1787368241.822992:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+6:18419:x1874190788634496:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787368241.823076:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+6:18419:x1874190788634496:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 85us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.823084:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:3.0:1787368241.824816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368241.824998:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788634880 00000100:00100000:2.0:1787368241.825006:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788634880 00000100:00100000:2.0:1787368241.825057:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1787368241.825067:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9ab70352-efce-480e-a808-993671ad30dd+6:18419:x1874190788634880:12345-192.168.203.4@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787368241.825140:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9ab70352-efce-480e-a808-993671ad30dd+6:18419:x1874190788634880:12345-192.168.203.4@tcp:900:mount.lustre.0 Request processed in 74us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368241.825148:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:0.0:1787368241.827956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368241.827997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368241.828087:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788634624 00000100:00100000:1.0:1787368241.828096:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788634624 00000100:00100000:1.0:1787368241.828136:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788634752 00000100:00100000:1.0:1787368241.828139:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788634752 00000100:00100000:1.0:1787368241.828161:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1787368241.828169:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874190788634624:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787368241.828200:0:24384:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9ab70352-efce-480e-a808-993671ad30dd@192.168.203.4@tcp t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:1.0:1787368241.828227:0:24384:0:(genops.c:1385:class_connect()) connect: client 9ab70352-efce-480e-a808-993671ad30dd, cookie 0x66f5679bff0329c3 00002000:00100000:1.0:1787368241.828237:0:24384:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9ab70352-efce-480e-a808-993671ad30dd/ffff9c5483f86000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787368241.828246:0:24384:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787368241.828304:0:24384:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787368241.828330:0:24384:0:(import.c:65:import_set_state_nolock()) ffff9c5483f86800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368241.828410:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ab70352-efce-480e-a808-993671ad30dd+6:2401:x1874190788634624:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 240us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.828417:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1787368241.828433:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1787368241.828437:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874190788634752:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787368241.828450:0:24384:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9ab70352-efce-480e-a808-993671ad30dd@192.168.203.4@tcp t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:1.0:1787368241.828465:0:24384:0:(genops.c:1385:class_connect()) connect: client 9ab70352-efce-480e-a808-993671ad30dd, cookie 0x66f5679bff0329ca 00002000:00100000:1.0:1787368241.828470:0:24384:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9ab70352-efce-480e-a808-993671ad30dd/ffff9c5481b3a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787368241.828476:0:24384:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787368241.828510:0:24384:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787368241.828525:0:24384:0:(import.c:65:import_set_state_nolock()) ffff9c559367f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787368241.828564:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ab70352-efce-480e-a808-993671ad30dd+6:2401:x1874190788634752:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 125us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368241.828570:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000001:00100000:2.0:1787368241.833800:0:25200:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ab70352-efce-480e-a808-993671ad30dd 00000001:00100000:2.0:1787368241.833813:0:25200:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0376d49e-ddfe-46c2-91e5-49eaeca90b82 00000001:00080000:2.0:1787368241.833821:0:25200:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:0.0:1787368241.842418:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368241.842520:0:22882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788635008 00000100:00100000:3.0:1787368241.842528:0:22882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788635008 00000100:00100000:3.0:1787368241.842592:0:22882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1787368241.842602:0:22882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ab70352-efce-480e-a808-993671ad30dd+6:18419:x1874190788635008:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787368241.842687:0:22882:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787368241.842778:0:22882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ab70352-efce-480e-a808-993671ad30dd+6:18419:x1874190788635008:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 177us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368241.842786:0:22882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1787368242.024972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368242.025130:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788635136 00000100:00100000:2.0:1787368242.025154:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788635136 00000100:00100000:2.0:1787368242.025217:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1787368242.025228:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab70352-efce-480e-a808-993671ad30dd+6:18454:x1874190788635136:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:2.0:1787368242.025247:0:22880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368242.025269:0:22880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff0329d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee28 expref: -99 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368242.025341:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368242.025392:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368242.025406:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368242.025789:0:22880:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787368242.025793:0:22880:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368242.025817:0:22880:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368242.025843:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff0329d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee28 expref: 8 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368242.025861:0:22880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee28 expref: 7 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368242.025871:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55bc700000) 00010000:00010000:2.0:1787368242.025874:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787368242.025877:0:22880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67fe00, rc 0) 00000100:00100000:2.0:1787368242.026057:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab70352-efce-480e-a808-993671ad30dd+7:18454:x1874190788635136:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 830us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368242.026065:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00010000:00010000:3.0:1787368242.072708:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368243.097536:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368243.608644:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808655872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787368243.608732:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368243.608841:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808655872 00000100:00100000:2.0:1787368243.608850:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808655872 00000100:00080000:0.0:1787368243.608951:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368243.614248:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787368243.614279:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808655872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787368243.614313:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787368243.614419:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808655872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368243.614427:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787368243.615081:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808655872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787368244.121883:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808656000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787368244.121953:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368244.122412:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787368244.122430:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808656128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368244.122469:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787368244.122577:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368244.123657:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808656000 00000100:00100000:1.0:1787368244.123666:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808656000 00000100:00100000:1.0:1787368244.123714:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808656128 00000100:00100000:1.0:1787368244.123717:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808656128 00000100:00100000:1.0:1787368244.123743:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787368244.123751:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808656000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787368244.123784:0:23621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787368244.123851:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808656000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368244.123858:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787368244.123872:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787368244.123878:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808656128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787368244.123892:0:23621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787368244.123923:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808656128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368244.123928:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787368244.123966:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808656128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368244.125524:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808656000:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787368244.572048:0:25757:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787368244.632757:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808656256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787368244.632831:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368244.632950:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808656256 00000100:00100000:3.0:1787368244.632959:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808656256 00000100:00100000:3.0:1787368244.633016:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787368244.633025:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808656256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787368244.633049:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787368244.633096:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808656256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368244.633103:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787368244.633194:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808656256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787368244.633463:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787368245.147008:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787368245.660110:0:24380:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ab70352-efce-480e-a808-993671ad30dd 00000001:00100000:0.0:1787368245.660124:0:24380:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0376d49e-ddfe-46c2-91e5-49eaeca90b82 00000001:00100000:2.0:1787368245.661121:0:22858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9ab70352-efce-480e-a808-993671ad30dd 00000001:00100000:2.0:1787368245.661130:0:22858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0376d49e-ddfe-46c2-91e5-49eaeca90b82 00000001:00100000:0.0:1787368245.663548:0:23611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9ab70352-efce-480e-a808-993671ad30dd 00000001:00100000:0.0:1787368245.663564:0:23611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0376d49e-ddfe-46c2-91e5-49eaeca90b82 00010000:00010000:2.0:1787368246.168507:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368246.680829:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808656384:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.680898:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.680947:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808656896:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.680974:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.680992:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808657408:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.681012:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.681027:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808657920:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.681050:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.681072:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787368246.681077:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808656512:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.681100:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.681117:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808657024:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.681138:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.681155:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808657536:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.681176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.681206:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808656640:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.681230:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368246.682488:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787368246.682503:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808658048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787368246.682575:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808657152:0@lo:400:kworker.0 00000040:00080000:3.0:1787368246.682683:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787368246.682755:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808656896 00000100:00100000:3.0:1787368246.682762:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808656896 00000100:00100000:3.0:1787368246.682796:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808657408 00000100:00100000:3.0:1787368246.682800:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808657408 00000100:00100000:3.0:1787368246.682811:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808657920 00000100:00100000:3.0:1787368246.682814:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808657920 00000100:00100000:3.0:1787368246.682836:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808657536 00000100:00100000:3.0:1787368246.682839:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808657536 00000100:00100000:3.0:1787368246.682854:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787368246.682863:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808656896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368246.684021:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368246.684149:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808658048 00000100:00100000:2.0:1787368246.684156:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808658048 00000100:00100000:2.0:1787368246.684208:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787368246.684219:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808658048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787368246.684253:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787368246.684301:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808658048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368246.684320:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787368246.684503:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787368246.684508:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787368246.684510:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787368246.684635:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808658048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787368246.684837:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808656512 00000100:00100000:0.0:1787368246.684842:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808656512 00000100:00100000:1.0:1787368246.684935:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.684960:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808657664:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.684987:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.685003:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808658176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787368246.685037:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.685055:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787368246.685061:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808656768:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.685080:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.685095:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808657280:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.685113:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368246.685128:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808657792:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.685146:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368246.685184:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808657024 00000100:00100000:0.0:1787368246.685188:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808657024 00000100:00100000:3.0:1787368246.685279:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808656896:12345-0@lo:400:kworker.0 Request processed in 2416us (4302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685288:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787368246.685305:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808657664 00000100:00100000:3.0:1787368246.685308:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808657664 00000100:00100000:3.0:1787368246.685328:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808657792 00000100:00100000:3.0:1787368246.685330:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808657792 00000100:00100000:3.0:1787368246.685343:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787368246.685350:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808657408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.685406:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808657408:12345-0@lo:400:kworker.0 Request processed in 46us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685413:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787368246.685425:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787368246.685430:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808657920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.685456:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808657920:12345-0@lo:400:kworker.0 Request processed in 27us (4406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685462:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787368246.685473:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787368246.685486:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808657536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.685515:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808657536:12345-0@lo:400:kworker.0 Request processed in 30us (4338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685521:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787368246.685533:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787368246.685538:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808657664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.685567:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874190808657664:12345-0@lo:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685573:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787368246.685582:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787368246.685588:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808657792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.685622:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874190808657792:12345-0@lo:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685628:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787368246.685646:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808656640 00000100:00100000:3.0:1787368246.685649:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808656640 00000100:00100000:3.0:1787368246.685666:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808657152 00000100:00100000:3.0:1787368246.685669:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808657152 00000100:00100000:3.0:1787368246.685679:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808656768 00000100:00100000:3.0:1787368246.685681:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808656768 00000100:00100000:3.0:1787368246.685690:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808657280 00000100:00100000:3.0:1787368246.685692:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808657280 00000100:00100000:3.0:1787368246.685710:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368246.685717:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808656640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.685745:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808656640:12345-0@lo:400:kworker.0 Request processed in 29us (4514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685750:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787368246.685769:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368246.685775:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808657152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.685803:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808657152:12345-0@lo:400:kworker.0 Request processed in 29us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685809:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787368246.685819:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787368246.685825:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808656768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.685849:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808656768:12345-0@lo:400:kworker.0 Request processed in 24us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685855:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787368246.685866:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787368246.685871:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808657280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.685894:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808657280:12345-0@lo:400:kworker.0 Request processed in 24us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.685900:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787368246.685913:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787368246.685916:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787368246.685918:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787368246.685920:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787368246.685988:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808657536:0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.686000:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808656896:0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.686009:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808657408:0@lo:400:kworker.0 00010000:00080000:3.0:1787368246.686022:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c5483ced180 x1874190808657920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787368246.686032:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808657920:0@lo:400:kworker.0 00000100:00100000:2.0:1787368246.686324:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787368246.686333:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808656512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368246.686420:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808656512:12345-0@lo:400:kworker.0 Request processed in 89us (5319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368246.686427:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787368246.686442:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787368246.686449:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54822c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808657024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368246.686477:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54822c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808657024:12345-0@lo:400:kworker.0 Request processed in 29us (5338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368246.686482:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787368246.686817:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808656512:0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.686829:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808657024:0@lo:400:kworker.0 00000100:00100000:3.0:1787368246.688451:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808658176 00000100:00100000:3.0:1787368246.688463:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808658176 00000100:00100000:3.0:1787368246.688516:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787368246.688525:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b5074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808658176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787368246.688545:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787368246.688605:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b5074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808658176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368246.688743:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787368246.690428:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1787368246.690453:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808656768:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.690469:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808657280:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.690481:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874190808657792:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.690500:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808658176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787368246.690512:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808656640:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.690523:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808657152:0@lo:400:kworker.0 00010000:00080000:1.0:1787368246.690536:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c54845b0e00 x1874190808657664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787368246.690546:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874190808657664:0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.691846:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808656384 00000100:00100000:1.0:1787368246.691858:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808656384 00000100:00100000:1.0:1787368246.691903:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787368246.691913:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3651:x1874190808656384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368246.692006:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3651:x1874190808656384:12345-0@lo:400:kworker.0 Request processed in 94us (11108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368246.692015:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787368246.692069:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808656384:0@lo:400:kworker.0 00000100:00100000:0.0:1787368247.094795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.094839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.094862:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.094879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.094895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.094929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.094959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.094976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.094998:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.095036:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788635520 00000100:00100000:0.0:1787368247.095046:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788635520 00000100:00100000:0.0:1787368247.095095:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788636032 00000100:00100000:0.0:1787368247.095099:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788636032 00000100:00100000:0.0:1787368247.095114:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788635392 00000100:00100000:0.0:1787368247.095116:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788635392 00000100:00100000:0.0:1787368247.095130:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788635904 00000100:00100000:0.0:1787368247.095132:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788635904 00000100:00100000:0.0:1787368247.095145:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1787368247.095154:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2405:x1874190788635520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368247.095218:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2405:x1874190788635520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 65us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368247.095226:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1787368247.095242:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:0.0:1787368247.095248:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+5:2405:x1874190788636032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368247.095271:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+5:2405:x1874190788636032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368247.095277:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:0.0:1787368247.095288:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1787368247.095293:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:2405:x1874190788635392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368247.095316:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:2405:x1874190788635392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368247.095321:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1787368247.095340:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1787368247.095346:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+6:2405:x1874190788635904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368247.095443:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788635264 00000100:00100000:3.0:1787368247.095447:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788635264 00000100:00100000:3.0:1787368247.095474:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:3.0:1787368247.095479:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+13:2405:x1874190788635264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368247.095502:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+13:2405:x1874190788635264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368247.095509:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 147 00000100:00100000:3.0:1787368247.095537:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788635776 00000100:00100000:3.0:1787368247.095540:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788635776 00000100:00100000:3.0:1787368247.095557:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788636288 00000100:00100000:3.0:1787368247.095559:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788636288 00000100:00100000:3.0:1787368247.095568:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788635648 00000100:00100000:3.0:1787368247.095570:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788635648 00000100:00100000:3.0:1787368247.095591:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788636160 00000100:00100000:3.0:1787368247.095594:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788636160 00000100:00100000:3.0:1787368247.095606:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1787368247.095611:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2405:x1874190788635776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368247.095652:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2405:x1874190788635776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368247.095659:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1787368247.095670:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:3.0:1787368247.095676:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ab70352-efce-480e-a808-993671ad30dd+5:2405:x1874190788636288:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368247.095695:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ab70352-efce-480e-a808-993671ad30dd+5:2405:x1874190788636288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368247.095711:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:3.0:1787368247.095722:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:3.0:1787368247.095729:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2405:x1874190788635648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368247.095750:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2405:x1874190788635648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368247.095756:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:3.0:1787368247.095767:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1787368247.095773:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ab70352-efce-480e-a808-993671ad30dd+5:2405:x1874190788636160:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368247.095794:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9ab70352-efce-480e-a808-993671ad30dd+5:2405:x1874190788636160:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368247.095800:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00080000:3.0:1787368247.095826:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787368247.095830:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787368247.095832:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787368247.095834:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787368247.096342:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+6:2405:x1874190788635904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 993us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368247.096350:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00010000:00010000:1.0:1787368247.196907:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787368247.539135:0:25904:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd979b92f0 20000000:00000080:1.0:1787368247.539153:0:25904:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c55a8eca800 uarg=0000000000000000 20000000:01000000:1.0:1787368247.539192:0:25904:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787368247.539198:0:25904:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787368247.539202:0:25904:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787368247.541487:0:25905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1787368247.541662:0:25904:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787368247.552571:0:25904:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787368247.552604:0:25904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552622:0:25904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03263c expref: 23 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552630:0:25904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff03264a expref: 23 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552637:0:25904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032689 expref: 23 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552644:0:25904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032803 expref: 23 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552653:0:25904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed87 expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552681:0:25904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf7 expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552687:0:25904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552742:0:25904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf7 expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552758:0:25904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf7 expref: 12 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368247.552773:0:25904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658304:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368247.552882:0:25904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed87 expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552890:0:25904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed87 expref: 12 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368247.552899:0:25904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658432:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368247.552933:0:25904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff032803 expref: 23 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.552942:0:25904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff032803 expref: 23 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368247.552950:0:25904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658560:0@lo:104: 00000100:00100000:1.0:1787368247.552990:0:25904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787368247.553038:0:25904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff032689 expref: 23 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.553046:0:25904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff032689 expref: 23 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368247.553055:0:25904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658688:0@lo:104: 00000100:00100000:1.0:1787368247.553076:0:25904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787368247.553114:0:25904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03264a expref: 23 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.553122:0:25904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03264a expref: 23 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368247.553130:0:25904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658816:0@lo:104: 00000100:00100000:1.0:1787368247.553151:0:25904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787368247.553167:0:25904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x66f5679bff03263c expref: 23 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368247.553174:0:25904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x66f5679bff03263c expref: 23 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368247.553181:0:25904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc691f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658944:0@lo:104: 00000100:00100000:1.0:1787368247.553199:0:25904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368247.553208:0:25904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6a49780 going to sleep for 11 seconds 00000100:00100000:2.0:1787368247.553305:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808658560 00000100:00100000:2.0:1787368247.553313:0:22861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808658560 00000100:00100000:2.0:1787368247.553350:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808658688 00000100:00100000:2.0:1787368247.553376:0:22861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808658688 00000100:00100000:2.0:1787368247.553389:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808658816 00000100:00100000:2.0:1787368247.553392:0:22861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808658816 00000100:00100000:2.0:1787368247.553400:0:22861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808658944 00000100:00100000:2.0:1787368247.553402:0:22861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808658944 00000100:00100000:2.0:1787368247.553415:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787368247.553423:0:22861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+6:25904:x1874190808658560:12345-0@lo:104: 00010000:00010000:2.0:1787368247.553435:0:22861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553505:0:22861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787368247.553512:0:22861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+6:25904:x1874190808658560:12345-0@lo:104: Request processed in 89us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368247.553521:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787368247.553539:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787368247.553545:0:22861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+5:25904:x1874190808658688:12345-0@lo:104: 00010000:00010000:2.0:1787368247.553552:0:22861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553591:0:22861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787368247.553596:0:22861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+5:25904:x1874190808658688:12345-0@lo:104: Request processed in 52us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368247.553602:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787368247.553614:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368247.553620:0:22861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+4:25904:x1874190808658816:12345-0@lo:104: 00010000:00010000:2.0:1787368247.553627:0:22861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553652:0:22861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787368247.553657:0:22861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+4:25904:x1874190808658816:12345-0@lo:104: Request processed in 38us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368247.553662:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368247.553674:0:22861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368247.553680:0:22861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:25904:x1874190808658944:12345-0@lo:104: 00010000:00010000:2.0:1787368247.553687:0:22861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553734:0:22861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787368247.553739:0:22861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+3:25904:x1874190808658944:12345-0@lo:104: Request processed in 60us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368247.553745:0:22861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787368247.553762:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787368247.553767:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553775:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b613a000 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368247.553779:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368247.553788:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787368247.553788:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368247.553799:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368247.553805:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787368247.553847:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553854:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787368247.553877:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553884:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55b613a000/0x66f5679bff032803 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff03280a expref: -99 pid: 25199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553908:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787368247.553911:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553916:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e74400 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368247.553919:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553925:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368247.553931:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368247.553936:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787368247.553960:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553966:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787368247.553982:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553988:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e74400/0x66f5679bff03264a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032651 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.553998:0:22867:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368247.554001:0:22867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.554015:0:22867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55814a0400 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368247.554018:0:22867:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.554025:0:22867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368247.554030:0:22867:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368247.554035:0:22867:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787368247.554061:0:22867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.554067:0:22867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787368247.554074:0:22867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.554080:0:22867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c55814a0400/0x66f5679bff03263c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032643 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.554089:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368247.554091:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368247.554093:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368247.554102:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368247.554113:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808659072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368247.554145:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368247.554191:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808659200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368247.554223:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368247.554243:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787368247.554249:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808659328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368247.554269:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368247.554294:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808659072 00000100:00100000:2.0:1787368247.554298:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808659072 00010000:00010000:2.0:1787368247.554318:0:24032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032803 expref: 24 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368247.554339:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808659200 00000100:00100000:2.0:1787368247.554342:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808659200 00010000:00010000:2.0:1787368247.554374:0:24032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03264a expref: 25 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368247.554390:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808659328 00000100:00100000:2.0:1787368247.554393:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808659328 00010000:00010000:2.0:1787368247.554406:0:24032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03263c expref: 26 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368247.554418:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787368247.554425:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+26:3653:x1874190808659072:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368247.554431:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787368247.554436:0:24032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368247.554445:0:24032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032803 expref: 26 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.554455:0:24032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff032803 expref: 26 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368247.554460:0:22863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+26:3651:x1874190808659200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787368247.554474:0:22863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368247.554477:0:24032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787368247.554481:0:22863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03264a expref: 26 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368247.554494:0:22863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03264a expref: 26 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368247.554507:0:22863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368247.554513:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+26:3653:x1874190808659072:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368247.554528:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787368247.554553:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787368247.554554:0:22863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+25:3651:x1874190808659200:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368247.554563:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+25:3651:x1874190808659328:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787368247.554564:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787368247.554577:0:24032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368247.554583:0:24032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff03263c expref: 24 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.554593:0:24032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff03263c expref: 24 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.554603:0:24032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368247.554627:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3651:x1874190808659328:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368247.554633:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787368247.554668:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808659072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368247.554694:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808659328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368247.554714:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3651:1874190808659200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787368247.555072:0:25904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5483e75600/0x66f5679bff03280a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff032803 expref: 23 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368247.555085:0:25904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658560:0@lo:104: 00000100:00100000:1.0:1787368247.555095:0:25904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658688:0@lo:104: 00010000:00010000:1.0:1787368247.555128:0:25904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241dc00/0x66f5679bff032651 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03264a expref: 22 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368247.555137:0:25904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658816:0@lo:104: 00010000:00010000:1.0:1787368247.555146:0:25904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55814a1800/0x66f5679bff032643 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff03263c expref: 21 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368247.555156:0:25904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc691f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658944:0@lo:104: 00010000:00010000:1.0:1787368247.556051:0:25906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368247.556055:0:25906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368247.556257:0:25906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368247.556845:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.556856:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5483e75a00 already unused, calling callback (ffffffffc114ec20) 10000000:00010000:2.0:1787368247.556860:0:22866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.556870:0:22866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787368247.556892:0:22866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787368247.556897:0:22866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787368247.556939:0:22866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.556945:0:22866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787368247.556960:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.556967:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c5483e75a00/0x66f5679bff032689 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x66f5679bff032690 expref: -99 pid: 24379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.556983:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368247.556986:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368247.556987:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368247.557008:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808659456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787368247.557049:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368247.557092:0:22863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808659456 00000100:00100000:2.0:1787368247.557098:0:22863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808659456 00010000:00010000:2.0:1787368247.557122:0:22863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032689 expref: 21 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368247.557147:0:22863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368247.557156:0:22863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:3653:x1874190808659456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787368247.557168:0:22863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368247.557173:0:22863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x66f5679bff032689 expref: 21 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.557188:0:22863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x66f5679bff032689 expref: 21 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.557201:0:22863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c558241d200/0x66f5679bff032690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x66f5679bff032689 expref: 21 pid: 22873 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.557213:0:22863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368247.557245:0:22863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:3653:x1874190808659456:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368247.557252:0:22863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787368247.557284:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3653:1874190808659456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787368247.559118:0:25904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc693800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658304:192.168.203.4@tcp:104: 00000100:00100000:1.0:1787368247.559133:0:25904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25904:1874190808658432:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368247.559164:0:25904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368247.559471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368247.559550:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368247.559659:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788636416 00000100:00100000:3.0:1787368247.559666:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788636416 00010000:00010000:3.0:1787368247.559771:0:22865:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf7 expref: 13 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368247.559773:0:22864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788636544 00000100:00100000:2.0:1787368247.559779:0:22864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788636544 00010000:00010000:2.0:1787368247.559804:0:22864:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed87 expref: 14 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368247.559809:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1787368247.559824:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483682450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7db1a22-e032-464d-a4cf-1677c572dedf+14:2402:x1874190788636416:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368247.559838:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787368247.559838:0:22864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00010000:00010000:3.0:1787368247.559845:0:22865:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf7 expref: 14 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368247.559865:0:22865:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf7 expref: 14 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368247.559865:0:22864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7db1a22-e032-464d-a4cf-1677c572dedf+14:2403:x1874190788636544:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368247.559879:0:22864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368247.559886:0:22864:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed87 expref: 14 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368247.559890:0:22865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5580030600/0x66f5679bff0329ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edf7 expref: 14 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.559904:0:22864:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed87 expref: 14 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.559916:0:22864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c55bd67e800/0x66f5679bff03296f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ed87 expref: 14 pid: 22871 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.559945:0:22864:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.559953:0:22864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.559966:0:22864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.559974:0:22864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.559987:0:22864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368247.560059:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787368247.560111:0:22864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368247.560120:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483682450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7db1a22-e032-464d-a4cf-1677c572dedf+12:2402:x1874190788636416:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 297us (648us total) trans 0 rc 0/0 00010000:00010000:2.0:1787368247.560125:0:22864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580031c00 already unused, calling callback (ffffffffc0b31420) 00000100:00100000:3.0:1787368247.560131:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00010000:00010000:2.0:1787368247.560131:0:22864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.560144:0:22864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.560162:0:22864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.560173:0:22864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368247.560198:0:22864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7db1a22-e032-464d-a4cf-1677c572dedf+11:2403:x1874190788636544:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 340us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368247.560212:0:22864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00010000:00010000:2.0:1787368247.561459:0:25904:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.561472:0:25904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368247.561478:0:25904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c5580031c00/0x66f5679bff0329df lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.216524:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787368248.611451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.611618:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788636672 00000100:00100000:3.0:1787368248.611628:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788636672 00000100:00100000:3.0:1787368248.611739:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:3.0:1787368248.611750:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:18922:x1874190788636672:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787368248.611770:0:22879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368248.611791:0:22879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673800/0x66f5679bff0329e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee2f expref: -99 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.611867:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.611881:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.611893:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.611907:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.611913:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.611919:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612024:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff0329fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612033:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff0329fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612040:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff0329fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787368248.612076:0:22879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787368248.612080:0:22879:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787368248.612119:0:22879:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff0329fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612138:0:22879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612146:0:22879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612153:0:22879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612159:0:22879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368248.612164:0:22879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612171:0:22879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612182:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55bc700000) 00010000:00010000:3.0:1787368248.612193:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368248.612198:0:22879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612205:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673e00/0x66f5679bff0329ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612220:0:22879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612226:0:22879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612231:0:22879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612236:0:22879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581673000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368248.612239:0:22879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612244:0:22879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612251:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c548221b900) 00010000:00010000:3.0:1787368248.612254:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368248.612256:0:22879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612261:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673000/0x66f5679bff0329f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612295:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673800/0x66f5679bff0329e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee2f expref: 8 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612319:0:22879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672a00/0x66f5679bff0329fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee2f expref: 7 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.612326:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c548221ba00) 00010000:00010000:3.0:1787368248.612328:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787368248.612330:0:22879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672a00, rc 0) 00000100:00100000:3.0:1787368248.612445:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:18922:x1874190788636672:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 696us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.612453:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1787368248.619567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.619653:0:22889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788636800 00000100:00100000:3.0:1787368248.619669:0:22889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788636800 00000100:00100000:3.0:1787368248.619731:0:22889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1787368248.619741:0:22889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:18922:x1874190788636800:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787368248.619819:0:22889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:18922:x1874190788636800:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 Request processed in 80us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.619827:0:22889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1787368248.624778:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368248.625001:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788637056 00000100:00100000:0.0:1787368248.625011:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788637056 00000100:00100000:1.0:1787368248.625336:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1787368248.625348:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:18922:x1874190788637056:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787368248.625399:0:22878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368248.625420:0:22878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff032a02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee36 expref: -99 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625492:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625507:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625533:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625549:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625556:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625562:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625700:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff032a17 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625709:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff032a17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625715:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff032a17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368248.625726:0:22878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787368248.625885:0:22878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625893:0:22878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625899:0:22878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625905:0:22878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368248.625914:0:22878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625922:0:22878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625934:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c548221ba00) 00010000:00010000:1.0:1787368248.625937:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368248.625941:0:22878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625947:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030600/0x66f5679bff032a09 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625959:0:22878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625965:0:22878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625971:0:22878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625976:0:22878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5580030c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368248.625980:0:22878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625985:0:22878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.625992:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c55bc700200) 00010000:00010000:1.0:1787368248.625995:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368248.626003:0:22878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.626009:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030c00/0x66f5679bff032a10 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.627911:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580031c00/0x66f5679bff032a02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee36 expref: 10 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.627936:0:22878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030e00/0x66f5679bff032a17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee36 expref: 9 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.627945:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55bc700700) 00010000:00010000:1.0:1787368248.627948:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368248.627951:0:22878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5580030e00, rc 0) 00000100:00100000:1.0:1787368248.628493:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:18922:x1874190788637056:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 3144us (3722us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787368248.628504:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1787368248.631128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368248.631636:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788637184 00000100:00100000:0.0:1787368248.631647:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788637184 00000100:00100000:0.0:1787368248.631887:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:0.0:1787368248.631899:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:18922:x1874190788637184:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787368248.632004:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:18922:x1874190788637184:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 107us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368248.632013:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:0.0:1787368248.640269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368248.640398:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788637312 00000100:00100000:1.0:1787368248.640407:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788637312 00000100:00100000:1.0:1787368248.640455:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1787368248.640466:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:18922:x1874190788637312:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1787368248.648492:0:24580:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7985us 00000100:00100000:1.0:1787368248.657681:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:18922:x1874190788637312:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 17207us (17411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368248.657707:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 10000000:01000000:2.0:1787368248.664586:0:22875:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787368248.664594:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5481b38000 from 13 10000000:01000000:2.0:1787368248.664599:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787368248.664641:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff032a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.664652:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff032a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.665118:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff032a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368248.665145:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808659584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787368248.665434:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368248.665479:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787368248.665495:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808659584 00000100:00100000:3.0:1787368248.665501:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808659584 00000100:00100000:3.0:1787368248.665561:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787368248.665570:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+20:22875:x1874190808659584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368248.665583:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368248.665597:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673800/0x66f5679bff032a2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032a25 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.665619:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673800/0x66f5679bff032a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032a25 expref: 21 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.665644:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673800/0x66f5679bff032a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032a25 expref: 21 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.665652:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673800, rc 0) 00000100:00100000:3.0:1787368248.666324:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:22875:x1874190808659584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 753us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.666333:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787368248.666697:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808659584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368248.666715:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff032a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a2c expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.666739:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff032a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032a2c expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368248.666819:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808659712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368248.667025:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368248.667061:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787368248.667117:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808659712 00000100:00100000:0.0:1787368248.667123:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808659712 00000100:00100000:0.0:1787368248.667165:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787368248.667176:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:22875:x1874190808659712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368248.667308:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:22875:x1874190808659712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368248.667316:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787368248.667453:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808659712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.667484:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808659840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.667527:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368248.667548:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495600 going to sleep for 11 seconds 00000100:00100000:3.0:1787368248.667561:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808659840 00000100:00100000:3.0:1787368248.667565:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808659840 00000100:00100000:3.0:1787368248.667588:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787368248.667595:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be9bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:22875:x1874190808659840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.667669:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be9bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:22875:x1874190808659840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.667676:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787368248.667728:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808659840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787368248.668820:0:25919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:1.0:1787368248.669134:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:01000000:1.0:1787368248.670721:0:22875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787368248.670814:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787368248.670827:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff032a25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a2c expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.670838:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bd67fa00/0x66f5679bff032a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a2c expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787368248.670849:0:22875:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787368248.670851:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55b0fa1800 from 13 10000000:01000000:1.0:1787368248.670854:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787368248.670896:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b6727e00/0x66f5679bff032a33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.670905:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55b6727e00/0x66f5679bff032a33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.670915:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55b6727e00/0x66f5679bff032a33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368248.670938:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808659968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787368248.670996:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368248.671041:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6a490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787368248.671156:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808659968 00000100:00100000:0.0:1787368248.671163:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808659968 00000100:00100000:0.0:1787368248.671212:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787368248.671221:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+21:22875:x1874190808659968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368248.671234:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368248.671246:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68b000/0x66f5679bff032a3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032a33 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.671269:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68b000/0x66f5679bff032a3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032a33 expref: 22 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.671279:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68b000/0x66f5679bff032a3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032a33 expref: 22 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.671287:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b000, rc 0) 00000100:00100000:0.0:1787368248.671331:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:22875:x1874190808659968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368248.671337:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787368248.671780:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808659968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787368248.671798:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55b6727e00/0x66f5679bff032a33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a3a expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.671807:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55b6727e00/0x66f5679bff032a33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032a3a expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368248.671868:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787368248.671907:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368248.671981:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6a490c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368248.673978:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788637440 00000100:00100000:2.0:1787368248.673991:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788637440 00000100:00100000:2.0:1787368248.674074:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:2.0:1787368248.674087:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:18928:x1874190788637440:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1787368248.674110:0:22879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368248.674131:0:22879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee3d expref: -99 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674193:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674209:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674220:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674277:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674286:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674313:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674375:0:22879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674383:0:22879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674391:0:22879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674397:0:22879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fc00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368248.674400:0:22879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674407:0:22879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674418:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55bc700000) 00010000:00010000:2.0:1787368248.674421:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368248.674426:0:22879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674432:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674448:0:22879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674455:0:22879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674468:0:22879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674474:0:22879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368248.674477:0:22879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674484:0:22879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674493:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c5598ca1800) 00010000:00010000:2.0:1787368248.674496:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368248.674499:0:22879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674505:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032a4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674539:0:22879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee3d expref: 10 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674550:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55bc700000) 00010000:00010000:2.0:1787368248.674553:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368248.674557:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee3d expref: 10 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.674568:0:22879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f800, rc 0) 00000100:00100000:2.0:1787368248.674628:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:18928:x1874190788637440:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 545us (5497us total) trans 0 rc 301/301 00000100:00100000:2.0:1787368248.674645:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1787368248.676060:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808660096 00000100:00100000:0.0:1787368248.676071:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808660096 00000100:00100000:0.0:1787368248.676118:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787368248.676127:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:22875:x1874190808660096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368248.676419:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:22875:x1874190808660096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (4509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368248.676427:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787368248.676815:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368248.676866:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787368248.676922:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368248.676959:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b613e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787368248.677136:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808660224 00000100:00100000:3.0:1787368248.677142:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808660224 00000100:00100000:3.0:1787368248.677182:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787368248.677190:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:22875:x1874190808660224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.677282:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:22875:x1874190808660224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.677289:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787368248.677337:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787368248.678312:0:25920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787368248.678638:0:22875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787368248.678672:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787368248.678683:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55b6727e00/0x66f5679bff032a33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a3a expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.678704:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55b6727e00/0x66f5679bff032a33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a3a expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787368248.678714:0:22875:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787368248.678716:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c5483678000 from 13 10000000:01000000:3.0:1787368248.678719:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787368248.678928:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff032a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.678938:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff032a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.678949:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff032a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368248.678972:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.679026:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368248.679111:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495600 going to sleep for 11 seconds 00000100:00100000:0.0:1787368248.681950:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808660352 00000100:00100000:0.0:1787368248.681964:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808660352 00000100:00100000:0.0:1787368248.682078:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787368248.682089:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+22:22875:x1874190808660352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787368248.682104:0:22873:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368248.682122:0:22873:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bc68be00/0x66f5679bff032a5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032a56 expref: -99 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.682149:0:22873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bc68be00/0x66f5679bff032a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032a56 expref: 23 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.682160:0:22873:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bc68be00/0x66f5679bff032a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032a56 expref: 23 pid: 22873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.682170:0:22873:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68be00, rc 0) 00000100:00100000:0.0:1787368248.682241:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808660352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (3215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368248.682248:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787368248.682323:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368248.682374:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff032a56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a5d expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.682384:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff032a56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032a5d expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368248.682458:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.682493:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368248.682532:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495600 going to sleep for 11 seconds 00000100:00100000:0.0:1787368248.682580:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808660480 00000100:00100000:0.0:1787368248.682584:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808660480 00000100:00100000:0.0:1787368248.682639:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787368248.682646:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808660480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368248.682727:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368248.682783:0:22887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788637568 00000100:00100000:0.0:1787368248.682784:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808660480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368248.682790:0:22887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788637568 00000100:00100000:0.0:1787368248.682795:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787368248.682952:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.682982:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.683023:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368248.683037:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55bd495600 going to sleep for 11 seconds 00000100:00100000:3.0:1787368248.683048:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808660608 00000100:00100000:3.0:1787368248.683052:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808660608 00000100:00100000:3.0:1787368248.683070:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787368248.683076:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808660608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.683152:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808660608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.683159:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787368248.683196:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.683426:0:22888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1787368248.683434:0:22888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:18928:x1874190788637568:12345-192.168.203.4@tcp:700:lfs.0 00000100:00100000:3.0:1787368248.683493:0:22888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:18928:x1874190788637568:12345-192.168.203.4@tcp:700:lfs.0 Request processed in 59us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.683506:0:22888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1787368248.687684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368248.687777:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788637824 00000100:00100000:0.0:1787368248.687792:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788637824 00000100:00100000:1.0:1787368248.687920:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:1.0:1787368248.687933:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:18928:x1874190788637824:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1787368248.687989:0:24580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368248.688015:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5580030000/0x66f5679bff032999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2edb8 expref: 9 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.688033:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55bc700000) 00010000:00010000:1.0:1787368248.688037:0:24580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787368248.688094:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.688108:0:24580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee28 expref: 5 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.688118:0:24580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.688149:0:24580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee28 expref: 5 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.688164:0:24580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee28 expref: 5 pid: 22880 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368248.688177:0:24580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc692680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24580:1874190808660736:192.168.203.4@tcp:104: 00000040:00080000:3.0:1787368248.688225:0:25921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:1.0:1787368248.688263:0:24580:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6a499c0 going to sleep for 11 seconds 00000020:01000000:0.0:1787368248.688666:0:22875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787368248.688704:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787368248.688713:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff032a56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a5d expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.688723:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c5581673000/0x66f5679bff032a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a5d expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787368248.688735:0:22875:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787368248.688738:0:22875:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c55acbc7800 from 13 10000000:01000000:0.0:1787368248.688740:0:22875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787368248.688760:0:22875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b800/0x66f5679bff032a6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.688768:0:22875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b800/0x66f5679bff032a6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.688776:0:22875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b800/0x66f5679bff032a6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368248.688791:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787368248.688827:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368248.688960:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787368248.688980:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808660864 00000100:00100000:3.0:1787368248.688988:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808660864 00000100:00100000:3.0:1787368248.689031:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787368248.689039:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+23:22875:x1874190808660864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368248.689049:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368248.689062:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673e00/0x66f5679bff032a72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x66f5679bff032a6b expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.689080:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673e00/0x66f5679bff032a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x66f5679bff032a6b expref: 24 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.689091:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673e00/0x66f5679bff032a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x66f5679bff032a6b expref: 24 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.689098:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673e00, rc 0) 00000100:00100000:3.0:1787368248.689147:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:22875:x1874190808660864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.689154:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787368248.691662:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.691744:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788637952 00000100:00100000:3.0:1787368248.691753:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788637952 00000100:00100000:2.0:1787368248.691791:0:24580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc692680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24580:1874190808660736:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368248.691792:0:22865:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee28 expref: 6 pid: 22880 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.691821:0:24580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368248.691840:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:3.0:1787368248.691852:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ab70352-efce-480e-a808-993671ad30dd+6:2402:x1874190788637952:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368248.691882:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368248.691889:0:22865:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee28 expref: 6 pid: 22880 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.691902:0:22865:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee28 expref: 6 pid: 22880 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.691923:0:22865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff0329d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee28 expref: 6 pid: 22880 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.691938:0:22865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55bc700000) 00010000:00010000:3.0:1787368248.691943:0:22865:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.691951:0:22865:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.691959:0:22865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.691989:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787368248.692021:0:24580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.692030:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368248.692038:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ab70352-efce-480e-a808-993671ad30dd+5:2402:x1874190788637952:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 188us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.692047:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00010000:00010000:2.0:1787368248.692054:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.692065:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.692074:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368248.697876:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368248.697906:0:22875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b800/0x66f5679bff032a6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a72 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.697920:0:22875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b800/0x66f5679bff032a6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x66f5679bff032a72 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368248.698040:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368248.698102:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368248.698144:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077900 going to sleep for 11 seconds 00010000:00010000:1.0:1787368248.698339:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698392:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698403:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787368248.698420:0:24580:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0eb679d reply state 00000000dddfb87d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698432:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698439:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:1.0:1787368248.698442:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787368248.698446:0:24580:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787368248.698452:0:24580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787368248.698460:0:24580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698466:0:24580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698473:0:24580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698479:0:24580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6727800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368248.698484:0:24580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698491:0:24580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698510:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c55bc700000) 00010000:00010000:1.0:1787368248.698512:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368248.698516:0:24580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698522:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032a64 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787368248.698540:0:24580:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0eb679d reply state 00000000dddfb87d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698548:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.698553:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c5598ca1800) 00010000:00010000:1.0:1787368248.698556:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787368248.698558:0:24580:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787368248.698641:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+10:18928:x1874190788637824:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 10709us (10964us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787368248.698650:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:3.0:1787368248.699867:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808660992 00000100:00100000:3.0:1787368248.699878:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808660992 00000100:00100000:3.0:1787368248.699931:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787368248.699939:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:22875:x1874190808660992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.700082:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:22875:x1874190808660992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.700099:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787368248.701132:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808660992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787368248.701185:0:22875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808661120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787368248.701244:0:22875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368248.701286:0:22875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077900 going to sleep for 11 seconds 00000100:00100000:0.0:1787368248.701869:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808661120 00000100:00100000:0.0:1787368248.701876:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808661120 00000100:00100000:0.0:1787368248.701921:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787368248.701932:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:22875:x1874190808661120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787368248.702055:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:22875:x1874190808661120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368248.702069:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787368248.702165:0:22875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:22875:1874190808661120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787368248.704787:0:25922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787368248.704991:0:22875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787368248.705015:0:22875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787368248.705026:0:22875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b800/0x66f5679bff032a6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a72 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.705038:0:22875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c55bc68b800/0x66f5679bff032a6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x66f5679bff032a72 expref: -99 pid: 22875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368248.729642:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787368248.729676:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bc690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808661248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787368248.729760:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368248.729962:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808661248 00000100:00100000:0.0:1787368248.729969:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808661248 00000100:00100000:0.0:1787368248.730019:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787368248.730029:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808661248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787368248.730056:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787368248.730109:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874190808661248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368248.730117:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787368248.730136:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368248.730178:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bc690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874190808661248:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1787368248.730389:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787368248.798291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368248.798489:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788638080 00000100:00100000:2.0:1787368248.798500:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788638080 00000100:00100000:2.0:1787368248.798566:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1787368248.798588:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+10:18936:x1874190788638080:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:2.0:1787368248.798626:0:22879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368248.798648:0:22879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee44 expref: -99 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.798722:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff032a8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.798736:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff032a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.798902:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff032a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368248.798947:0:22879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787368248.798950:0:22879:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368248.798985:0:22879:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff032a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.799009:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032a87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee44 expref: 12 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.799026:0:22879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f600/0x66f5679bff032a8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee44 expref: 11 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.799033:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1e00) 00010000:00010000:2.0:1787368248.799036:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787368248.799038:0:22879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f600, rc 0) 00000100:00100000:2.0:1787368248.799095:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+11:18936:x1874190788638080:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 521us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368248.799102:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1787368248.822096:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368248.822722:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788638208 00000100:00100000:0.0:1787368248.822734:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788638208 00000100:00100000:0.0:1787368248.822867:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1787368248.822879:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab70352-efce-480e-a808-993671ad30dd+5:18937:x1874190788638208:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368248.822902:0:22878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368248.822925:0:22878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032a95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee4b expref: -99 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.822988:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff032a9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.823003:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff032a9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.823016:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff032a9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368248.823061:0:22878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787368248.823078:0:22878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787368248.823103:0:22878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff032a9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.823129:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032a95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee4b expref: 7 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.823148:0:22878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b400/0x66f5679bff032a9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee4b expref: 6 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.823158:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1e00) 00010000:00010000:0.0:1787368248.823161:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787368248.823165:0:22878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b400, rc 0) 00000100:00100000:0.0:1787368248.823234:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab70352-efce-480e-a808-993671ad30dd+6:18937:x1874190788638208:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 357us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368248.823243:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1787368248.830024:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368248.830093:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788638336 00000100:00100000:1.0:1787368248.830104:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788638336 00000100:00100000:1.0:1787368248.830209:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1787368248.830221:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab70352-efce-480e-a808-993671ad30dd+6:18937:x1874190788638336:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787368248.830242:0:22880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368248.830262:0:22880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032aa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee52 expref: -99 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830377:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830395:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830409:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830422:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830441:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830449:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830525:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032ab8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830532:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032ab8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830538:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032ab8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368248.830572:0:22880:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787368248.830576:0:22880:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787368248.830594:0:22880:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032ab8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830616:0:22880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830621:0:22880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830627:0:22880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830633:0:22880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6727a00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368248.830637:0:22880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830644:0:22880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830724:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1e00) 00010000:00010000:1.0:1787368248.830732:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368248.830737:0:22880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830743:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032aaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830757:0:22880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830763:0:22880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830769:0:22880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830782:0:22880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6726000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368248.830785:0:22880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830791:0:22880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830806:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c5598ca1800) 00010000:00010000:1.0:1787368248.830808:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368248.830811:0:22880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830817:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032ab1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830844:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727800/0x66f5679bff032aa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee52 expref: 8 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830863:0:22880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032ab8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee52 expref: 7 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.830870:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:1.0:1787368248.830872:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787368248.830875:0:22880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b6726600, rc 0) 00000100:00100000:1.0:1787368248.830996:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab70352-efce-480e-a808-993671ad30dd+7:18937:x1874190788638336:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 776us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368248.831005:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:2.0:1787368248.834244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.834330:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788638464 00000100:00100000:3.0:1787368248.834341:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788638464 00000100:00100000:3.0:1787368248.834438:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1787368248.834448:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9ab70352-efce-480e-a808-993671ad30dd+5:18937:x1874190788638464:12345-192.168.203.4@tcp:900:lfs.0 00000100:00100000:3.0:1787368248.834534:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9ab70352-efce-480e-a808-993671ad30dd+5:18937:x1874190788638464:12345-192.168.203.4@tcp:900:lfs.0 Request processed in 87us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.834543:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1787368248.837993:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368248.838093:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788638720 00000100:00100000:1.0:1787368248.838114:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788638720 00000100:00100000:1.0:1787368248.838302:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1787368248.838312:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+7:18937:x1874190788638720:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787368248.838332:0:24580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368248.838352:0:24580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032abf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee59 expref: -99 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368248.838568:0:24580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787368248.838658:0:24580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032abf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee59 expref: 9 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.838674:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1e00) 00010000:00010000:1.0:1787368248.838677:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787368248.838683:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032abf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee59 expref: 9 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368248.838774:0:24580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b6727c00, rc 0) 00000100:00100000:1.0:1787368248.838877:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+8:18937:x1874190788638720:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 566us (892us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1787368248.838885:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1787368248.847971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.848191:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788638976 00000100:00100000:3.0:1787368248.848201:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788638976 00000100:00100000:3.0:1787368248.848297:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:3.0:1787368248.848308:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+8:18937:x1874190788638976:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:3.0:1787368248.848392:0:22879:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368248.848421:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032ab8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee52 expref: 8 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.848452:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:3.0:1787368248.848458:0:22879:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787368248.848480:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.848494:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.848504:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787368248.848723:0:22879:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002c0a510 reply state 000000004bd489ad transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.848743:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.848762:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:3.0:1787368248.848765:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787368248.848768:0:22879:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787368248.848777:0:22879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787368248.849237:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab70352-efce-480e-a808-993671ad30dd+9:18937:x1874190788638976:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 929us (1273us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787368248.849245:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1787368248.854219:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368248.854718:0:22881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788639232 00000100:00100000:0.0:1787368248.854728:0:22881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788639232 00000100:00100000:0.0:1787368248.854968:0:22881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:0.0:1787368248.854980:0:22881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ab70352-efce-480e-a808-993671ad30dd+9:18937:x1874190788639232:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787368248.855214:0:22881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ab70352-efce-480e-a808-993671ad30dd+10:18937:x1874190788639232:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 235us (1002us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787368248.855222:0:22881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1787368248.857921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368248.858228:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788639488 00000100:00100000:1.0:1787368248.858237:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788639488 00000100:00100000:1.0:1787368248.858330:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1787368248.858340:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab70352-efce-480e-a808-993671ad30dd+10:18937:x1874190788639488:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368248.858716:0:22878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368248.858738:0:22878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032ad4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee60 expref: -99 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.858812:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.858850:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.858861:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.858873:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.858879:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.858885:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368248.858981:0:22878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787368248.859044:0:22878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859052:0:22878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859059:0:22878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859064:0:22878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68b200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368248.859068:0:22878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859077:0:22878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859100:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1e00) 00010000:00010000:0.0:1787368248.859103:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368248.859109:0:22878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859115:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859128:0:22878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859133:0:22878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859138:0:22878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859144:0:22878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368248.859146:0:22878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859163:0:22878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859170:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c5598ca1800) 00010000:00010000:0.0:1787368248.859172:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368248.859175:0:22878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859181:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032ae2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859226:0:22878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032ad4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee60 expref: 12 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859236:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1e00) 00010000:00010000:0.0:1787368248.859238:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787368248.859241:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032ad4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee60 expref: 12 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.859249:0:22878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ac00, rc 0) 00000100:00100000:0.0:1787368248.859309:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab70352-efce-480e-a808-993671ad30dd+11:18937:x1874190788639488:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 970us (1396us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1787368248.859317:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1787368248.864703:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368248.864829:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788639616 00000100:00100000:0.0:1787368248.865095:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788639616 00000100:00100000:0.0:1787368248.865260:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1787368248.865272:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab70352-efce-480e-a808-993671ad30dd+11:18937:x1874190788639616:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368248.865298:0:22880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368248.865318:0:22880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032af0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee67 expref: -99 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.865559:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.865582:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.865594:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368248.865636:0:22880:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787368248.865640:0:22880:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787368248.865658:0:22880:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.865683:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032af0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee67 expref: 13 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.865713:0:22880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee67 expref: 12 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368248.865721:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:0.0:1787368248.865724:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787368248.865727:0:22880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68ae00, rc 0) 00000100:00100000:0.0:1787368248.865788:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab70352-efce-480e-a808-993671ad30dd+12:18937:x1874190788639616:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 518us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368248.865796:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:3.0:1787368248.875665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368248.875774:0:22882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788639744 00000100:00100000:1.0:1787368248.875800:0:22882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788639744 00000100:00100000:1.0:1787368248.875869:0:22882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1787368248.875880:0:22882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ab70352-efce-480e-a808-993671ad30dd+12:18937:x1874190788639744:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:2.0:1787368248.882985:0:22882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9ab70352-efce-480e-a808-993671ad30dd+12:18937:x1874190788639744:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 7096us (7317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368248.883000:0:22882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1787368248.883805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.884012:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788639872 00000100:00100000:3.0:1787368248.884020:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788639872 00000100:00100000:3.0:1787368248.884103:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:3.0:1787368248.884113:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+11:18300:x1874190788639872:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787368248.884130:0:22871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368248.884148:0:22871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c5581673200/0x66f5679bff032afe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee6e expref: -99 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.884176:0:22871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c5581673200/0x66f5679bff032afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee6e expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.884188:0:22871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c5581673200/0x66f5679bff032afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee6e expref: 12 pid: 22871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.884198:0:22871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673200, rc 0) 00000100:00100000:3.0:1787368248.884243:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18300:x1874190788639872:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 132us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.884267:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 160 00000100:00100000:0.0:1787368248.885831:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.890178:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788640128 00000100:00100000:3.0:1787368248.890194:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788640128 00000100:00100000:2.0:1787368248.891297:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:2.0:1787368248.891310:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18300:x1874190788640128:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787368248.891716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368248.891800:0:22881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788640256 00000100:00100000:1.0:1787368248.891807:0:22881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788640256 00000100:00100000:1.0:1787368248.891854:0:22881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1787368248.891862:0:22881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6ad4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ab70352-efce-480e-a808-993671ad30dd+12:18937:x1874190788640256:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1787368248.892066:0:22881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6ad4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ab70352-efce-480e-a808-993671ad30dd+13:18937:x1874190788640256:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 204us (350us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1787368248.892076:0:22881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1787368248.892570:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18300:x1874190788640128:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 1261us (6742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368248.892580:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:0.0:1787368248.895299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.895396:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788640384 00000100:00100000:3.0:1787368248.895405:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788640384 00000100:00100000:3.0:1787368248.895492:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:3.0:1787368248.895503:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18300:x1874190788640384:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.895643:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18300:x1874190788640384:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 141us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.895651:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 162 00000100:00100000:0.0:1787368248.899525:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368248.899671:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788640512 00000100:00100000:2.0:1787368248.899680:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788640512 00000100:00100000:2.0:1787368248.899862:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:2.0:1787368248.899873:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc4bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+12:18300:x1874190788640512:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787368248.899890:0:22872:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368248.899909:0:22872:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c55bd67e400/0x66f5679bff032b05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee75 expref: -99 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.899942:0:22872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c55bd67e400/0x66f5679bff032b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee75 expref: 13 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.899953:0:22872:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c55bd67e400/0x66f5679bff032b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee75 expref: 13 pid: 22872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.899979:0:22872:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e400, rc 0) 00000100:00100000:2.0:1787368248.900042:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc4bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18300:x1874190788640512:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 170us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368248.900049:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:1.0:1787368248.905488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.905979:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788640640 00000100:00100000:3.0:1787368248.905989:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788640640 00000100:00100000:3.0:1787368248.906044:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:3.0:1787368248.906053:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18300:x1874190788640640:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787368248.906196:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18300:x1874190788640640:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 143us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.906203:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 164 00000100:00100000:0.0:1787368248.912321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368248.912939:0:22872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788640768 00000100:00100000:2.0:1787368248.912950:0:22872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788640768 00000100:00100000:2.0:1787368248.913012:0:22872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:2.0:1787368248.913023:0:22872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18300:x1874190788640768:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787368248.913162:0:22872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7db1a22-e032-464d-a4cf-1677c572dedf+13:18300:x1874190788640768:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 139us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368248.913171:0:22872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:1.0:1787368248.950974:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368248.951044:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788640896 00000100:00100000:2.0:1787368248.951054:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788640896 00000100:00100000:2.0:1787368248.951121:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1787368248.951131:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+11:18945:x1874190788640896:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787368248.951151:0:24580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368248.951171:0:24580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032b0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee7c expref: -99 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951235:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951250:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951263:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951289:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951296:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951304:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951434:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff032b21 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951445:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff032b21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951452:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff032b21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368248.951482:0:24580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787368248.951485:0:24580:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368248.951658:0:24580:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff032b21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951671:0:24580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951678:0:24580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951694:0:24580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951916:0:24580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67fe00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368248.951921:0:24580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951929:0:24580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951942:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1e00) 00010000:00010000:2.0:1787368248.951945:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368248.951949:0:24580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951955:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fe00/0x66f5679bff032b13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951969:0:24580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951975:0:24580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951981:0:24580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951986:0:24580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67e600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368248.951989:0:24580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.951995:0:24580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.952009:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c5598ca1800) 00010000:00010000:2.0:1787368248.952011:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368248.952014:0:24580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.952020:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.952043:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032b0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee7c expref: 13 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.952055:0:24580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ee00/0x66f5679bff032b21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee7c expref: 12 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.952061:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:2.0:1787368248.952063:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787368248.952066:0:24580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67ee00, rc 0) 00000100:00100000:2.0:1787368248.952117:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+12:18945:x1874190788640896:12345-192.168.203.4@tcp:101:bash.0 Request processed in 988us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368248.952125:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:1.0:1787368248.957301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.957461:0:22890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788641024 00000100:00100000:3.0:1787368248.957471:0:22890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788641024 00000100:00100000:3.0:1787368248.957645:0:22890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1787368248.957656:0:22890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:18945:x1874190788641024:12345-192.168.203.4@tcp:900:bash.0 00000100:00100000:3.0:1787368248.957759:0:22890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:18945:x1874190788641024:12345-192.168.203.4@tcp:900:bash.0 Request processed in 97us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368248.957769:0:22890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1787368248.960171:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368248.961583:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788641280 00000100:00100000:3.0:1787368248.961611:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788641280 00000100:00100000:3.0:1787368248.961681:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:3.0:1787368248.961703:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+12:18945:x1874190788641280:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1787368248.961723:0:22879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368248.961807:0:22879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b28 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee83 expref: -99 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.961988:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.962007:0:22879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee67 expref: 12 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.962016:0:22879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.962052:0:22879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee67 expref: 12 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.962066:0:22879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee67 expref: 12 pid: 22880 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368248.962084:0:22879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22879:1874190808661376:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368248.962229:0:22879:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787368248.965186:0:22879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6043b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22879:1874190808661376:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368248.965212:0:22879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368248.965764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368248.966516:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788641408 00000100:00100000:2.0:1787368248.966525:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788641408 00010000:00010000:2.0:1787368248.966567:0:24032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee67 expref: 13 pid: 22880 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368248.966612:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1787368248.966622:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ab70352-efce-480e-a808-993671ad30dd+13:2402:x1874190788641408:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368248.966662:0:24032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368248.966670:0:24032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee67 expref: 13 pid: 22880 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.966683:0:24032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee67 expref: 13 pid: 22880 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.966720:0:24032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032af7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee67 expref: 13 pid: 22880 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.966739:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:2.0:1787368248.966743:0:24032:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.966753:0:24032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.966760:0:24032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.966788:0:24032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368248.966848:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ab70352-efce-480e-a808-993671ad30dd+12:2402:x1874190788641408:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 226us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368248.966857:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00010000:00010000:3.0:1787368248.967643:0:22879:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.967659:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.967736:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.967746:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.967754:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968249:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968259:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968266:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787368248.968276:0:22879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787368248.968296:0:22879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968303:0:22879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968309:0:22879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968315:0:22879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672200 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368248.968325:0:22879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968333:0:22879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968343:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:3.0:1787368248.968346:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787368248.968349:0:22879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968682:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b2f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787368248.968937:0:22879:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058875936 reply state 00000000d21552f1 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968950:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.968957:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c548221b500) 00010000:00010000:3.0:1787368248.968960:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787368248.968962:0:22879:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787368248.969000:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b28 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee83 expref: 15 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.969015:0:22879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee83 expref: 14 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368248.969021:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:3.0:1787368248.969024:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787368248.969035:0:22879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581673600, rc 0) 00000100:00100000:3.0:1787368248.969152:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+15:18945:x1874190788641280:12345-192.168.203.4@tcp:101:bash.0 Request processed in 7451us (8989us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787368248.969161:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:0.0:1787368248.988829:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368248.989030:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788641536 00000100:00100000:2.0:1787368248.989041:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788641536 00000100:00100000:2.0:1787368248.989146:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1787368248.989158:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+15:18945:x1874190788641536:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1787368248.989196:0:22878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368248.989216:0:22878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032b4b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee8a expref: -99 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.989283:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.989298:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.989309:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787368248.989386:0:22878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787368248.989391:0:22878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787368248.989410:0:22878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.989419:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.989454:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032b4b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee8a expref: 17 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.989485:0:22878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee8a expref: 16 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368248.989493:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:2.0:1787368248.989496:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787368248.989499:0:22878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67e600, rc 0) 00000100:00100000:2.0:1787368248.989572:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+16:18945:x1874190788641536:12345-192.168.203.4@tcp:101:bash.0 Request processed in 417us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368248.989580:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:1.0:1787368248.992563:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368248.992662:0:22881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788641792 00000100:00100000:0.0:1787368248.992684:0:22881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788641792 00000100:00100000:0.0:1787368248.992755:0:22881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1787368248.992768:0:22881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+16:18945:x1874190788641792:12345-192.168.203.4@tcp:35:bash.0 00000100:00100000:0.0:1787368248.993160:0:22881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+17:18945:x1874190788641792:12345-192.168.203.4@tcp:35:bash.0 Request processed in 394us (604us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1787368248.993169:0:22881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000040:00080000:3.0:1787368249.049077:0:23637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787368249.064792:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.064953:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788642048 00000100:00100000:0.0:1787368249.064963:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788642048 00000100:00080000:2.0:1787368249.065092:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787368249.065126:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1787368249.065135:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+17:18955:x1874190788642048:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1787368249.065157:0:22880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368249.065173:0:22880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032b59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee91 expref: -99 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368249.065248:0:22880:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787368249.065322:0:22880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032b59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee91 expref: 19 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.065334:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c5598ca1e00) 00010000:00010000:0.0:1787368249.065336:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787368249.065339:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032b59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee91 expref: 19 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.065351:0:22880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a600, rc 0) 00000100:00100000:0.0:1787368249.065431:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+18:18955:x1874190788642048:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 297us (648us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1787368249.065438:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:2.0:1787368249.072092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.072184:0:22881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788642304 00000100:00100000:0.0:1787368249.072193:0:22881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788642304 00000100:00100000:0.0:1787368249.072348:0:22881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1787368249.072392:0:22881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+18:18955:x1874190788642304:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1787368249.072866:0:22881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+19:18955:x1874190788642304:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 508us (781us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1787368249.072874:0:22881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1787368249.127105:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.131120:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788642560 00000100:00100000:1.0:1787368249.131132:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788642560 00000100:00100000:1.0:1787368249.131203:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1787368249.131213:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+19:18958:x1874190788642560:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1787368249.131238:0:24580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368249.131258:0:24580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727000/0x66f5679bff032b67 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee98 expref: -99 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.131378:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727600/0x66f5679bff032b6e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.131392:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727600/0x66f5679bff032b6e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.131422:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727600/0x66f5679bff032b6e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368249.131434:0:24580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787368249.131530:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727000/0x66f5679bff032b67 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee98 expref: 22 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.131547:0:24580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727600/0x66f5679bff032b6e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee98 expref: 21 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.131556:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:1.0:1787368249.131559:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787368249.131562:0:24580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b6727600, rc 0) 00000100:00100000:1.0:1787368249.131704:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+21:18958:x1874190788642560:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 491us (4605us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1787368249.131711:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:1.0:1787368249.137100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.137181:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788642688 00000100:00100000:3.0:1787368249.137191:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788642688 00000100:00100000:3.0:1787368249.137250:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:3.0:1787368249.137261:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+21:18958:x1874190788642688:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:3.0:1787368249.137329:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.137346:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.137386:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.137421:0:22879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.137428:0:22879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.137435:0:22879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.137441:0:22879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:3.0:1787368249.137445:0:22879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.137466:0:22879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.137478:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:3.0:1787368249.137481:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787368249.137485:0:22879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.137491:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b7c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368249.137560:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+21:18958:x1874190788642688:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 300us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368249.137569:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:0.0:1787368249.138234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.138291:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788642816 00000100:00100000:3.0:1787368249.138296:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788642816 00000100:00100000:3.0:1787368249.138339:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1787368249.138348:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+21:2405:x1874190788642816:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368249.138519:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368249.138537:0:22865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727600/0x66f5679bff032b6e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee98 expref: 21 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.138553:0:22865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:3.0:1787368249.138557:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368249.138680:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+20:2405:x1874190788642816:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 332us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368249.138696:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1787368249.145148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368249.146215:0:22882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788643072 00000100:00100000:2.0:1787368249.146226:0:22882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788643072 00000100:00100000:2.0:1787368249.146294:0:22882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1787368249.146304:0:22882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+20:18958:x1874190788643072:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1787368249.146525:0:22882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+21:18958:x1874190788643072:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 221us (1385us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1787368249.146533:0:22882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1787368249.242205:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787368249.242225:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808661504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787368249.242293:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368249.242416:0:22884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808661504 00000100:00100000:0.0:1787368249.242425:0:22884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808661504 00000100:00100000:0.0:1787368249.242467:0:22884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787368249.242475:0:22884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808661504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787368249.242503:0:22884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787368249.242549:0:22884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874190808661504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.242556:0:22884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787368249.242613:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874190808661504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787368249.243118:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787368249.243129:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808661632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787368249.243161:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368249.243189:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808661632 00000100:00100000:3.0:1787368249.243193:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808661632 00000100:00100000:3.0:1787368249.243218:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787368249.243225:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808661632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787368249.243243:0:22883:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787368249.243278:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808661632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368249.243285:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787368249.243313:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808661632:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787368249.244042:0:25906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787368249.432327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.432559:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788643328 00000100:00100000:1.0:1787368249.432570:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788643328 00000100:00100000:1.0:1787368249.432779:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1787368249.432791:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+21:18989:x1874190788643328:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:1.0:1787368249.432815:0:24580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368249.432853:0:24580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727200/0x66f5679bff032b83 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2ee9f expref: -99 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.432977:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726800/0x66f5679bff032b8a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.432992:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726800/0x66f5679bff032b8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.433005:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726800/0x66f5679bff032b8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368249.433016:0:24580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787368249.433126:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727200/0x66f5679bff032b83 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee9f expref: 24 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.433144:0:24580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726800/0x66f5679bff032b8a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee9f expref: 23 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.433152:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:1.0:1787368249.433155:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787368249.433158:0:24580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b6726800, rc 0) 00000100:00100000:1.0:1787368249.433221:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+23:18989:x1874190788643328:12345-192.168.203.4@tcp:101:cat.0 Request processed in 432us (903us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1787368249.433228:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:2.0:1787368249.441476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.441695:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788643456 00000100:00100000:0.0:1787368249.441709:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788643456 00000100:00100000:0.0:1787368249.441790:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:0.0:1787368249.441802:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+23:2402:x1874190788643456:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787368249.441822:0:24032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787368249.442038:0:24032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726800/0x66f5679bff032b8a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee9f expref: 23 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.442063:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:0.0:1787368249.442080:0:24032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787368249.442184:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+22:2402:x1874190788643456:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 383us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.442193:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1787368249.443162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368249.443345:0:22882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788643712 00000100:00100000:2.0:1787368249.443382:0:22882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788643712 00000100:00100000:2.0:1787368249.443441:0:22882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1787368249.443451:0:22882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+22:18989:x1874190788643712:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:2.0:1787368249.443746:0:22882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+23:18989:x1874190788643712:12345-192.168.203.4@tcp:35:cat.0 Request processed in 295us (585us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1787368249.443755:0:22882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1787368249.513711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.513804:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788643968 00000100:00100000:3.0:1787368249.513814:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788643968 00000100:00100000:3.0:1787368249.513882:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1787368249.513892:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+23:18995:x1874190788643968:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1787368249.513914:0:22879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368249.513933:0:22879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b98 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eea6 expref: -99 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.514055:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.514076:0:22879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee83 expref: 24 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.514086:0:22879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee8a expref: 24 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.514108:0:22879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.514139:0:22879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee8a expref: 24 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.514152:0:22879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee8a expref: 24 pid: 22878 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368249.514166:0:22879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22879:1874190808661760:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368249.514258:0:22879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee83 expref: 24 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.514267:0:22879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee83 expref: 24 pid: 22879 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368249.514276:0:22879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22879:1874190808661888:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368249.514299:0:22879:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787368249.519252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.519292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368249.519413:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788644096 00000100:00100000:2.0:1787368249.519422:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788644096 00010000:00010000:2.0:1787368249.519460:0:22865:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee8a expref: 25 pid: 22878 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368249.519510:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788644224 00000100:00100000:2.0:1787368249.519513:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788644224 00010000:00010000:2.0:1787368249.519527:0:22865:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee83 expref: 26 pid: 22879 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368249.519546:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1787368249.519554:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+26:2403:x1874190788644096:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368249.519568:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368249.519574:0:22865:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee8a expref: 26 pid: 22878 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.519585:0:22865:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee8a expref: 26 pid: 22878 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.519606:0:22865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:2.0:1787368249.519612:0:22865:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.519619:0:22865:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.519626:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368249.519674:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+26:2403:x1874190788644096:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 120us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368249.519690:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1787368249.519707:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:2.0:1787368249.519714:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be765450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+25:2403:x1874190788644224:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787368249.519728:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368249.519733:0:22865:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee83 expref: 25 pid: 22879 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.519756:0:22865:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee83 expref: 25 pid: 22879 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.519769:0:22865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:2.0:1787368249.519772:0:22865:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.519779:0:22865:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.519785:0:22865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.519802:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368249.519821:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be765450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+25:2403:x1874190788644224:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 108us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368249.519834:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00010000:00010000:1.0:1787368249.520335:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e600/0x66f5679bff032b52 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee8a expref: 24 pid: 22878 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368249.520396:0:22879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55b6041500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22879:1874190808661760:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368249.520421:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581673600/0x66f5679bff032b3d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2ee83 expref: 23 pid: 22879 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368249.520432:0:22879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54836bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22879:1874190808661888:192.168.203.4@tcp:104: 00010000:00010000:1.0:1787368249.520451:0:22879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.520459:0:22879:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.520465:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368249.520481:0:22879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787368249.520614:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672c00/0x66f5679bff032b98 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eea6 expref: 24 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.520629:0:22879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672200/0x66f5679bff032b9f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eea6 expref: 23 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.520636:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:1.0:1787368249.520639:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787368249.520642:0:22879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c5581672200, rc 0) 00000100:00100000:1.0:1787368249.520694:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+23:18995:x1874190788643968:12345-192.168.203.4@tcp:101:dd.0 Request processed in 6803us (6993us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1787368249.520701:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1787368249.524192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368249.530244:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788644352 00000100:00100000:2.0:1787368249.530258:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788644352 00000100:00100000:2.0:1787368249.530372:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1787368249.530382:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+23:18995:x1874190788644352:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1787368249.530403:0:22878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368249.530421:0:22878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff032bad lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eead expref: -99 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.530473:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.530487:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.530497:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.530604:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67e800/0x66f5679bff032bad lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eead expref: 25 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.530624:0:22878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eead expref: 24 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.530632:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:2.0:1787368249.530642:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787368249.530646:0:22878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67f200, rc 0) 00000100:00100000:2.0:1787368249.530820:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+24:18995:x1874190788644352:12345-192.168.203.4@tcp:101:dd.0 Request processed in 438us (6635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368249.530827:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1787368249.533920:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.534003:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788644608 00000100:00100000:0.0:1787368249.534013:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788644608 00000100:00100000:0.0:1787368249.534069:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:0.0:1787368249.534080:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+24:18995:x1874190788644608:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1787368249.534294:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.534314:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.534326:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787368249.534401:0:22880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1787368249.534424:0:22880:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edf903a1 reply state 00000000e38263a9 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.534437:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.534445:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:0.0:1787368249.534447:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787368249.534450:0:22880:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787368249.534544:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+27:18995:x1874190788644608:12345-192.168.203.4@tcp:36:dd.0 Request processed in 465us (632us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1787368249.534551:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000020:00080000:0.0:1787368249.534566:0:22880:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787368249.543401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.543499:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788644736 00000100:00100000:1.0:1787368249.543509:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788644736 00000100:00100000:1.0:1787368249.543583:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1787368249.543594:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+27:18995:x1874190788644736:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1787368249.543616:0:24580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368249.543637:0:24580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032bc2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eeb4 expref: -99 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.543702:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032bc2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eeb4 expref: 28 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.543717:0:24580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032bc2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eeb4 expref: 28 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.543735:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:1.0:1787368249.543738:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787368249.543751:0:24580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b6727a00, rc 0) 00000100:00100000:1.0:1787368249.543813:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+28:18995:x1874190788644736:12345-192.168.203.4@tcp:101:dd.0 Request processed in 222us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368249.543820:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1787368249.556221:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368249.556517:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788644992 00000100:00100000:2.0:1787368249.556527:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788644992 00000100:00100000:2.0:1787368249.556591:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1787368249.556601:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+28:18995:x1874190788644992:12345-192.168.203.4@tcp:103:dd.0 00010000:00010000:2.0:1787368249.556615:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368249.556650:0:22865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727a00/0x66f5679bff032bc2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eeb4 expref: 28 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.556670:0:22865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:2.0:1787368249.556675:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787368249.556739:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483ced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+27:18995:x1874190788644992:12345-192.168.203.4@tcp:103:dd.0 Request processed in 140us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368249.556754:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1787368249.561284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.564858:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788645120 00000100:00100000:0.0:1787368249.564875:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788645120 00000100:00100000:0.0:1787368249.565070:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:0.0:1787368249.565083:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+27:18995:x1874190788645120:12345-192.168.203.4@tcp:58:dd.0 00010000:00010000:0.0:1787368249.565189:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.565207:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.565219:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787368249.566558:0:22880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787368249.566588:0:22880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1787368249.566709:0:22880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1787368249.567212:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+27:18995:x1874190788645120:12345-192.168.203.4@tcp:58:dd.0 Request processed in 2107us (5913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.567222:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:3.0:1787368249.569307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368249.569516:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788645248 00000100:00100000:2.0:1787368249.569526:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788645248 00000100:00100000:2.0:1787368249.569578:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:2.0:1787368249.569587:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+27:18995:x1874190788645248:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1787368249.569608:0:24580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787368249.569627:0:24580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032bd0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eebb expref: -99 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.569678:0:24580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.569708:0:24580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032bd0 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eebb expref: 28 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.569726:0:24580:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.569738:0:24580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032bd0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eebb expref: 28 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.569762:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:2.0:1787368249.569777:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787368249.569782:0:24580:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032bd0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eebb expref: 28 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.569790:0:24580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bd67ea00, rc 0) 00000100:00100000:2.0:1787368249.570484:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+28:18995:x1874190788645248:12345-192.168.203.4@tcp:101:dd.0 Request processed in 894us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368249.570492:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000040:00080000:2.0:1787368249.752597:0:22914:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787368249.752608:0:22914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787368249.752634:0:22914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787368249.752643:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787368249.752782:0:22914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22914:1874190808662016:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787368249.752869:0:22914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c55b6077300 going to sleep for 11 seconds 00000100:00100000:2.0:1787368249.754644:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808662144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787368249.754715:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368249.754834:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808662144 00000100:00100000:3.0:1787368249.754857:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808662144 00000100:00100000:3.0:1787368249.754925:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787368249.754934:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808662144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787368249.754959:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787368249.755006:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874190808662144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368249.755013:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787368249.755057:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874190808662144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787368249.755739:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368249.761206:0:22914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55acbf7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22914:1874190808662016:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787368249.771795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.771889:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788645376 00000100:00100000:1.0:1787368249.771898:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788645376 00000100:00100000:1.0:1787368249.771955:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:1.0:1787368249.771965:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55acbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+28:18996:x1874190788645376:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787368249.771997:0:22879:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787368249.772106:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55acbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+28:18996:x1874190788645376:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 142us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368249.772115:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:2.0:1787368249.779175:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.779990:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788645504 00000100:00100000:1.0:1787368249.780014:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788645504 00000100:00100000:1.0:1787368249.780078:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1787368249.780088:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+28:18996:x1874190788645504:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787368249.780175:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780195:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780209:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780426:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780436:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780444:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780468:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780477:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780484:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368249.780531:0:22878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787368249.780535:0:22878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787368249.780555:0:22878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780567:0:22878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780573:0:22878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780580:0:22878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780586:0:22878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6726000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368249.780590:0:22878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780597:0:22878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780609:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55bc700700) 00010000:00010000:1.0:1787368249.780613:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368249.780617:0:22878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780623:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032bd7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780638:0:22878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780644:0:22878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780650:0:22878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780661:0:22878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6727c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368249.780664:0:22878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780670:0:22878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780678:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9c55bc700d00) 00010000:00010000:1.0:1787368249.780691:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368249.780695:0:22878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780701:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bde lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780718:0:22878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780724:0:22878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780730:0:22878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780735:0:22878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6726600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368249.780737:0:22878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780743:0:22878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780762:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:1.0:1787368249.780764:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368249.780768:0:22878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.780774:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032be5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368249.782831:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+28:18996:x1874190788645504:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 2722us (3644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368249.782846:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1787368249.791728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.793867:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788645760 00000100:00100000:1.0:1787368249.793879:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788645760 00000100:00100000:1.0:1787368249.793939:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:1.0:1787368249.793950:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+28:18996:x1874190788645760:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787368249.793969:0:22879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368249.793987:0:22879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032bec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eec2 expref: -99 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794093:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794110:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794122:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787368249.794133:0:22879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787368249.794242:0:22879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794251:0:22879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794257:0:22879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794263:0:22879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6727c00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368249.794267:0:22879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794275:0:22879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794289:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:1.0:1787368249.794293:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787368249.794297:0:22879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794304:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032bf3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794345:0:22879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032bec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eec2 expref: 30 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794402:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c55bc700700) 00010000:00010000:1.0:1787368249.794405:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787368249.794409:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032bec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eec2 expref: 30 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.794430:0:22879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b6726600, rc 0) 00000100:00100000:1.0:1787368249.794490:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+29:18996:x1874190788645760:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 542us (2773us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1787368249.794499:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:2.0:1787368249.807214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.807567:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788645888 00000100:00100000:1.0:1787368249.807579:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788645888 00000100:00100000:0.0:1787368249.812182:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1787368249.812198:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+29:18996:x1874190788645888:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787368249.813471:0:24580:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787368249.813636:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+29:18996:x1874190788645888:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 1439us (6429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.813647:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:2.0:1787368249.822601:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.822741:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788646144 00000100:00100000:1.0:1787368249.822751:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788646144 00000100:00100000:1.0:1787368249.822806:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:1.0:1787368249.822817:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+29:18996:x1874190788646144:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787368249.822838:0:22879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787368249.822858:0:22879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c01 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eec9 expref: -99 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787368249.824297:0:22879:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:1.0:1787368249.824307:0:22879:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1787368249.824330:0:22879:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1787368249.824509:0:22879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032c08 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.824525:0:22879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032c08 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.824536:0:22879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032c08 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.824596:0:22879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c01 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eec9 expref: 32 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.824627:0:22879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032c08 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eec9 expref: 31 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.824635:0:22879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55bc700d00) 00010000:00010000:1.0:1787368249.824638:0:22879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787368249.824640:0:22879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55b6727c00, rc 0) 00000100:00100000:1.0:1787368249.824723:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+31:18996:x1874190788646144:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 1908us (2130us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1787368249.824732:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1787368249.831951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.832024:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788646400 00000100:00100000:1.0:1787368249.832033:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788646400 00000100:00100000:1.0:1787368249.832088:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1787368249.832101:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+31:18996:x1874190788646400:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787368249.832167:0:22878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368249.832201:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6727c00/0x66f5679bff032c08 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eec9 expref: 31 pid: 22879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832438:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55bc700d00) 00010000:00010000:1.0:1787368249.832451:0:22878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787368249.832472:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832486:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832495:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832519:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832526:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832532:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832576:0:22878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832582:0:22878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832588:0:22878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832594:0:22878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6726600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368249.832598:0:22878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832605:0:22878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832612:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:1.0:1787368249.832615:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368249.832618:0:22878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832624:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726600/0x66f5679bff032c16 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832640:0:22878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832646:0:22878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832652:0:22878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832657:0:22878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6726000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:1.0:1787368249.832660:0:22878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832666:0:22878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832672:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb80af883 (ffff9c55bc700600) 00010000:00010000:1.0:1787368249.832674:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787368249.832676:0:22878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.832691:0:22878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c1d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb80af883 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368249.832757:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+30:18996:x1874190788646400:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 660us (872us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787368249.832764:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1787368249.836473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.836569:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788646528 00000100:00100000:0.0:1787368249.836578:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788646528 00000100:00100000:0.0:1787368249.836631:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:0.0:1787368249.836654:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+30:18996:x1874190788646528:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787368249.836674:0:22880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368249.836705:0:22880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c24 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eed0 expref: -99 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.836806:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032c2b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.836821:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032c2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.836832:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032c2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.837003:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c24 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed0 expref: 32 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.837021:0:22880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a200/0x66f5679bff032c2b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed0 expref: 31 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.837029:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:0.0:1787368249.837032:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787368249.837035:0:22880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a200, rc 0) 00000100:00100000:0.0:1787368249.837091:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+31:18996:x1874190788646528:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 439us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.837099:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:2.0:1787368249.847766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.848040:0:22878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788646784 00000100:00100000:1.0:1787368249.848049:0:22878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788646784 00000100:00100000:1.0:1787368249.848109:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:1.0:1787368249.848188:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+31:18996:x1874190788646784:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787368249.848532:0:22878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.848549:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.848560:0:22878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787368249.848732:0:22878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1787368249.848742:0:22878:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707136385875ns, next at 708136383643ns, rc = 0 00000004:00010000:1.0:1787368249.848787:0:22878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da5caf58 reply state 000000006a4c58e7 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.848800:0:22878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.848807:0:22878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:1.0:1787368249.848810:0:22878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787368249.848813:0:22878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787368249.850032:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+33:18996:x1874190788646784:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 1894us (2892us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1787368249.850043:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:2.0:1787368249.852122:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.854708:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788646912 00000100:00100000:0.0:1787368249.854724:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788646912 00000100:00100000:0.0:1787368249.854791:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:0.0:1787368249.854816:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+33:18996:x1874190788646912:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787368249.854852:0:22880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368249.854874:0:22880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eed7 expref: -99 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.854942:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed7 expref: 34 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.854958:0:22880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed7 expref: 34 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.854978:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:0.0:1787368249.854981:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787368249.854985:0:22880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b600, rc 0) 00000100:00100000:0.0:1787368249.855053:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+34:18996:x1874190788646912:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 240us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.855061:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:2.0:1787368249.857955:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.858159:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788647040 00000100:00100000:3.0:1787368249.858169:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788647040 00000100:00100000:3.0:1787368249.858400:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:3.0:1787368249.858411:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c559f9f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2403:x1874190788647040:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787368249.858633:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c559f9f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:2403:x1874190788647040:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 223us (685us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1787368249.858641:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00080000:2.0:1787368249.858819:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368249.867381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.871879:0:22882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788647296 00000100:00100000:3.0:1787368249.871902:0:22882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788647296 00000100:00100000:3.0:1787368249.871964:0:22882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1787368249.871975:0:22882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+34:18996:x1874190788647296:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787368249.872913:0:22882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+35:18996:x1874190788647296:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 936us (5553us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1787368249.872923:0:22882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1787368249.877198:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.877742:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788647552 00000100:00100000:0.0:1787368249.877751:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788647552 00000100:00100000:0.0:1787368249.877812:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:0.0:1787368249.877829:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bc692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+35:18996:x1874190788647552:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787368249.877948:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bc692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+35:18996:x1874190788647552:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 126us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.877956:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 58 00000100:00100000:2.0:1787368249.887486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.887596:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788647680 00000100:00100000:0.0:1787368249.887606:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788647680 00000100:00100000:0.0:1787368249.887666:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:0.0:1787368249.887699:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+35:18996:x1874190788647680:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787368249.887721:0:22880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368249.887741:0:22880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032c40 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eede expref: -99 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.887838:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c47 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.887853:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.887864:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787368249.888046:0:22880:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787368249.888065:0:22880:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.888089:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b200/0x66f5679bff032c40 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eede expref: 37 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.888107:0:22880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c47 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eede expref: 36 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.888115:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:0.0:1787368249.888118:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787368249.888122:0:22880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68a000, rc 0) 00000100:00100000:0.0:1787368249.888534:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+36:18996:x1874190788647680:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 836us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.888603:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:2.0:1787368249.891541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.891654:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788647808 00000100:00100000:3.0:1787368249.891663:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788647808 00000100:00100000:3.0:1787368249.891732:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1787368249.891767:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+6:2403:x1874190788647808:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787368249.891785:0:24385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787368249.891807:0:24385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eee5 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787368249.892034:0:24385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89133a, blocks: 0x0 00010000:00010000:3.0:1787368249.892056:0:24385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1787368249.892061:0:24385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368249.892072:0:24385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eee5 expref: 7 pid: 24385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.892092:0:24385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eee5 expref: 7 pid: 24385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.892105:0:24385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c558241d200, rc 0) 00000100:00100000:3.0:1787368249.892170:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:2403:x1874190788647808:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 406us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368249.892178:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1787368249.895613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.895723:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788648064 00000100:00100000:0.0:1787368249.895733:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788648064 00000100:00100000:0.0:1787368249.895789:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:0.0:1787368249.895799:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+36:18996:x1874190788648064:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787368249.895924:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+36:18996:x1874190788648064:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 126us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.895932:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:2.0:1787368249.898913:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.899001:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788648192 00000100:00100000:1.0:1787368249.899011:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788648192 00000100:00100000:1.0:1787368249.899071:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:1.0:1787368249.899081:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+36:18996:x1874190788648192:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787368249.902513:0:22858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1787368249.902530:0:22858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787368249.902592:0:22858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1787368249.902889:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.902913:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.902921:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.902927:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368249.902932:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.902941:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.902959:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:0.0:1787368249.902962:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787368249.902968:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.902992:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672400/0x66f5679bff032acd lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368249.903476:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+19:18996:x1874190788648192:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 4390us (4574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368249.903488:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:0.0:1787368249.903887:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808662272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787368249.903950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368249.904552:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808662272 00000100:00100000:3.0:1787368249.904560:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808662272 00000100:00100000:3.0:1787368249.904619:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787368249.904629:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808662272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787368249.904960:0:24383:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787368249.904964:0:24383:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787368249.904966:0:24383:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787368249.904968:0:24383:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787368250 -> 1787368250 00002000:00010000:3.0:1787368249.904981:0:24383:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1787368249.905113:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905123:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905129:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905146:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bd67f800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368249.905151:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905159:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905177:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c5598ca1800) 00010000:00010000:2.0:1787368249.905180:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368249.905186:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905192:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f800/0x66f5679bff032a79 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905211:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905241:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905246:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905251:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6726e00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368249.905255:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905260:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905269:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c55bc700200) 00010000:00010000:2.0:1787368249.905272:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368249.905275:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905280:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726e00/0x66f5679bff032a80 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905295:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905302:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905307:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905312:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c5581672800 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368249.905321:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905328:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905335:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c548221b500) 00010000:00010000:2.0:1787368249.905338:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368249.905341:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905347:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c5581672800/0x66f5679bff032b36 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905387:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905393:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905399:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905404:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a600 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368249.905407:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905413:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905420:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:2.0:1787368249.905422:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787368249.905432:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905439:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a600/0x66f5679bff032bbb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905452:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905458:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905463:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905469:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55b6726000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:2.0:1787368249.905471:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905477:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905485:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:2.0:1787368249.905487:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787368249.905490:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.905495:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55b6726000/0x66f5679bff032c32 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368249.905638:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874190808662272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1007us (1684us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787368249.905652:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1787368249.907134:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c54845b0380/2, rc 0, transno 12884901892 00000100:00100000:0.0:1787368249.907149:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808662272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787368249.907593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.907725:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788648320 00000100:00100000:0.0:1787368249.907732:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788648320 00000100:00100000:0.0:1787368249.908153:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1787368249.908164:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:2402:x1874190788648320:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787368249.908280:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:2402:x1874190788648320:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 117us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.908288:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1787368249.912032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1787368249.912103:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788648576 00000100:00100000:2.0:1787368249.912112:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788648576 00000100:00100000:2.0:1787368249.912194:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:2.0:1787368249.912204:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+15:18996:x1874190788648576:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787368249.912266:0:24580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787368249.912293:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c47 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eede expref: 15 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.912313:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:2.0:1787368249.912318:0:24580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787368249.912347:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032c55 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.912397:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032c55 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.912408:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032c55 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787368249.912520:0:24580:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c471b6d reply state 00000000ce97cc4b transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032c55 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.912532:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67fc00/0x66f5679bff032c55 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.912537:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:2.0:1787368249.912540:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787368249.912542:0:24580:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787368249.912628:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+16:18996:x1874190788648576:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 424us (604us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1787368249.912635:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:2.0:1787368249.916435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.916516:0:24818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788648704 00000100:00100000:0.0:1787368249.916526:0:24818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788648704 00000100:00100000:0.0:1787368249.916581:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:0.0:1787368249.916590:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:2405:x1874190788648704:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787368249.916733:0:24818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787368249.916736:0:24818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787368249 00002000:00010000:0.0:1787368249.916739:0:24818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787368249 00002000:00010000:0.0:1787368249.916741:0:24818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787368250 -> 1787368249 00002000:00010000:0.0:1787368249.916743:0:24818:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787368249.916880:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+8:2405:x1874190788648704:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 290us (454us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787368249.916895:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:3.0:1787368249.920151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.920239:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788648832 00000100:00100000:0.0:1787368249.920249:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788648832 00000100:00100000:0.0:1787368249.920303:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1787368249.920314:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+8:2402:x1874190788648832:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787368249.920394:0:24385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.920411:0:24385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368249.920415:0:24385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787368249.920422:0:24385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.920436:0:24385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.920460:0:24385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.920469:0:24385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.920477:0:24385:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.920486:0:24385:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a400 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368249.920504:0:24385:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.920519:0:24385:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.920536:0:24385:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.920544:0:24385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063a0f406/0x66f5679bff032c5c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368249.920615:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+8:2402:x1874190788648832:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 302us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.920623:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1787368249.923790:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.923938:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788649088 00000100:00100000:0.0:1787368249.923948:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788649088 00000100:00100000:0.0:1787368249.923997:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:0.0:1787368249.924005:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+16:18996:x1874190788649088:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787368249.924077:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.924093:0:22880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eead expref: 16 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.924102:0:22880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.924164:0:22880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eead expref: 16 pid: 22878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.924176:0:22880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eead expref: 16 pid: 22878 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368249.924190:0:22880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22880:1874190808662400:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787368249.924587:0:22880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787368249.929271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368249.929596:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788649216 00000100:00100000:1.0:1787368249.929606:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788649216 00010000:00010000:1.0:1787368249.929645:0:24032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eead expref: 17 pid: 22878 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368249.929696:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1787368249.929707:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+17:2403:x1874190788649216:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368249.929721:0:24032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368249.929728:0:24032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eead expref: 17 pid: 22878 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.929752:0:24032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eead expref: 17 pid: 22878 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.929774:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:1.0:1787368249.929780:0:24032:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032bd0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eebb expref: 17 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.929791:0:24032:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.929818:0:24032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.929835:0:24032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368249.929855:0:24032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787368249.929916:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+17:2403:x1874190788649216:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 210us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368249.929924:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00010000:00010000:0.0:1787368249.931236:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67f200/0x66f5679bff032bb4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eead expref: 16 pid: 22878 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368249.931259:0:22880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22880:1874190808662400:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787368249.931280:0:22880:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.931289:0:22880:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.931295:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.931509:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.931523:0:22880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed7 expref: 16 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.931530:0:22880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.931570:0:22880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed7 expref: 16 pid: 22880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.931595:0:22880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed7 expref: 16 pid: 22880 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368249.931609:0:22880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22880:1874190808662528:192.168.203.4@tcp:104: 00000100:00100000:0.0:1787368249.931675:0:22880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5590f9ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787368249.935777:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.936068:0:22865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788649344 00000100:00100000:3.0:1787368249.936077:0:22865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788649344 00010000:00010000:3.0:1787368249.936116:0:22865:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed7 expref: 17 pid: 22880 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368249.936164:0:22865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:3.0:1787368249.936173:0:22865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+17:2402:x1874190788649344:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787368249.936188:0:22865:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787368249.936195:0:22865:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed7 expref: 17 pid: 22880 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.936207:0:22865:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed7 expref: 17 pid: 22880 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.936238:0:22865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:3.0:1787368249.936243:0:22865:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.936252:0:22865:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.936259:0:22865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.936294:0:22865:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787368249.936348:0:22865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+17:2402:x1874190788649344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 175us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368249.936380:0:22865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00010000:00010000:0.0:1787368249.937289:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c39 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eed7 expref: 16 pid: 22880 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368249.937308:0:22880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22880:1874190808662528:192.168.203.4@tcp:104: 00010000:00010000:0.0:1787368249.937328:0:22880:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.937337:0:22880:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.937342:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787368249.937457:0:22880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1787368249.937563:0:22880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1787368249.937599:0:22880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1787368249.937671:0:22880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22880:1874190808662656:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787368249.937731:0:22880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368249.937982:0:22880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5592d48f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787368249.938067:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808662656 00000100:00100000:2.0:1787368249.938073:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808662656 00000100:00100000:2.0:1787368249.938166:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787368249.938175:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22880:x1874190808662656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787368249.938270:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22880:x1874190808662656:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368249.938278:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787368249.938334:0:22880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22880:1874190808662656:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787368249.938506:0:22880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1787368249.938560:0:22880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22880:1874190808662784:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787368249.938594:0:22880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368249.939313:0:22880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5588a649c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787368249.939478:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808662784 00000100:00100000:3.0:1787368249.939483:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808662784 00000100:00100000:3.0:1787368249.939516:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787368249.939525:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22880:x1874190808662784:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787368249.939700:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22880:x1874190808662784:12345-0@lo:1000:mdt00_002.0 Request processed in 175us (1105us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1787368249.939708:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787368249.939890:0:22880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22880:1874190808662784:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787368249.939929:0:22880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.939937:0:22880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.939944:0:22880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.939949:0:22880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a000 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368249.939953:0:22880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.939959:0:22880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.939973:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:0.0:1787368249.939976:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787368249.939981:0:22880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.939986:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c6a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.940014:0:22880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.940029:0:22880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.940034:0:22880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.940038:0:22880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ae00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368249.940042:0:22880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.940047:0:22880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.940056:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:0.0:1787368249.940058:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787368249.940064:0:22880:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032bd0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eebb expref: 19 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.940074:0:22880:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032bd0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eebb expref: 19 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.940082:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032bd0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eebb expref: 19 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.940201:0:22880:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bd67ea00/0x66f5679bff032bd0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eebb expref: 19 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368249.940217:0:22880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22880:1874190808662912:192.168.203.4@tcp:105: 00000100:00100000:0.0:1787368249.940419:0:22880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5588a649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787368249.943919:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.944006:0:22882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788649472 00000100:00100000:3.0:1787368249.944014:0:22882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788649472 00000100:00100000:3.0:1787368249.944073:0:22882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1787368249.944083:0:22882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55b6ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+20:18995:x1874190788649472:12345-192.168.203.4@tcp:49:dd.0 00000100:00100000:3.0:1787368249.944233:0:22882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+20:18995:x1874190788649472:12345-192.168.203.4@tcp:49:dd.0 Request processed in 151us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368249.944241:0:22882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1787368249.944778:0:22880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22880:1874190808662912:192.168.203.4@tcp:105: 00010000:00010000:0.0:1787368249.944803:0:22880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944813:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ae00/0x66f5679bff032bc9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944855:0:22880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944869:0:22880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944880:0:22880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944890:0:22880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944896:0:22880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944902:0:22880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944908:0:22880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68a400 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368249.944911:0:22880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944918:0:22880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944947:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:0.0:1787368249.944950:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787368249.944953:0:22880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944959:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a400/0x66f5679bff032c71 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944969:0:22880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944975:0:22880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944981:0:22880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944985:0:22880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c55bc68ac00 already unused, calling callback (ffffffffc175e4f0) 00010000:00010000:0.0:1787368249.944988:0:22880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.944994:0:22880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.945000:0:22880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:0.0:1787368249.945002:0:22880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787368249.945005:0:22880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.945010:0:22880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68ac00/0x66f5679bff032c63 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22880 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787368249.945431:0:22914:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787368249.945436:0:22914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787368249.945450:0:22914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787368249.945455:0:22914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787368249.945599:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55b6041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0376d49e-ddfe-46c2-91e5-49eaeca90b82+19:18996:x1874190788649088:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 21593us (21817us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1787368249.945608:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000020:00080000:0.0:1787368249.945613:0:22880:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787368249.948914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368249.949085:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788649600 00000100:00100000:0.0:1787368249.949095:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788649600 00000100:00100000:0.0:1787368249.949156:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:0.0:1787368249.949165:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+19:18995:x1874190788649600:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1787368249.949183:0:24580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787368249.949201:0:24580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c78 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ac78d7ad0a2eeec expref: -99 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.949428:0:24580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c7f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.949444:0:24580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c7f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.949455:0:24580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c7f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.949566:0:24580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68a000/0x66f5679bff032c78 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eeec expref: 21 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.949585:0:24580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c55bc68b600/0x66f5679bff032c7f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eeec expref: 20 pid: 24580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368249.949593:0:24580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c548221b200) 00010000:00010000:0.0:1787368249.949603:0:24580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787368249.949607:0:24580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c55bc68b600, rc 0) 00000100:00100000:0.0:1787368249.949667:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+20:18995:x1874190788649600:12345-192.168.203.4@tcp:101:dd.0 Request processed in 503us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368249.949675:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1787368249.954868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368249.955399:0:22882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788649856 00000100:00100000:3.0:1787368249.955409:0:22882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788649856 00000100:00100000:3.0:1787368249.955457:0:22882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1787368249.955467:0:22882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+20:18996:x1874190788649856:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787368249.955739:0:22882:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787368249.955780:0:22882:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1787368249.955813:0:22882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.955849:0:22882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.955861:0:22882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.955870:0:22882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.955876:0:22882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.955881:0:22882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368249.955897:0:22882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787368249.955984:0:22882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+22:18996:x1874190788649856:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 518us (1124us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1787368249.955993:0:22882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000020:00080000:3.0:1787368249.955997:0:22882:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787368249.956613:0:22866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787368249.956621:0:22866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.956629:0:22866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241dc00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:2.0:1787368249.956632:0:22866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.956640:0:22866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.956654:0:22866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c55937a6500) 00010000:00010000:2.0:1787368249.956657:0:22866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787368249.956669:0:22866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.956675:0:22866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c558241dc00/0x66f5679bff032c86 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368249.956699:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368249.956701:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787368249.956702:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787368250.086206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368250.086405:0:24389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788649984 00000100:00100000:3.0:1787368250.086416:0:24389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788649984 00000100:00100000:3.0:1787368250.086494:0:24389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1787368250.086505:0:24389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+8:2405:x1874190788649984:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:3.0:1787368250.086541:0:24389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.086563:0:24389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eee5 expref: 8 pid: 24385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.086593:0:24389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368250.086597:0:24389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368250.086603:0:24389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.086638:0:24389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eee5 expref: 8 pid: 24385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.086653:0:24389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eee5 expref: 8 pid: 24385 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368250.086668:0:24389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c54845b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24389:1874190808663040:192.168.203.4@tcp:104: 00000100:00100000:3.0:1787368250.086881:0:24389:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c5483c2f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787368250.092745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368250.092912:0:24391:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787368250.092921:0:24391:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787368250.093188:0:24391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788650112 00000100:00100000:1.0:1787368250.093196:0:24391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788650112 00000100:00100000:3.0:1787368250.093870:0:25924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1787368250.093883:0:25924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:2404:x1874190788650112:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:3.0:1787368250.093915:0:25924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.093933:0:25924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368250.093938:0:25924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787368250.093943:0:25924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.093952:0:25924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368250.095672:0:24389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c54845b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24389:1874190808663040:192.168.203.4@tcp:104: 00010000:00010000:3.0:1787368250.095709:0:24389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787368250.095763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1787368250.095919:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788650240 00000100:00100000:1.0:1787368250.095926:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788650240 00010000:00010000:1.0:1787368250.095956:0:24032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eee5 expref: 10 pid: 24385 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368250.095991:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1787368250.095999:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+10:2402:x1874190788650240:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787368250.096011:0:24032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787368250.096031:0:24032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eee5 expref: 10 pid: 24385 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368250.096043:0:24032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eee5 expref: 10 pid: 24385 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368250.096081:0:24032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000397151ab/0x66f5679bff032c4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x4ac78d7ad0a2eee5 expref: 10 pid: 24385 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368250.096095:0:24032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368250.096099:0:24032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368250.096104:0:24032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368250.096113:0:24032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368250.096121:0:24032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368250.096124:0:24032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787368250.096127:0:24032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368250.096134:0:24032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787368250.096170:0:24032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787368250.096604:0:25924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368250.096615:0:25924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787368250.099444:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+9:2402:x1874190788650240:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 218us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368250.099471:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00010000:00010000:2.0:1787368250.107654:0:24389:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787368250.107674:0:24389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787368250.179806:0:24380:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1787368250.179837:0:24380:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1787368250.180857:0:25924:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1787368250.180865:0:25924:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1787368249 -> 1787368250 00002000:00010000:0.0:1787368250.180868:0:25924:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787368249 -> 1787368250 00002000:00010000:0.0:1787368250.180871:0:25924:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1787368250.180887:0:25924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368250.180901:0:25924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368250.181108:0:25924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368250.181115:0:25924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241c600 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:0.0:1787368250.181119:0:25924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368250.181137:0:25924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368250.181155:0:25924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787368250.181162:0:25924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdddcf24/0x66f5679bff032c94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787368250.181894:0:25924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+7:2404:x1874190788650112:12345-192.168.203.4@tcp:4:dd.0 Request processed in 88006us (89157us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787368250.181910:0:25924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000001:00080000:1.0:1787368250.208854:0:24380:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:3.0:1787368250.209054:0:24389:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:3.0:1787368250.209087:0:24389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.209100:0:24389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.209109:0:24389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.209116:0:24389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c558241ce00 already unused, calling callback (ffffffffc0b31420) 00010000:00010000:3.0:1787368250.209121:0:24389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.209130:0:24389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.209149:0:24389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787368250.209180:0:24389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4678ae/0x66f5679bff032c8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787368250.209278:0:24389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55be7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2405:x1874190788649984:12345-192.168.203.4@tcp:4:dd.0 Request processed in 122766us (123072us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787368250.209288:0:24389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00010000:00010000:2.0:1787368250.264502:0:22867:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787368251.290585:0:25906:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787368251.481893:0:25961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1787368251.800650:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808663168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787368251.800737:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368251.801183:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808663168 00000100:00100000:2.0:1787368251.801197:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808663296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787368251.801205:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808663168 00000100:00100000:2.0:1787368251.801238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787368251.801260:0:24387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808663296 00000100:00100000:1.0:1787368251.801264:0:24387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808663296 00000100:00100000:1.0:1787368251.801288:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787368251.801299:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c54845b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808663168:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787368251.801301:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787368251.801327:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787368251.801407:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c54845b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874190808663168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368251.801416:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787368251.801433:0:24387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787368251.801441:0:24387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808663296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787368251.801451:0:24387:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787368251.801463:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874190808663168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787368251.801497:0:24387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874190808663296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787368251.801504:0:24387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787368251.801676:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787368251.801686:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808663424:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.801718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368251.801750:0:22873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808663424 00000100:00100000:0.0:1787368251.801754:0:22873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808663424 00000100:00100000:0.0:1787368251.801780:0:22873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787368251.801787:0:22873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3654:x1874190808663424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.801819:0:22873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdb7fc68-6ac7-4a03-989c-ef7cf48653be+24:3654:x1874190808663424:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368251.801825:0:22873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787368251.801851:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdb7fc68-6ac7-4a03-989c-ef7cf48653be:3654:1874190808663424:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.801877:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808663552:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.801908:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368251.801934:0:22883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808663552 00000100:00100000:0.0:1787368251.801938:0:22883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808663552 00000100:00100000:0.0:1787368251.801957:0:22883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787368251.801963:0:22883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808663552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.801994:0:22883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874190808663552:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368251.801999:0:22883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787368251.802018:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874190808663552:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.802052:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787368251.802058:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808663936:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.802080:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368251.802116:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808664064:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.802141:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368251.802169:0:24383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808664064 00000100:00100000:0.0:1787368251.802173:0:24383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808664064 00000100:00100000:0.0:1787368251.802205:0:24383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787368251.802212:0:24383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808664064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.802246:0:24383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808664064:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368251.802252:0:24383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787368251.802280:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808664064:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.802318:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787368251.802325:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808664448:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.802351:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787368251.802419:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808664576:0@lo:400:kworker.0 00000100:00100000:2.0:1787368251.802568:0:23621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808663936 00000100:00100000:2.0:1787368251.802573:0:23621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808663936 00000100:00100000:2.0:1787368251.802601:0:23621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787368251.802608:0:23621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5483711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808663936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368251.802642:0:23621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5483711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874190808663936:12345-0@lo:400:kworker.0 Request processed in 35us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368251.802656:0:23621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787368251.802683:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787368251.802696:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808663680:0@lo:400:kworker.0 00000100:00100000:2.0:1787368251.802722:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368251.802741:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808664192:0@lo:400:kworker.0 00000100:00100000:2.0:1787368251.802767:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368251.802787:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787368251.802794:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c5483710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808663808:0@lo:400:kworker.0 00000100:00100000:3.0:1787368251.802843:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874190808663296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787368251.802886:0:24385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808663680 00000100:00100000:3.0:1787368251.802891:0:24385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808663680 00000100:00100000:3.0:1787368251.802921:0:24385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787368251.802926:0:24385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808663680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787368251.803137:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808664448 00000100:00100000:1.0:1787368251.803141:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808664448 00000100:00100000:1.0:1787368251.803170:0:22879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808664192 00000100:00100000:1.0:1787368251.803173:0:22879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808664192 00000100:00100000:1.0:1787368251.803190:0:22879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787368251.803197:0:22879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808664448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368251.805693:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368251.805891:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55bd8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808664320:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.806005:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787368251.806011:0:24385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874190808663680:12345-0@lo:400:kworker.0 Request processed in 3080us (3283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368251.806025:0:24385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787368251.806046:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874190808663936:0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.806087:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808663808 00000100:00080000:3.0:1787368251.806093:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787368251.806094:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808663808 00000100:00080000:3.0:1787368251.806101:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787368251.806128:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808664576 00000100:00100000:3.0:1787368251.806132:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808664576 00000100:00100000:0.0:1787368251.806134:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787368251.806145:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808664192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368251.806167:0:24580:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787368251.806175:0:24580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787368251.806195:0:22878:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787368251.806199:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874190808664192:12345-0@lo:400:kworker.0 Request processed in 55us (3433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368251.806206:0:22878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787368251.806214:0:22878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808663808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787368251.806267:0:22878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874190808663808:12345-0@lo:400:kworker.0 Request processed in 49us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368251.806268:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368251.806290:0:3651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1787368251.806295:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c54845b0380, transno 12884901892 00000004:00080000:2.0:1787368251.806307:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1787368251.806323:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874190808663680:0@lo:400:kworker.0 00000100:00100000:2.0:1787368251.806339:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874190808664192:0@lo:400:kworker.0 00000100:00100000:1.0:1787368251.806345:0:22879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874190808664448:12345-0@lo:400:kworker.0 Request processed in 3145us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368251.806388:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c5483710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874190808663808:0@lo:400:kworker.0 00000100:00080000:2.0:1787368251.806528:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787368251.806710:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c55afa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808664704:0@lo:400:kworker.0 00000100:00100000:2.0:1787368251.806737:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787368251.806798:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808664320 00000100:00100000:2.0:1787368251.806802:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808664320 00000100:00100000:0.0:1787368251.810127:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787368251.810171:0:22880:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787368251.810184:0:22880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190808664704 00000100:00100000:0.0:1787368251.810191:0:22880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190808664704 00000100:00100000:0.0:1787368251.810223:0:22880:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787368251.810230:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787368251.810238:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808664576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.810315:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874190808664576:12345-0@lo:400:kworker.0 Request processed in 78us (4311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368251.810322:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787368251.810331:0:22880:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787368251.810336:0:22880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787368251.810341:0:22880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808664704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787368251.810392:0:22880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874190808664704:12345-0@lo:400:kworker.0 Request processed in 50us (3654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368251.810397:0:22880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787368251.810682:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55afa75f80 x1874190808664704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368251.810714:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55afa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874190808664704:0@lo:400:kworker.0 00000100:00100000:3.0:1787368251.810751:0:22878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787368251.810755:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874190808664576:0@lo:400:kworker.0 00010000:00080000:0.0:1787368251.810772:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c55bd8f0e00 x1874190808664448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787368267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787368251.810781:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874190808664448:0@lo:400:kworker.0 00000100:00080000:3.0:1787368251.810919:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787368251.810924:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787368251.813268:0:22879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787368251.817203:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787368251.817230:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808664320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787368251.817376:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55afa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874190808664320:12345-0@lo:400:kworker.0 Request processed in 160us (11112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787368251.817384:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787368251.817501:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c55bd8f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874190808664320:0@lo:400:kworker.0 00000100:00100000:0.0:1787368252.213890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368252.213930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368252.213953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368252.213974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368252.213989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368252.214006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368252.214023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368252.214039:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1787368252.214054:0:22871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788650368 00000100:00100000:3.0:1787368252.214063:0:22871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788650368 00000100:00100000:0.0:1787368252.214075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1787368252.214096:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788650624 00000100:00100000:0.0:1787368252.214108:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788650624 00000100:00100000:3.0:1787368252.214109:0:22871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:3.0:1787368252.214117:0:22871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c5591244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+13:2404:x1874190788650368:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368252.214142:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788651136 00000100:00100000:0.0:1787368252.214145:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788651136 00000100:00100000:0.0:1787368252.214157:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788650496 00000100:00100000:0.0:1787368252.214164:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788650496 00000100:00100000:0.0:1787368252.214177:0:24580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788651008 00000100:00100000:0.0:1787368252.214180:0:24580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788651008 00000100:00100000:3.0:1787368252.214190:0:22871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c5591244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7db1a22-e032-464d-a4cf-1677c572dedf+13:2404:x1874190788650368:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787368252.214193:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1787368252.214198:0:22871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:0.0:1787368252.214199:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2404:x1874190788650624:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368252.214228:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788650880 00000100:00100000:0.0:1787368252.214229:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2404:x1874190788650624:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368252.214231:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788650880 00000100:00100000:0.0:1787368252.214244:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 59 00000100:00100000:3.0:1787368252.214247:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788651392 00000100:00100000:3.0:1787368252.214249:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788651392 00000100:00100000:0.0:1787368252.214257:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:3.0:1787368252.214258:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788650752 00000100:00100000:3.0:1787368252.214260:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788650752 00000100:00100000:0.0:1787368252.214263:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+5:2404:x1874190788651136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368252.214271:0:24384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190788651264 00000100:00100000:3.0:1787368252.214273:0:24384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190788651264 00000100:00100000:3.0:1787368252.214286:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1787368252.214287:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+5:2404:x1874190788651136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368252.214291:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2404:x1874190788650880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368252.214292:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:0.0:1787368252.214303:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:0.0:1787368252.214308:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+22:2404:x1874190788650496:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368252.214313:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2404:x1874190788650880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368252.214318:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1787368252.214328:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1787368252.214332:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0376d49e-ddfe-46c2-91e5-49eaeca90b82+22:2404:x1874190788650496:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368252.214334:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ab70352-efce-480e-a808-993671ad30dd+5:2404:x1874190788651392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368252.214338:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:0.0:1787368252.214348:0:24580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:0.0:1787368252.214374:0:24580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+6:2404:x1874190788651008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368252.214377:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ab70352-efce-480e-a808-993671ad30dd+5:2404:x1874190788651392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 19us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368252.214390:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1787368252.214400:0:24580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab70352-efce-480e-a808-993671ad30dd+6:2404:x1874190788651008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 47us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368252.214402:0:24384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1787368252.214406:0:24580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1787368252.214407:0:24384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2404:x1874190788650752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1787368252.214423:0:24818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:0.0:1787368252.214429:0:24818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ab70352-efce-480e-a808-993671ad30dd+5:2404:x1874190788651264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1787368252.214430:0:24384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0376d49e-ddfe-46c2-91e5-49eaeca90b82+5:2404:x1874190788650752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787368252.214435:0:24384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1787368252.214446:0:24818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c55bd626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ab70352-efce-480e-a808-993671ad30dd+5:2404:x1874190788651264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 18us (371us total) trans 0 rc 0/0 00000100:00080000:3.0:1787368252.214449:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787368252.214452:0:24818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00080000:3.0:1787368252.214453:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787368252.214455:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787368252.214457:0:22874:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787368252.312467:0:22866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 59316 lines, 59316 kept, 0 dropped, 0 bad.